Brendan Gregg

MAY 1, 2022

My dream is to turn computer performance analysis into a science, one where we can completely understand the performance of everything: of applications, libraries, kernels, hypervisors, firmware, and hardware. Teaching others is another passion of mine – it's what drives me to write books, create training materials, and write blog posts here.

Wireless 145

Wireless Hardware Open Source AWS 145

O'Reilly

SEPTEMBER 15, 2021

Most respondents participated in training of some form. Learning new skills and improving old ones were the most common reasons for training, though hireability and job security were also factors. Company-provided training opportunities were most strongly associated with pay increases. Demographics.

Azure 145

Azure Social Media Programming AWS 145

Percona

DECEMBER 27, 2023

At Percona, we observe a growing trend among companies utilizing Kubernetes as a means to offer services to their teams, fostering expedited software delivery and driving business growth. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 80

Cloud Open Source Strategy Best Practices 80

Dynatrace

OCTOBER 26, 2020

First, they used a video camera and trained an AI model but then decided to use a less privacy-intrusive variant with an infrared sensor. For all the hardware geeks – here is the architectural overview of his project: Architectural overview of all involved components in his COVID-19 home innovation project. Raspberry Pi Model 3 B.

Innovation 159

Innovation Metrics Hardware Games 159

Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The other continuing trend is to custom silicon, with specialized accelerators and the ARM based Graviton range from AWS, Apple’s M1 series, Tesla’s in car processor and training engines etc.

Serverless 98

Serverless Hardware AWS Architecture 98

Testlodge

MARCH 12, 2024

End-to-end tests can often include hardware. If this is the case, request hardware units as early as possible to avoid any delays in testing due to supply issues. It has an abundance of training tutorials and documentation. Cypress – Cypress is also an open-source tool for end-to-end testing of web applications.

Systems 90

Systems Testing Open Source Hardware 90

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 108

Availability Database Open Source Hardware 108

ACM Sigarch

MAY 31, 2023

using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management. About CXL hardware availability with academia. Using emulation (e.g.

Latency 52

Latency Hardware Cache Architecture 52

Scalegrid

JANUARY 5, 2024

It comprises a collection of interrelated data and a set of software tools that aid in the access, processing, and management of data. A DBMS, or Database Management System, is software used to store, retrieve, and manipulate data, serving as an interface between users and the database. What is the main advantage of using a database?

Efficiency 147

Efficiency Storage Database Scalability 147

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little. Reduced cost.

Cloud 172

Cloud Traffic Best Practices Strategy 172

ACM Sigarch

APRIL 26, 2018

They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens. FPU: Floating Processing Unit (FPU).

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

OCTOBER 18, 2023

Limited toolset and features Another challenge that organizations may face when considering open source is the perception that community software versions have a limited set of features. Security and risk The question “ Is Open Source software safe? Does anyone on my team require further training before we start?

Open Source 92

Open Source Database Hardware Strategy 92

The Morning Paper

FEBRUARY 18, 2020

The key insight this led to is that ML models are software , derived from data. ML learning systems combine the characteristics of software, e.g. the need for CI/CD pipelines, and of data, e.g. the need to track lineage. Many of the software engineering discipline and controls need to be brought over into an ML context.

Government 95

Government Software Engineering Storage Database 95

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. Standard stuff.

Cache 126

Cache Latency Benchmarking Hardware 126

DZone

FEBRUARY 27, 2021

As a Software Engineer, the mind is trained to seek optimizations in every aspect of development and ooze out every bit of available CPU Resource to deliver a performing application. This begins not only in designing the algorithm or coming out with efficient and robust architecture but right onto the choice of programming language.

Java 207

Java C++ Benchmarking Programming 207

Testsigma

MAY 3, 2021

We love it so much that we devise new ways all the time to incorporate automation in each and every field of software development. Mobile devices are the most fragmented thing you will ever work with while developing software. Test automation in conventional software is straightforward. Training and Selecting Right Tool Stack.

Mobile 77

Mobile Testing Operating System Hardware 77

The Morning Paper

FEBRUARY 27, 2020

Modern software systems at scale are incredibly complex ever changing environments. This paper describes Gandalf, the software deployment monitor in production at Microsoft Azure for the past eighteen months plus. The training data is generated from historical deployment cases with feedback from component teams. NSDI’20.

Analytics 68

Analytics Infrastructure Cloud Hardware 68

Brendan Gregg

MAY 1, 2022

My dream is to turn computer performance analysis into a science, one where we can completely understand the performance of everything: of applications, libraries, kernels, hypervisors, firmware, and hardware. I now have an opportunity at Intel to grow further in my career, and to help grow other people.

Wireless 52

Wireless Hardware Open Source Cloud 52

The Netflix TechBlog

DECEMBER 23, 2020

everything from the frontend API for netflix.com, to machine learning training workloads, to video encoders. Various pieces of software used elevated capabilities for FUSE, low-level packet monitoring, and performance tracing amongst other use cases. It runs a wide variety of workloads from various parts of the company?—?everything

Media 286

Media Metrics Systems Processing 286

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. You may already be using it daily and find it makes running applications in the cloud much more manageable.

Efficiency 103

Efficiency Cloud Healthcare Open Source 103

Tasktop

MAY 28, 2020

And first to invent the “Top Gun” Air Combat Training System back in the early ‘70s. . At the forefront of Cubic’s Agile transformation to help the company innovate even faster is VP and CTO, Jim Colson, a former IBM fellow and a leading authority in scaling software delivery. Accelerating with a Software/Hardware Hybrid.

Speed 52

Speed Metrics Transportation Hardware 52

The Morning Paper

MAY 14, 2019

A DNN model is trained to recognise patterns in space and time that lead to QoS violations. When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation. Seer in action.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

APRIL 29, 2019

Various software systems are needed to design, build, and operate this CDN infrastructure, and a significant number of them are written in Python. Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites.

Open Source 279

Open Source Network Infrastructure Big Data 279

ACM Sigarch

APRIL 8, 2019

This is arguably a fundamentally hard problem for computer architecture, but efforts towards open source hardware (eg. Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Lena Olson is a Software Engineer at Google. . gem5 ) are baby steps towards this goal.

Architecture 74

Architecture Open Source Hardware Software Engineering 74

CSS Wizardry

OCTOBER 27, 2018

My involvement with clients here is usually workshops and training: teaching developers the knowledge and tooling required to effectively conduct performance audits, and making teams self-sufficient. Who: Engineers. When: During development. Do certain browsers or geographic locales suffer more than others?

Performance Testing 172

Performance Testing Testing Performance Strategy 172

The Netflix TechBlog

FEBRUARY 13, 2020

There is a potential benefit in reusing the hardware in place for video compression/decompression. Image decoding in hardware may not be a primary motivator, given the peculiarities of OS dependent UI composition, and architectural implications of moving uncompressed image pixels around.

Code 212

Code Metrics Efficiency Open Source 212

The Morning Paper

SEPTEMBER 26, 2019

However, the widespread availability of powerful and low-cost software-defined radio platforms has altered the threat landscape. …pilots are trained and instructed to trust the instruments more than their intuition. If the instruments ask them to fly right, the pilots will fly right.

Wireless 91

Wireless Systems Airlines Hardware 91

Sutter's Mill

NOVEMBER 11, 2023

This week’s meeting: Meeting #2 of C++26 At the previous meeting in June, the committee adopted the first 40 proposed changes for C++26, including many that had been ready for a couple of meetings and were just waiting for the C++26 train to open to be adopted. For those highlights, see the previous trip report. This is that library.

C++ 107

C++ Lambda Network Programming 107

All Things Distributed

NOVEMBER 30, 2016

automatic speech recognition, natural language understanding, image classification), collect and clean the training data, and train and tune the machine learning models. Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

Smashing Magazine

OCTOBER 11, 2022

In his recent Smashing Conference talk, green software expert Asim Hussain mentioned that the biggest shift he is seeing is as a result of regulation — or the threat of regulation. Hardware And E-Waste. The Environment Variables podcast from the Green Software Foundation has an episode on Accessibility and Sustainability.

Strategy 124

Strategy Development Energy Website 124

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

All Things Distributed

SEPTEMBER 4, 2017

And thirdly, an "algorithmic revolution" has taken place, meaning it is now possible to train trillions of algorithms simultaneously, making the whole machine learning process much faster. For the past 20 years, thousands of software engineers at Amazon have been working on ML. Machine Leaning at Amazon.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down.

Energy 52

Energy Cloud Traffic Transportation 52

Alex Russell

APRIL 29, 2021

Education, tools, and training all support the premise that supporting more browsers is better ( ceteris paribus ), creating a substantial incentive to grease squeaky wheels. is access to hardware devices. This allows customisation and use of specialised features without custom, proprietary software for niche hardware.

Media 145

Media Games Education Engineering 145

CSS Wizardry

APRIL 2, 2018

When I’m on a flight (as I am right now) or a train, this extra bulk doesn’t bother me too much—I get settled in anyway, so I don’t mind the extra room it takes. If I go down this path, I’ll need to start considering many other things such as storage, backups, compatible media players, and maybe even dedicated hardware. Review (?????).

Website 108

Website Media Hardware Monitoring 108

O'Reilly

NOVEMBER 28, 2023

Training models and developing complex applications on top of those models is becoming easier. Many of the new open source models are much smaller and not as resource intensive but still deliver good results (especially when trained for a specific application). report that the difficulty of training a model is a problem.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

All Things Distributed

MARCH 13, 2017

Previously, the top priorities for IT departments were equipping data centers with hardware, purchasing software, and further developing proprietary software. Today, companies take their server capacity and software from the cloud. These days, it's expected that everything should happen almost simultaneously.

Social Media 84

Social Media Retail Automotive Innovation 84