The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. So why mess with it?

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. The short answer is no.

Energy 130

Energy Latency Performance Network 130

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. A key step in digital transformation is migrating from traditional on-prem IT processes to adopting cloud services. What is cloud migration?

Cloud 165

Cloud Traffic Best Practices Strategy 165

Adrian Cockcroft

MARCH 17, 2020

Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. Is the model of the controlled process looking at the right metrics and behaving safely? Book: Engineering a Safer World by Nancy G. They could do nothing, because they hope the problem will go away on its own.

Healthcare 52

Healthcare Government Airlines Systems 52

Percona

NOVEMBER 9, 2023

Your workloads, encapsulated in containers, can be deployed freely across different clouds or your own hardware. Role-Based Access Control (RBAC) : RBAC manages permissions to ensure that only individuals, programs, or processes with the proper authorization can utilize particular resources. have adopted Kubernetes.

Efficiency 104

Efficiency Cloud Healthcare Open Source 104

Percona

JUNE 22, 2023

long_query_time: Defines the threshold for query execution time, and queries taking longer than this threshold are considered slow and logged for further analysis innodb_buffer_pool_size: Sets the size of the InnoDB buffer pool. The point we’re making here is they are critical for MySQL Performance.

Performance 105

Performance Monitoring Traffic Database 105

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. An advanced observability solution can also be used to automate more processes, increasing efficiency and innovation among Ops and Apps teams.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. What about short-lived processes, like a service restarting in a loop? This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. These can be invisible to top(8).

Speed 126

Speed Java AWS Virtualization 126

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. A finely tuned database processes queries more efficiently, leading to swifter results. MySQL relies heavily on the availability of hardware resources to perform at its best.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. bpftrace is suited for this kind of analysis: decomposing metrics into distributions or per-event logs, and creating new metrics for visibility into blind spots. pid process ID.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

JULY 4, 2019

Moreover, just like an A/B test, we’ll be collecting metrics while the experiment is underway and performing statistical analysis at the end to interpret the results. degraded hardware, transient networking problem) or, more often, because of some change deployed by Netflix engineers that did not have the intended effect.

Latency 77

Latency Engineering Metrics Traffic 77

Dotcom-Montior

DECEMBER 8, 2021

Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation. ITSM is the policies, processes, and structure behind the lifecycle of IT services. Incident Management Lifecyle: Process and Steps. Service Desk.

Social Media 90

Social Media Monitoring Latency DevOps 90

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78

HammerDB

OCTOBER 23, 2023

Note that for all tests, we used the local loopback address and port to provide the lowest possible network latency between client and server and also so we don’t have any concerns about bandwidth limitations. Database information and performance schemas The best approach for database performance analysis is to take a top-down approach.

Benchmarking 62

Benchmarking Database Network C++ 62

CSS - Tricks

JULY 25, 2019

Over the past couple of years, it has become the go-to free performance analysis tool. Estimated Input Latency. This process works by obtaining mobile 75th and 95th percentiles from HTTP Archive , then applying a log normal function. Estimated Input Latency. What is Google Lighthouse? Speed Index. First CPU Idle.

Google 71

Google Engineering Speed Mobile 71

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. What about short-lived processes, like a service restarting in a loop? This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. These can be invisible to top(8).

Speed 52

Speed Java AWS Virtualization 52

Adrian Cockcroft

NOVEMBER 11, 2019

Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. This discussion focuses on hardware, software and operational failure modes. Try to measure your mean time to respond (MTTR) for incidents. Book: Engineering a Safer World by Nancy G.

Latency 52

Latency Engineering Systems Hardware 52

Alex Russell

MARCH 6, 2021

Advances in browser content processing. Hardware Past As Performance Prologue. If those specs sound eerily familiar, it's perhaps because they're identical to 2016's $200USD Moto G4 , all the way down to the 2011-vintage 28nm SoC process node used to fab the chip's anemic, 2012-vintage A53 cores. Mind The Gap.

Performance 124

Performance Network Cache Metrics 124

Adrian Cockcroft

NOVEMBER 11, 2019

Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures. This discussion focuses on hardware, software and operational failure modes. Try to measure your mean time to respond (MTTR) for incidents. Book: Engineering a Safer World by Nancy G.

Latency 53

Latency Engineering Systems Hardware 53

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

All Things Distributed

NOVEMBER 15, 2010

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. For example, the most fundamental abstraction trade-off has always been latency versus throughput.

AWS 136

AWS Latency Programming Architecture 136

Brendan Gregg

AUGUST 8, 2017

This measures demand, which can be greater than what the system is currently processing. 42/3411 43603. . ## History The original load averages show only CPU demand: the number of processes running plus those waiting to run. The load average is an average of the number of runnable processes over a given time period.

Latency 111

Latency Metrics C++ Systems 111

Alex Russell

JANUARY 30, 2024

HTML, CSS, images, and fonts can all be parsed and run at near wire speeds on low-end hardware, but JavaScript is at least three times more expensive, byte-for-byte. Meanwhile, budget segment devices have finally started to see improvement ( as this series predicted ), thanks to hand-me-down architecture and process node improvements.

Performance 90

Performance Network Mobile Speed 90

Smashing Magazine

AUGUST 3, 2021

This liberal attitude is known as Postel’s Law, which is conveyed superbly by Jeremy Keith in Resilient Web Design : “Even if there are errors in the HTML or CSS, the browser will still attempt to process the information, skipping over any pieces that it can’t parse.”. JavaScript is less forgiving. Resilience is extrinsic. More after jump!

Network 145

Network Engineering Availability Monitoring 145

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. What about short-lived processes, like a service restarting in a loop? This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. These can be invisible to top(8).

Speed 40

Speed Java AWS Virtualization 40

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Read/Write latency. Read/Write requests are processes with a minimal latency.

Database 213

Database Latency C++ Scalability 213

KeyCDN

AUGUST 15, 2019

Types of Performance Tests Although web page testing tools are helpful and can give you a quick overview of a website’s speed and overall performance, you should conduct a more thorough analysis using a variety of tests including: Load Tests: Load tests look at how increased workload affects an application’s response time.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Dynatrace

AUGUST 5, 2019

It covers these key areas: Technology & Dependency Analysis. Resource consumption & traffic analysis. Before starting any migration project, you must have a good overview of all your hosts, processes, services and technologies. Step 2: Understand your Dependencies: No Host or Process left alone!

Cloud 31

Cloud Traffic Database Network 31

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Helps media apps on the web save battery when doing video processing. Coordination APIs allow applications to save memory and processing power (albeit, most often in desktop and tablet form-factors). Shape Detection.

Media 145

Media Games Education Engineering 145

Alex Russell

OCTOBER 22, 2017

Answering it requires an understanding of how browsers process resources (which differs by type) and the concept of the critical path. This input processing happens on document’s main thread , where JavaScript runs. Processing input (including scrolling w/ active touch listeners). ” A good question!

Performance 68

Performance Benchmarking Network Mobile 68

Brendan Gregg

SEPTEMBER 5, 2017

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Alex Russell

JUNE 20, 2020

After all, those are properties that browsers compete on, benefiting users in the process. In each quantum of time, hardware and OS vendors press ahead, adding features. As OS and hardware deployed base integrate these components, the set of what most computers can do is expanded.

Hardware 55

Hardware Games Java Media 55

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Treo Sites provides competitive analysis based on real-world data. Establish a performance culture. Large preview ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Micro-optimizations are great for keeping performance on track, but it’s critical to have clearly defined targets in mind — measurable goals that would influence any decisions made throughout the process. Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Media Metrics 145