The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. So why mess with it?

Cache 251

Cache Latency Airlines Logistics 251

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables). One use case for STM is to model the behavior of a customer in the form of a flow of transactions along the buyer’s journey.

Monitoring 209

Monitoring Social Media IoT Metrics 209

Testsigma

DECEMBER 12, 2020

To ease out the web development, developers think of new ways to have a dedicated and organised system of sustainable websites such as subgrids. Let alone browsers, the website may get into trouble for different resolutions, different operating systems and different browser versions too!! Challenges In Cross-Browser Testing.

Testing 53

Testing Operating System Website Latency 53

ScaleOut Software

APRIL 6, 2021

It also deploys real-time digital twin models to the in-memory data grid, which hosts instances of digital twins (one per data source) and runs application-defined code to process incoming messages. This simplifies the installation process and ensures portability across operating systems.

IoT 52

IoT Azure Analytics Healthcare 52

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times.

Strategy 130

Strategy Monitoring Latency DevOps 130

All Things Distributed

NOVEMBER 13, 2014

AWS handles all the administration of the underlying compute resources, including server and operating system maintenance, capacity provisioning and automatic scaling, code and security patch deployment, and code monitoring and logging. You can go from code to service in three clicks and then let AWS Lambda take care of the rest.

Lambda 136

Lambda AWS Cloud Scalability 136

Dynatrace

AUGUST 25, 2023

These signals ( latency, traffic, errors, and saturation ) provide a solid means of proactively monitoring operative systems via SLOs and tracking business success. Performance typically addresses response times or latency aspects and contributes to the four golden signals.

Performance 178

Performance Latency Traffic Metrics 178

cdemi

DECEMBER 4, 2016

The service retrieves the messages from the queue and processes them. Requests from a number of different tasks, which can be generated at a highly variable rate , can be passed to the service through the same message queue and will be processed at a constant rate that the service can work at.

Design 47

Design Azure Scalability Latency 47

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. This leads us to the process page of our specific Apache instance.

Metrics 175

Metrics Monitoring Database Network 175

Dynatrace

JANUARY 26, 2021

Traditional computing models rely on virtual or physical machines, where each instance includes a complete operating system, CPU cycles, and memory. REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. The provider is essentially your system administrator.

Serverless 245

Serverless Efficiency Lambda Azure 245

Dotcom-Montior

NOVEMBER 24, 2021

Web developers or administrators did not have to worry or even consider the complexity of distributed systems of today. Great, your system was ready to be deployed. Once the system was deployed, to ensure everything was running smoothly, it only took a couple of simple checks to verify. What is a Distributed System?

Systems 74

Systems Monitoring Hardware Network 74

The Netflix TechBlog

SEPTEMBER 24, 2021

By Xiaomei Liu , Rosanna Lee , Cyril Concolato Introduction Behind the scenes of the beloved Netflix streaming service and content, there are many technology innovations in media processing. Packaging has always been an important step in media processing. Uploading and downloading data always come with a penalty, namely latency.

Cloud 237

Cloud Media Storage Cache 237

Dynatrace

JUNE 25, 2020

This means that Dynatrace continues full operation when a majority of nodes are up and a maximum of two nodes are down at a time. The network latency between cluster nodes should be around 10 ms or less. Cluster nodes reside in both data centers and they continuously process, store, and replicate data. What’s next?

Availability 251

Availability Hardware Latency Traffic 251

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. In the realm of cloud-based business operations, there is an increasing dependence on complex information processing patterns.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MARCH 23, 2023

As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Operating system Linux is the most common operating system for high-performance MySQL servers. But also larger log files mean that the recovery process will be slower in case of a crash.

Performance 123

Performance Hardware Tuning Storage 123

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. switches to connect processing nodes, pooled memory and I/O resources into very large coherent fabrics within a rack, and use Ethernet between racks.

Architecture 52

Architecture Latency Benchmarking AWS 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

JUNE 30, 2019

Here’s the set-up as relayed to me by Pat (with permission): At work, I am part of a good sized team working on a large system implementation. One of the very senior engineers with 25+ years experience mentioned a problem with the system. In such a situation I’d expect to see unusually high latencies, but normal throughput).

Traffic 75

Traffic Latency Programming Scalability 75

John McCalpin

APRIL 2, 2020

The presentation discusses a family of simple performance models that I developed over the last 20 years — originally in support of processor and system design at SGI (1996-1999), IBM (1999-2005), and AMD (2006-2008), but more recently in support of system procurements at The Texas Advanced Computing Center (TACC) (2009-present).

Benchmarking 59

Benchmarking Performance Latency Architecture 59

All Things Distributed

MARCH 11, 2016

Build evolvable systems. But we couldn’t adopt the old style approach of upgrading systems through a maintenance outage, as many businesses around the world are relying on our platform for 24/7 availability. We needed to build systems that embrace failure as a natural occurrence even if we did not know what the failure might be.

AWS 147

AWS Hardware Retail Virtualization 147

The Morning Paper

MAY 21, 2019

” This paper describes a “far memory” system that has been in production deployment at Google since 2016. This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions.

Software 78

Software Software Google Hardware 78

All Things Distributed

APRIL 9, 2015

The Amazon ML console and API provide data and model visualization tools, as well as wizards to guide you through the process of creating machine learning models, measuring their quality and fine-tuning the predictions to match your application requirements. The Amazon Elastic File System. Details on the AWS Blog. for a while already.

Lambda 123

Lambda Cloud IoT AWS 123

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN304 Learnings from migrating a service from JDK 8 to JDK 11 AWS Lambda improved latency by migrating to JDK 11 with Amazon Corretto.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks.

Latency 53

Latency Engineering Systems Hardware 53

O'Reilly Software

APRIL 4, 2018

We live in the era of the connected experience, where our daily interactions with the world can be digitized, collected, processed, and analyzed to generate valuable insights. Accumulating all this data to process overnight is not an option anymore. Do we need to process each record individually? Process tolerance.

Architecture 80

Architecture Scalability Google Operating System 80

Testsigma

JULY 23, 2020

This is a standalone software program which doesn’t depend on any internet connectivity for its working and its performance is not impacted because of any network related latencies. Any network-related latencies result in performance hindrances in these types of applications.

Testing 63

Testing Internet Internet Latency 63

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. This capability is valuable for reverting to a previous state, whether to recover from data corruption or any other incident.

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

APRIL 14, 2019

Just as today’s systems offer memory protection, they call this time protection. The paper focuses on two key use cases: A confined component running in its own security domain, connected to the rest of the system by explicit (e.g. Even when we do flush caches, the latency of flushing can itself be used as a channel!

Hardware 44

Hardware Cache Latency Speed 44

All Things Distributed

OCTOBER 2, 2017

About 20 percent would return a set of rows, but still operate on only a single table. The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit.

Internet 130

Internet Internet AWS Performance 130