The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

NOVEMBER 14, 2019

Taiji: managing global user traffic for large-scale internet services at the edge Xu et al., It’s another networking paper to close out the week (and our coverage of SOSP’19), but whereas Snap looked at traffic routing within the datacenter, Taiji is concerned with routing traffic from the edge to a datacenter. SOSP’19.

Traffic 42

Traffic Internet Internet Latency 42

The Morning Paper

NOVEMBER 15, 2020

This stems from a combination of Jevon’s paradox and the interconnectedness of systems – doing more in one area often leads to a need for more elsewhere too. At the end of the day, there are three basic ways we can increase capacity: Increasing the number of units in a system (subject to Amdahl’s law ). IDS/IPS requirements.

Servers 128

Servers Hardware Latency Design 128

Percona

JUNE 22, 2023

Number of slow queries recorded Select types, sorts, locks, and total questions against a database Command counters and handlers used by queries give an overall traffic summary Along with this, PMM also comes with Query Analytics giving much detailed information about queries getting executed.

Performance 102

Performance Monitoring Traffic Database 102

Percona

MAY 1, 2023

Recently I was engaged in a MySQL Performance Audit for a customer to help troubleshoot performance issues that led to downtime during periods of high traffic on their AWS RDS MySQL instances. The innodb_io_capacity_max parameter was set to 2000, so the hardware should be able to deliver that many IOPS without major issues.

AWS 117

AWS Hardware Storage Tuning 117

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). This can result in significant cost savings for high traffic applications. Expert Tip.

Cloud 242

Cloud Azure AWS Database 242

Dotcom-Montior

MAY 12, 2020

They now allow users to interact more with the company in the form of online forms, shopping carts, Content Management Systems (CMS), online courses, etc. Network latency. Hardware resources. Network Latency. Network latency can be affected due to. Hardware Resources. The list goes on and on. Wi-Fi usage.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. As well as AWS Regions, we also have 24 AWS Edge Network Locations in Europe.

AWS 116

AWS Airlines Latency Games 116

The Netflix TechBlog

FEBRUARY 9, 2021

Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. To reduce latency, assets should be generated in an offline fashion and not in real time. Let’s put it all together and review the system interaction diagram.

Engineering 165

Engineering Storage Latency Entertainment 165

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This reduction in latency ensures that applications and websites provide a more rapid and responsive user experience. Another highly beneficial caching method is key-value caching.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

MARCH 11, 2016

Build evolvable systems. But we couldn’t adopt the old style approach of upgrading systems through a maintenance outage, as many businesses around the world are relying on our platform for 24/7 availability. This is a given, whether you are using the highest quality hardware or lowest cost components. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

Dotcom-Montior

NOVEMBER 11, 2020

Serverless computing can be a huge benefit to organizations that don’t have the necessary resources or teams to manage physical resources, like servers/hardware, and all the maintenance and licensing that goes along with that, allowing them to focus on developing their code and applications. Benefits of a Serverless Model.

Serverless 57

Serverless Monitoring Lambda Latency 57

The Morning Paper

JULY 4, 2019

Are you ready to take your system assurance programme to the next level? In all cases we need to be able to carefully monitor the impact on the system, and back out if things start going badly wrong. Netflix’s system is deployed on the public cloud as complex set of interacting microservices.

Latency 77

Latency Engineering Metrics Traffic 77

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day.

AWS 124

AWS Cloud Games Serverless 124

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Hardware Optimizers” want to get the maximum utilization out of hardware. Telcos and Fortune 500 corporations used to spend years defining custom systems, down to the last cable. Vikings fight zombies.

Hardware 56

Hardware Latency Virtualization Cloud 56

HammerDB

OCTOBER 23, 2023

With a simple example such as this, it would not necessarily be expected for the additional network traffic to be significant between the 2 approaches. Stored Procedures and Client SQL comparison To test the stored procedures and client implementations, we ran both workloads against a system equipped with Intel Xeon 8280L.

Benchmarking 62

Benchmarking Database Network C++ 62

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. on end-to-end latency) and less than 0.15% on throughput.

Big Data 45

Big Data Cloud Performance Hardware 45

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Hardware Optimizers” want to get the maximum utilization out of hardware. Telcos and Fortune 500 corporations used to spend years defining custom systems, down to the last cable. Vikings fight zombies.

Hardware 40

Hardware Latency Virtualization Cloud 40

VoltDB

JUNE 29, 2017

This allows publishers to establish a “premium” auction instead of the typical real-time bidding system. Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. Another adtech infrastructure problem is capacity.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

This allows publishers to establish a “premium” auction instead of the typical real-time bidding system. Most existing adtech infrastructure simply can not achieve the required latency. VoltDB provides the necessary technology to achieve the latency required by header bidding. Another adtech infrastructure problem is capacity.

Performance 40

Performance Hardware Latency Infrastructure 40

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system. Amazon DynamoDB offers low, predictable latencies at any scale. All Things Distributed.

Scalability 167

Scalability Database Ecommerce Latency 167

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 52

Speed Java AWS Virtualization 52

CSS - Tricks

JULY 25, 2019

Estimated Input Latency. Estimated Input Latency. To successfully uncover significant differences in user experience, we suggest using a performance monitoring system (like Calibre !) It’s time to come to terms that your customers aren’t using the same powerful hardware as you. They are: Time to Interactive ( TTI ).

Google 71

Google Engineering Speed Mobile 71

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 52

Latency Engineering Systems Hardware 52

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 124

Performance Network Cache Metrics 124

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 53

Latency Engineering Systems Hardware 53

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 40

Speed Java AWS Virtualization 40

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 106

Performance Network Latency Servers 106

Testsigma

JANUARY 30, 2021

As mobile phones are readily available, users try to open that particular application on a mobile web browser, instead of signing into their systems and hitting the URL. Each smartphone comes with various screen sizes and resolutions, operates on different network speeds, and has different hardware capabilities.

Mobile 52

Mobile Testing Website Internet 52

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Alex Russell

JULY 14, 2021

Meanwhile, on Android, the #2 and #3 sources of web traffic do not respect browser choice. The predominant desktop situation is relatively straightforward: Browsers handle links, and non-browsers defer loading http and https URLs to the system, which in turn invokes the default browser. The Baseline Scenario #.

Google 121

Google Mobile Engineering Internet 121

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. Exploring the Similarities Between Aurora vs. RDS When comparing Amazon Aurora and Amazon RDS, it becomes evident that both solutions offer time-saving benefits in systems administration.

AWS 52

AWS Database Serverless Storage 52

Dynatrace

AUGUST 5, 2019

Resource consumption & traffic analysis. Lift & Shift is where you basically just move physical or virtual hosts to the cloud – essentially you just run your host on somebody else’s hardware. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 31

Cloud Traffic Database Network 31

Alex Russell

OCTOBER 22, 2017

Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. Contended, over-subscribed cells can make “fast” networks brutally slow, transport variance can make TCP much less efficient , and the bursty nature of web traffic works against us.

Performance 68

Performance Benchmarking Network Mobile 68

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76