The Netflix TechBlog

JANUARY 25, 2023

For example, we have a service that stores a movie entity’s metadata or a service that stores metadata about images. In Pic 1 below, we have an example of an application which is used by editors to review their work. All data should be also available for offline analytics in Hive/Iceberg. Annotations can be versioned.

Scalability 283

Scalability Latency Media Architecture 283

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

JUNE 7, 2023

Furthermore, tools like LangChain leverage large language models (LLM) as one of their basic building blocks for creating AI agents (think of AI agents as APIs that perform a series of chat interactions that target a desired outcome) which perform complex and potentially large queries against an LLM like GPT-4.

Monitoring 164

Monitoring Latency Metrics Azure 164

Dynatrace

MAY 31, 2023

Keeping pace with modern digital transformation requires ensuring that applications are responsive, resilient, and always available amid increased complexity. With so many of their transactions occurring online, customers are becoming more demanding, expecting websites and applications to always perform perfectly.

Best Practices 223

Best Practices DevOps Latency Metrics 223

The Netflix TechBlog

MARCH 7, 2024

These integrations are implemented through Metaflow’s extension mechanism which is publicly available but subject to change, and hence not a part of Metaflow’s stable API yet. Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance. For many of our applications, model explainability matters.

Systems 226

Systems Media Cache Open Source 226

Scalegrid

APRIL 28, 2020

High performance. Is my database cluster still highly available? All of our high availability options are offered in DigitalOcean, including 2 Replicas + 1 Arbiter, 3 Replicas and custom replica set setups. DigitalOcean does not have the concept of availability zones (AZ), so we distribute the nodes across different regions.

Azure 344

Azure AWS Database Latency 344

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. For example, a Stanford University and UC Berkeley team noted in a research study that ChatGPT behavior deteriorates over time. Consequently, AI model drift and hallucinations emerge as primary concerns.

Cache 204

Cache Azure Infrastructure Monitoring 204

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 104

Performance Monitoring Traffic Database 104

Dynatrace

MARCH 16, 2023

In the 2023 Perform session “SLOs done right: A practitioners guide,” Michael Cabrera, SRE lead at Vivint, and Andreas Grabner, DevSecOps activist at Dynatrace, break down the state of SLOs and discuss how teams can adopt successful SLOs, avoid less-than-ideal objectives, and ultimately build better SLOs.

DevOps 215

DevOps Latency Metrics Traffic 215

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

MAY 19, 2022

Every organization’s goal is to keep its systems available and resilient to support business demands. Example 1: Architecture boundaries. This multinational information technology service and consulting company was asked to help a global automotive manufacturer with the management goal of measuring service flow performance.

Automotive 270

Automotive Latency Architecture Azure 270

Dynatrace

NOVEMBER 6, 2023

As software delivery tasks traditionally performed at the end of the software delivery lifecycle – such as testing and deployment – have shifted to the beginning of the lifecycle, developers are now working with Kubernetes more directly. Dynatrace enables teams to specify SLOs, such as latency, uptime, availability, and more.

Development 262

Development DevOps Programming Cloud 262

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., There are high hopes for 5G , for example unlocking new applications in UHD streaming and VR, and machine-to-machine communication in IoT. What is the end-to-end throughput and latency, and where are the bottlenecks?

Energy 130

Energy Latency Performance Network 130

Dynatrace

JULY 18, 2023

While infrastructure has historically been treated as a bottleneck where proper scaling and compute power are applied to improve performance, these aspects are now typically addressed by hyperscalers that offer cloud-based infrastructure and infrastructure as a service. This can all be done safely and consistently in a repeatable manner.

Best Practices 190

Best Practices Code Infrastructure Latency 190

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. CFS is widely used and therefore well tested and Linux machines around the world run with reasonable performance.

Cache 251

Cache Latency Airlines Logistics 251

CSS Wizardry

AUGUST 7, 2019

The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. The reason is because mobile networks are, as a rule, high latency connections. Armed with this knowledge, we can soon understand why TTFB can often increase so dramatically on mobile.

Latency 269

Latency Ecommerce Servers Mobile 269

Scalegrid

DECEMBER 14, 2023

How the MongoDB timeout is set up can significantly affect your application’s performance, no matter if you are an experienced MongoDB user or just starting with NoSQL databases. For example, your payment history might be on one database cluster and your analytics records on another cluster.

Java 130

Java Network Servers Database 130

Dynatrace

FEBRUARY 2, 2022

This demand creates an increasing need for DevOps teams to maintain the performance and reliability of critical business applications. For example, the IT team of a bank wants to ensure that for a trailing 30-day period there is 99.9% service availability with <50ms latency for an application with no revenue impact.

DevOps 196

DevOps Metrics Best Practices Latency 196

Dynatrace

JUNE 1, 2023

Service level objectives (SLOs) provide a powerful framework for measuring and maintaining software performance, reliability, and user satisfaction. Certain service-level objective examples can help organizations get started on measuring and delivering metrics that matter. Let’s dig into these foundational SLO examples.

Traffic 173

Traffic Latency Website Virtualization 173

The Netflix TechBlog

APRIL 27, 2023

For the example query listed above, the data expressions are name,errors,:eq,:sum and name,rps,:eq,:sum. The fundamental idea behind Telltale is to detect anomalies on SLI metrics (for example, latency, error rates, etc). Data expressions define what data needs to be sourced in order to evaluate a query.

Storage 288

Storage Cache Metrics Database 288

Dynatrace

DECEMBER 2, 2021

SLOs, together with service-level indicators (SLIs), deliver the performance promised in service-level agreements (SLAs) and other business level objectives (BLOs) while staying within error budgets. For example, an SLA between a web host provider and customer can guarantee 99.95% uptime for all web services of a company over a year.

Metrics 191

Metrics Best Practices DevOps Infrastructure 191

Dynatrace

APRIL 5, 2021

Real-time stream processing to perform live activity tracking, data cleansing, metrics generation, and more. Some common examples include: A request through API Gateway or Amplify. The function itself performs a small unit of work and Lambda charges subscribers by the millisecond. Optimizing Lambda for performance.

Lambda 180

Lambda AWS Serverless Hardware 180

Dynatrace

APRIL 26, 2022

Understanding why a user is experiencing transactional or performance issues enables organizations to achieve greater observability that goes beyond metrics, traces and logs. Digital experience monitoring (DEM) allows an organization to optimize customer experiences by taking into account the context surrounding digital experience metrics.

Monitoring 203

Monitoring Social Media IoT Metrics 203

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Sutter's Mill

FEBRUARY 12, 2024

Because “high-performance low-latency” is kind of C++’s bailiwick, and because it’s my course, you’ll be unsurprised to learn that the topics and code focus on C++ and include coverage of modern C++17/20/23 features. Presented by Alfasoft.

C++ 40

C++ Latency Code Technology 40

CSS Wizardry

APRIL 22, 2020

ReactDOM, for example, ends up 27% smaller when compressed with maximum-level Brotli compression (11) as opposed to with maximum-level Gzip (9). So, for the last several years, I, along with other performance engineers like me, have been recommending that our clients move over from Gzip and to Brotli instead. packet loss).

Latency 269

Latency Servers Website Speed 269

The Netflix TechBlog

AUGUST 30, 2021

For example, when running tests, the state of the device will change from “available for testing” to “in test.” Build a Spring @Configuration class that autowires the KafkaProperties bean injected by the Netflix Spring runtime and, using the Kafka settings available from that bean, construct an Alpakka-Kafka ConsumerSettings bean.

Latency 213

Latency Traffic Transportation Hardware 213

The Netflix TechBlog

SEPTEMBER 8, 2020

As an example, to render the screen shown here, the app sends a query that looks like this: paths: ["videos", 80154610, "detail"] A path starts from a root object , and is followed by a sequence of keys that we want to retrieve the data for. ecosystem and the rich selection of npm packages available.

Latency 233

Latency Cache Java Traffic 233

Dynatrace

SEPTEMBER 23, 2020

Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Sometimes these locations landed on mount points which, due to capacity, availability, or access constraints, weren’t well suited for large runtime storage.

Storage 148

Storage Latency Operating System Network 148

CSS Wizardry

MAY 31, 2019

A classic example is jQuery, that we might link to like so: There are a number of perceived benefits to doing this, but my aim later in this article is to either debunk these claims, or show how other costs vastly outweigh them. I’m going to use an example taken straight from Bootstrap’s own Getting Started. What Am I Talking About?

Cache 274

Cache Latency Infrastructure Website 274

Dynatrace

MAY 5, 2021

At Perform 2021 , Dynatrace’s Kristof Renders, Services Practice Manager for Autonomous Cloud Enablement, joined Sumit Nagal, Principal Engineer at Intuit, to demonstrate how service-level objectives (SLOs) and business-level objectives (BLOs) can “shift left.” For example, improving latency by as little as 0.1

Benchmarking 183

Benchmarking Latency Speed Software 183

Speed Curve

FEBRUARY 5, 2024

That performance golden rule still holds true today. Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Latency – How much time does it take to deliver a packet from A to B. Below are some examples from the major CDN providers that you can leverage.

Servers 57

Servers Cache Retail Benchmarking 57

Scalegrid

JANUARY 19, 2024

For example, memory-resident databases without persistent disks, such as Redis cluster setups or Apache Spark installations, rely on stand-alone machines. Therefore, companies must carefully consider key performance metrics and methodologies to stay relevant and successful in timely and trend-oriented markets.

Database 130

Database Network Servers Monitoring 130

Dynatrace

SEPTEMBER 30, 2021

Cloud migration is the process of transferring some or all your data, software, and operations to a cloud-based computing environment that offers unlimited scale and high availability. For example, as traffic increases, costs will too. Improved performance and availability. Inconsistent performance.

Cloud 165

Cloud Traffic Best Practices Strategy 165

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The kind of edge server envisaged here might, for example, be integrated with your WiFi access point. One example from the paper is an application using the ammo.js Why would we want to live migrate web workers?

Mobile 104

Mobile Cloud Latency Games 104

The Netflix TechBlog

MARCH 10, 2023

Production assets operations are performed in parallel with older data reprocessing without any service downtime. Data Sharding strategy in elasticsearch is updated to provide low search latency (as described in blog post) Design of new Cassandra reverse indices to support different sets of queries.

Media 237

Media Traffic Processing Design 237

CSS Wizardry

MAY 19, 2020

With more standardised FOUT/FOIT behaviour from browser vendors, to the newer font-display specification, performance—and therefore the user—seems to have been finally been put front-and-centre. On this site, in which performance is the only name of the game, I forgo web fonts entirely, opting instead to make use of the visitor’s system font.

Google 364

Google Media Latency Metrics 364