The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 226

Systems Media Cache Open Source 226

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. We also introduced our demo app and explained how to define the metrics and traces it uses. What is OneAgent?

Metrics 163

Metrics Monitoring Database Network 163

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 102

Database Benchmarking Latency C++ 102

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index.

Performance 102

Performance Monitoring Traffic Database 102

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Dynatrace

JUNE 25, 2021

As a strong supporter of open source and open standards, I’m aware that the wide availability of standards, open-source tools, and some newly coined terms are causing a lot of confusion. OpenTelemetry aims to support three so-called observability signals, namely: metrics.

Open Source 194

Open Source Monitoring Google Systems 194

Dynatrace

APRIL 5, 2021

Real-time stream processing to perform live activity tracking, data cleansing, metrics generation, and more. You can eliminate the latency issues caused by cold starts — an increase in normal response time when a new instance receives its first request — by using edge-optimized functions that run code closer to users and other projects.

Lambda 173

Lambda AWS Serverless Hardware 173

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. This process thoroughly assesses factors like cost-effectiveness, security measures, control levels, scalability options, customization possibilities, performance standards, and availability expectations.

Strategy 130

Strategy Cloud Government Innovation 130

Dynatrace

JULY 6, 2020

While the Azure overview page in Dynatrace has long featured monitoring data detected by OneAgent, with additional metrics pulled from Azure Monitor and topology information from Azure Resource Graph, the overview page now gives you quick access to the newly added services, which are listed under Supporting services.

Azure 144

Azure Cloud Big Data Virtualization 144

Speed Curve

MAY 1, 2023

A performance budget is a threshold that you apply to the metrics you care about the most. A good performance budget chart, such as the one above, should show you: The metric you're tracking The threshold you've created for that metric When you exceed that threshold How long you stayed out of bounds When you returned to below the threshold 3.

Performance 98

Performance Metrics Media Google 98

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Smashing Magazine

AUGUST 3, 2023

Google’s Core Web Vitals is a set of performance metrics that site owners can use to evaluate performance and diagnose performance issues. These metrics provide a different perspective on user experience: Largest Contentful Paint (LCP) Measures the time it takes for the main content on a webpage to load. One of the key Next.js

Performance 75

Performance Cache Traffic Metrics 75

Percona

APRIL 7, 2023

Here’s how the same test performed when running Percona Distribution for PostgreSQL 14 on these same servers: Queries: reads Queries: writes Queries: other Queries: total Transactions Latency (95th) MySQL (A) 1584986 1645000 245322 3475308 122277 20137.61 MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48 Why is that?

Tuning 135

Tuning Cache Servers Benchmarking 135

The Netflix TechBlog

MARCH 13, 2020

SVT-AV1: open-source AV1 encoder and decoder by Andrey Norkin , Joel Sole , Mariana Afonso , Kyle Swanson, Agata Opalach , Anush Moorthy , Anne Aaron SVT-AV1 is an open-source AV1 codec implementation hosted on GitHub [link] under a BSD + patent license. A single-threaded compression mode is used.

Open Source 154

Open Source Efficiency C++ Speed 154

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. This example instrumented one of many thousands of available events.

Latency 68

Latency C++ Cache Programming 68

The Morning Paper

SEPTEMBER 5, 2019

Datadog handles a ton of metrics – some customers have endpoints generating over 10M points per second! For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g Why do we need a new sketch?

Latency 52

Latency Metrics Open Source Java 52

The Morning Paper

FEBRUARY 23, 2020

It would be possible for a coordinator to also maintain their own giant copy of the public data available in the system, assuming some freshness guarantees, but the payment mechanisms in AnyLog make a crawl in advance of queries unattractive. SLA enforcement of availability clauses. Incentives for contractors. Periods (e.g.

Blockchain 94

Blockchain Internet Internet IoT 94

Testsigma

AUGUST 24, 2020

Similarly, it helps to have a real-time dashboard for performance which depicts the performance metrics over a period of time rather than digging into logs and code-profiler reports every time you want to check on a product’s performance. Increased Complexity: As the scope for the product grows, so does the scope for continuous testing.

Testing 69

Testing Open Source Scalability Latency 69

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Smashing Magazine

JANUARY 11, 2021

LogRocket tracks key metrics, incl. Getting Ready: Planning And Metrics Performance culture, Core Web Vitals, performance profiles, CrUX, Lighthouse, FID, TTI, CLS, devices. Getting Ready: Planning And Metrics. DOM complete, time to first byte, first input delay, client CPU and memory usage. Get a free trial of LogRocket today.

Performance 145

Performance Cache Media Metrics 145

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. Quantitative performance testing looks at metrics like response time while qualitative testing is concerned with scalability, stability, and interoperability.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

HammerDB

OCTOBER 18, 2019

As noted previously the main developer of HammerDB is an Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are my own, specific to the context of HammerDB as an independent personal project and not representing Intel. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

HammerDB

DECEMBER 5, 2020

For example HammerDB has not used tpmC terminology to report TPC-C based metrics instead using TPM and NOPM nomenclature. Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Smashing Magazine

MAY 20, 2020

Which metrics should I use?” Which values of these metrics are acceptable?”. The metrics selection is outside of the scope of this article and depends highly on the project context, but I recommend that you start by reading User-centric Performance Metrics by Philip Walton. Adding 20% to them and set as your next goals.

Performance 100

Performance Metrics Best Practices Code 100

Smashing Magazine

JANUARY 6, 2020

Getting Ready: Planning And Metrics. Getting Ready: Planning And Metrics. You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Table Of Contents. Quick Wins.

Performance 145

Performance Cache Network Metrics 145

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. Apple Corporate is at fault, not Open Source engineers or the line managers who support them. Another window into this question is provided by the Web Confluence Metrics project. Higher is better.

Media 145

Media Games Education Engineering 145

Percona

JULY 1, 2023

These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc. It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best.

AWS 52

AWS Database Serverless Storage 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. that are used across multiple applications.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. This is why most AWS regions have three availability zones. Try to measure your mean time to respond (MTTR) for incidents. that are used across multiple applications.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

JANUARY 7, 2019

Getting Ready: Planning And Metrics. Getting Ready: Planning And Metrics. You need a business stakeholder buy-in, and to get it, you need to establish a case study on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Table Of Contents. Setting Realistic Goals. Defining The Environment.

Performance 104

Performance Cache Metrics Network 104

The Morning Paper

MAY 28, 2019

So it’s interesting to see a paper using nano-Joules per prediction as an evaluation metric. The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. Vector is open source and in use by multiple companies.

Performance 211

Performance Latency Open Source Metrics 211

The Netflix TechBlog

NOVEMBER 2, 2021

In particular, the VMAF metric lies at the core of improving the Netflix member’s streaming video quality. It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. As before, the start time for each metric’s assembly can vary.

Media 171

Media Innovation Metrics Latency 171

Alex Russell

JULY 14, 2021

This reduces friction and commensurately increases "engagement" metrics. [6]. The situation is even more acute in WebView IABs, which tend not to fully support features from these categories even when they appear available to developers via script. How can that be? have invested almost nothing in clarifying the situation.

Google 121

Google Mobile Engineering Internet 121

The Netflix TechBlog

JULY 26, 2021

From the moment a Netflix film or series is pitched and long before it becomes available on Netflix, it goes through many phases. Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain.

Big Data 253

Big Data Government Analytics Processing 253