The Netflix TechBlog

NOVEMBER 9, 2021

by Liwei Guo , Ashwin Kumar Gopi Valliammal , Raymond Tam , Chris Pham , Agata Opalach , Weibo Ni AV1 is the first high-efficiency video codec format with a royalty-free license from Alliance of Open Media (AOMedia), made possible by wide-ranging industry commitment of expertise and resources.

Media 246

Media Open Source Efficiency Software Engineering 246

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success.

Best Practices 91

Best Practices Hardware Tuning Scalability 91

Percona

OCTOBER 18, 2023

Community support One of the most significant advantages of open source databases is the expansive global community of users, developers, DBAs, and enthusiasts who collaborate to provide a seemingly never-ending array of how-tos, resources, guidance, and solutions to help you make your database more performant and secure.

Open Source 96

Open Source Database Hardware Strategy 96

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. With the help of log monitoring software, teams can collect information and trigger alerts if something happens that affects system performance and health. Optimized system performance. Together, they provide continuous value to the business.

Analytics 209

Analytics Monitoring Artificial Intelligence DevOps 209

Dynatrace

OCTOBER 28, 2021

As software performance degrades or fails, the chaos engineers’ findings enable developers to add resiliency into the code, so the application remains intact in an emergency. Chaos testing enriches the organization’s intelligence about how software performs under stress and how to make it more resilient.

Engineering 225

Engineering Entertainment Cloud Infrastructure 225

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. Here are some of the tasks orchestration platforms are challenged to perform.

Open Source 301

Open Source Traffic DevOps Cloud 301

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. They provide flexibility in data organization and performance optimization compared to the default setup. What are MySQL general tablespaces?

Storage 91

Storage Engineering Database Hardware 91

SQL Performance

JANUARY 23, 2020

"Waitstats helps us identify performance-related counters. But waits information by itself isn't enough to accurately diagnose performance problems. The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.".

Tuning 115

Tuning Servers Monitoring Hardware 115

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. We can split the task of having a good Resource Group implementation into three steps: You must perform an analysis of what you want to control. bin/mysqld./bin/mysqld

Tuning 45

Tuning Virtualization Testing Servers 45

The Morning Paper

NOVEMBER 10, 2019

Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. Rather than reimplement TCP/IP or refactor an existing transport, we started Pony Express from scratch to innovate on more efficient interfaces, architecture, and protocol.

Network 92

Network Transportation Latency Entertainment 92

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. This is very efficient, as confirmed by the elapsed time of 13ms (all of which is CPU time). The structure of a b-tree index makes finding the next highest value very efficient — there is no need to scan through the duplicates. BountyAmount.

Servers 86

Servers Tuning Database Efficiency 86

Percona

JANUARY 19, 2023

While the technologies have evolved and matured enough, there are still some people thinking that MySQL is only for small projects or that it can’t perform well with large tables. With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance.

Open Source 91

Open Source Storage Database Big Data 91

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

The Morning Paper

JUNE 27, 2019

In this paper we argue that systems for numerical computing are stuck in a local basin of performance and programmability. Systems researchers are doing an excellent job improving the performance of 5-year old benchmarks, but gradually making it harder to explore innovative machine learning research ideas. a research paper.

Systems 87

Systems Tuning Programming Innovation 87

Percona

AUGUST 5, 2023

Horizontal and vertical MySQL partitions are techniques used to divide tables into smaller sections for improved performance and management. Various partition types, like RANGE, LIST, HASH, and KEY, are used for specific needs, from range-based data to custom criteria, to ensure efficient data handling and the optimization of queries.

Strategy 40

Strategy Storage Database Best Practices 40

KeyCDN

AUGUST 15, 2019

Web performance is a broad subject, and you’ll find no shortage of performance testing tips and tutorials all over the web. Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

The Morning Paper

MAY 21, 2019

But for this to be realized in a practical manner, the system has to (1) be able to accurately control its aggressiveness to minimize the impact on application performance, and (2) be resilient to the variation of cold memory behavior across different machines,clusters, and jobs. Enter zswap!

Software 78

Software Software Google Hardware 78

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. For bare metals, any algorithm among deadline or noop (the performance difference between them is imperceptible) will be better than CFQ.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Based on these findings, the authors present four guidelines to get the best performance out of this memory today. The data we have collected demonstrate that many of the assumptions that researchers have made about how NVDIMMs would behave and perform are incorrect.

Scalability 59

Scalability Latency Cache Media 59

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. This post explains why HammerDB made the language decisions it made to make it the best performing and most usable database benchmarking software. Basic Benchmarking Concepts.

Programming 67

Programming Benchmarking Virtualization C++ 67

The Agile Manager

JUNE 30, 2015

A producer does this with a combination of efficiency (squeeze every penny from raw materials sourcing to distribution) and by appealing to or outright fueling user vanity (engender customer identity in every facet of its business). Operations and execution matter to the bottom line, but ultimately dance to the tune called by finance.

Software 40

Software Software Innovation Hardware 40

KeyCDN

SEPTEMBER 20, 2018

Error tracking is a vital component to any web project because it helps you pinpoint performance problems before they get out of hand. Error monitoring can get increasingly complicated as you deal with bugs reported by users and your production team, which is why having an efficient error tracking workflow from the beginning is so important.

Strategy 67

Strategy Monitoring Website Google 67

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. This uses hardware, typically a crystal oscillator, that produces ticks at a very high constant rate regardless of processor speed, power settings, or anything of that nature. Both calculations are performed over the per-thread truncated millisecond values.

Servers 95

Servers Tuning Architecture Processing 95

John McCalpin

JANUARY 22, 2018

For 64-bit floating-point data, the 512-bit Fused Multiply-Add (FMA) instructions performs 16 floating-point operations (8 adds and 8 multiplies). of the peak performance of (68 cores * 32 FP ops/cycle/core * 1.495 GHz =) 3253 GFLOPS ( note1 ).

Latency 40

Latency Hardware Code Testing 40

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Atomicity A transaction must be an atomic unit of work; either all of its data modifications are performed or none of them are performed. Consistency When completed, a transaction must leave all data in a consistent state.

Servers 40

Servers Cache Media Hardware 40

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. Pipeline reliability and performance go hand in hand. If tuned for performance, there is a good change reliability is compromised - and vice versa.

Latency 63

Latency Analytics Scalability Engineering 63

O'Reilly Software

APRIL 4, 2018

The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

SEPTEMBER 5, 2017

I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks. As a performance engineer who does kernel tracing, I find the lack of an ID I can trace in the kernel to be pretty annoying. It's the official profiler.

Virtualization 76

Virtualization AWS Engineering Hardware 76

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

Smashing Magazine

AUGUST 22, 2021

HTTP/3: Performance Improvements (Part 2). HTTP/3: Performance Improvements (Part 2). In this second part, we will zoom in on the performance improvements that QUIC and HTTP/3 bring to the table for web-page loading. HTTP/3 performance features ( current article ). Robin Marx. 2021-08-23T06:20:00+00:00.

Performance 105

Performance Network Latency Servers 105

SQL Server According to Bob

JANUARY 11, 2020

​​ This is similar to the ​​ suspend and resume ​​ operations performed by ​​ the operating system. ​​ Performing ​​ safety ​​ checks ​​ of SQL Server and all other system components before production deployment is very important.

Servers 40

Servers Cache Database Media 40

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 99

Hardware Storage Big Data Blockchain 99

The Netflix TechBlog

APRIL 29, 2019

Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites. Demand Engineering Demand Engineering is responsible for Regional Failovers , Traffic Distribution, Capacity Operations and Fleet Efficiency of the Netflix cloud.

Open Source 279

Open Source Network Infrastructure Big Data 279

All Things Distributed

MARCH 19, 2018

Finally, re-training is performed every x-many minutes/hours/days to keep the models updated with new data. The algorithm state contains all the variables, statistics, and data structures needed to perform updates, that is, all that is required to continue training. Post-training model tuning and rich states.

Scalability 159

Scalability Hardware AWS Tuning 159

All Things Distributed

MARCH 7, 2013

This allows us to tune both our hardware and our software to ensure that the end-to-end service is both cost-efficient and highly performant. ve been working hard over the past year to improve storage density and bring down the costs of our underlying hardware platform.

Ecommerce 139

Ecommerce Storage Scalability Hardware 139

O'Reilly

OCTOBER 11, 2022

As a trend, it’s not performing well on Google; it shows little long-term growth, if any, and gets nowhere near as many searches as terms like “Observability” and “Generative Adversarial Networks.” Office staff usually perform tasks like invoice processing by filling in a web form. Should it be? What’s required? There has to be.

Games 116

Games Healthcare Processing Retail 116

High Scalability

NOVEMBER 25, 2019

Version7 (Future): Move all compute to the public cloud, carve out more services for impact isolation, dynamic resource pooling to manage pets and cattle efficiently. Who performs what roles? It's a big team, we have Product managers, UX team, DevOps, scrum teams, architects, engineers performing various roles.

Architecture 52

Architecture Cache Azure Storage 52