The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This technique facilitates validation on multiple fronts.

Traffic 339

Traffic Latency Tuning Systems 339

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Storage I/O. We help where we can. File System. Networking.

Tuning 61

Tuning AWS Best Practices Network 61

Dynatrace

MARCH 15, 2024

Compliance, retention, archiving, or data governance regulations often require multicasting logs from the original source to multiple destinations, like an observability platform with long-term log storage. Dynatrace OTel Collector was released in Preview in January and is available generally from March 2024.

Open Source 203

Open Source Infrastructure Network Government 203

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Storage I/O. We help where we can. File System. Networking.

Tuning 52

Tuning AWS Best Practices Network 52

Percona

MAY 1, 2023

I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. This message is normally a side effect of a storage subsystem that is not capable of keeping up with the number of writes (e.g., Want to save money on your AWS RDS bill? The settings might not be optimal. IOPs) required by MySQL.

AWS 122

AWS Hardware Storage Tuning 122

Percona

AUGUST 10, 2018

This may help tune your table level autovacuum settings appropriately. Tuning Autovacuum in PostgreSQL. How do we identify the tables that need their autovacuum settings tuned ? . In order to tune autovacuum for tables individually, you must know the number of inserts/deletes/updates on a table for an interval.

Tuning 45

Tuning Cache Database Storage 45

DZone

JULY 10, 2019

In addition, compute and storage are increasingly being separated causing larger latencies for queries. Alluxio is leveraged as compute-side virtual storage to improve performance. But to get the best performance, like any technology stack, you need to follow the best practices.

Best Practices 133

Best Practices Latency Storage Tuning 133

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

SEPTEMBER 23, 2020

Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Sometimes these locations landed on mount points which, due to capacity, availability, or access constraints, weren’t well suited for large runtime storage. Customizable location of large runtime files.

Storage 148

Storage Latency Operating System Network 148

Percona

APRIL 14, 2023

Consider alternative tools, systems, and services: Many cloud providers offer long-term storage, serverless options, or component options for specific needs, with vastly different pricing models. Deactivate or eliminate elements you’re not using. With proper database management, it’s possible to cut your bills in half.

Database 84

Database Serverless Tuning Cloud 84

Dynatrace

FEBRUARY 14, 2022

Among these, you can find essential elements of application and infrastructure stacks, from app gateways (like HAProxy), through app fabric (like RabbitMQ), to databases (like MongoDB) and storage systems (like NetApp, Consul, Memcached, and InfluxDB, just to name a few). documentation. Prometheus Data Source documentation.

Technology 219

Technology Technology Metrics Infrastructure 219

Scalegrid

JUNE 22, 2020

ScaleGrid provides 30% more storage on average vs. DigitalOcean for MySQL at the same affordable price. As you can see above, ScaleGrid and DigitalOcean offer the same plan configurations across this plan size, apart from SSD where ScaleGrid provides over 20% more storage for the same price. MySQL Configuration Management & Tuning.

Database 217

Database Benchmarking Latency Performance 217

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

FEBRUARY 9, 2021

The masking process takes place on the device, even before screenshots are saved to local storage to guarantee that confidential information is never revealed. The masking API we provide allows you to fine-tune the masking configuration to your needs.

Mobile 195

Mobile Tuning Monitoring Storage 195

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Stay tuned for more news about MongoDB offerings. Databases are different from a lot of software. For one, they often favor stability over innovation. on your radar.

Availability 102

Availability Servers Database Open Source 102

Percona

AUGUST 7, 2023

InnoDB Undo Log The undo log, also known as the rollback segment, is a crucial part of the InnoDB storage engine. Properly managing flushing and purging operations is crucial for system performance and tuning.

Database 97

Database Tuning Storage Open Source 97

Dynatrace

AUGUST 28, 2020

Azure Data Lake Storage Gen1. We’ll release additional monitoring support for new services soon, so stay tuned for further updates. We’re happy to announce that now you can gain cloud monitoring excellence with Dynatrace for 15 additional Azure services, including: Azure Automation Account. Azure Logic Apps. Azure Event Grid.

Azure 156

Azure Cloud Tuning Monitoring 156

The Netflix TechBlog

OCTOBER 15, 2019

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. To improve the recovery time for this scenario, we started using block storage volumes (Amazon Elastic Block Store) instead of local disks on the brokers. Please stay tuned.

Transportation 192

Transportation Architecture Processing Storage 192

Dynatrace

MAY 9, 2019

Consequently, each new version of OneAgent for Windows consumed double storage space: one for the *.exe This storage space was consumed not only on our own infrastructure but also on each of the Dynatrace cluster nodes in the case of Managed deployments. ” Briefly, before the change, the *.exe exe file and one for the *.msi

Storage 116

Storage Tuning Traffic Architecture 116

n0derunner

JULY 23, 2019

As the DB continues to run on the new host – the Nutanix storage detects the access patterns and “localizes” the data that the DB is accessing. Many different queries are executing in parallel, some hitting RAM cache, some hitting storage. The Postgres DB is totally un-tuned and contains purely default settings.

Benchmarking 76

Benchmarking Storage Tuning Cache 76

Scalegrid

JANUARY 25, 2024

Best Practices for Redis Performance Tuning Optimizing memory allocation is essential for improving Redis’s performance. Furthermore, the wise utilization of different types Redis offers, such as strings, lists, sets , and sorted sets , allows efficient storage management.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

JUNE 8, 2021

For example, an athlete must be in tune with their body to know when something isn’t operating right which could impact their future performance. Stay tuned for more tips from our coach Jean Louis Lormeau. Similarly, we must also monitor our IT systems so closely that we know when the smallest thing isn’t working as normal.

Metrics 168

Metrics Tuning Programming Systems 168

Percona

DECEMBER 27, 2023

Well, here we are – with storage autoscaling for databases in Kubernetes, slated for release in Q1, 2024 after a year of hard work. This fully automated scaling and tuning will enable a serverless-like experience in our Operators and Everest. It’s worry-free and doesn’t require human intervention.

Cloud 81

Cloud Open Source Strategy Best Practices 81

Dynatrace

APRIL 26, 2022

EM gives visibility into the user device and performance from the endpoint to provide information on CPU, memory, operating systems, storage, security, networks, and whether software is up to date. Endpoint monitoring (EM). Endpoints can be physical (i.e., PC, smartphone, server) or virtual (virtual machines, cloud gateways).

Monitoring 206

Monitoring Social Media IoT Metrics 206

Dynatrace

AUGUST 14, 2019

Stay tuned for the next set of Synthetic Monitoring features, including, but not limited to: Credential storage. Use curly brackets ( { and } ) to access the variables you’ve defined in your pre- and post-execution scripts. What’s next? New public locations. Support for new cloud vendors.

Monitoring 117

Monitoring Tuning Storage Code 117

Percona

DECEMBER 20, 2018

Linux OS Tuning for MySQL Database Performance. In this post we will review the most important Linux settings to adjust for performance tuning and optimization of a MySQL database server. We’ll note how some of the Linux parameter settings used OS tuning may vary according to different system types: physical, virtual or cloud.

Database 40

Database Tuning Performance AWS 40

Adrian Cockcroft

JUNE 21, 2022

I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R. Rich became co-author of the second edition of the Sun Performance Tuning book, to describe how it worked. He had it up and running on Wednesday.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 90

Storage Engineering Database Hardware 90

Percona

AUGUST 17, 2023

PostgreSQL has powerful and advanced features, including asynchronous replication, full-text searches of the database, and native support for JSON-style storage, key-value storage, and XML. It has evolved steadily, however, during 25 years as an open source project. And because you’re covered, you’re also free.

Open Source 81

Open Source Healthcare Social Media Database 81

Dynatrace

NOVEMBER 17, 2020

With these release candidate APIs available, instrumentation for web frameworks, storage clients, and much more can be built. Stay tuned, there’s more to come! With the arrival of this release candidate (RC), the community’s focus now shifts to providing tracing RC component releases, as well as producing a metrics specification RC.

Open Source 152

Open Source Software Engineering Government Java 152

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 106

Storage Strategy Cloud Azure 106

Particular Software

JUNE 20, 2022

Because Cosmos DB charges for each storage operation, there is increased cost associated with checking for and obtaining the lock before a message is processed. If you’re currently using Azure Table Storage in your system, check out how to migrate from Azure Table storage to Cosmos DB.

Azure 52

Azure Storage Strategy Tuning 52

HammerDB

MAY 5, 2019

Also it is interesting to note that the impact of this change was not observed in other databases or other MySQL storage engines such as MyRocks the only noticeable impact with HammerDB workloads occurred in MySQL with InnoDB where in the source code ut0ut.cc So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

SQL Performance

APRIL 15, 2020

This capability is essential when performance tuning since query events include discrete CPU and IO metrics as well as runtime parameters, which are key for troubleshooting query performance problems such as parameter sniffing. For some reason this thing will not go away! An Updated XE Session. sqlserver.existing_connection. sqlserver.login.

Azure 96

Azure Database Tuning Network 96

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. MyRocks is shipped in Percona Server for MySQL.

Open Source 91

Open Source Storage Database Big Data 91

The Morning Paper

MARCH 10, 2020

This benchmark can synthetically generate more precise key-value queries that represent the reads and writes of key-value stores to the underlying storage system. The paper examines three different uses of RocksDB at Facebook: UDB , the underlying storage engine for the MySQL databases storing the social graph data. Three workloads.

Benchmarking 59

Benchmarking Storage Cache Open Source 59