The Netflix TechBlog

OCTOBER 27, 2020

By Tianlong Chen and Ioannis Papapanagiotou Netflix has more than 195 million subscribers that generate petabytes of data everyday. Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy.

Latency 243

Latency Storage Big Data Tuning 243

Dynatrace

FEBRUARY 16, 2023

How do you get more value from petabytes of exponentially exploding, increasingly heterogeneous data? The short answer: The three pillars of observability—logs, metrics, and traces—converging on a data lakehouse. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 191

Analytics Innovation Metrics Database 191

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. We help you configure your MySQL deployment to optimize your performance based on the size of your databases.

Database 166

Database Cloud Website Azure 166

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier.

Open Source 89

Open Source Database Hardware Strategy 89

Percona

APRIL 14, 2023

Below, we outline some proactive steps for achieving cost efficiency and maintaining performant database environments amid a turbulent economy: 1. In addition, hoarding digital data is expensive. Cutting back on the amount of data you store can lead to big savings. Growth is good, so scaling means growth, right?

Database 80

Database Serverless Tuning Cloud 80

Dynatrace

AUGUST 1, 2022

Kubernetes was initially designed with a strong focus on stateless workloads, meaning these workloads do not need to store any persistent data. Interestingly, our partner RedHat reported in 2021 that around 80% of deployed workloads are databases or data caches, storing data in persistent volume claims (PVCs).

Storage 193

Storage Database Network Metrics 193

Dynatrace

DECEMBER 18, 2023

This challenge has given rise to the discipline of observability engineering, which concentrates on the details of telemetry data to fine-tune observability use cases. To get a more granular look into telemetry data, many analysts rely on custom metrics using Prometheus. What is Prometheus?

Metrics 183

Metrics Engineering Energy Tuning 183

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out.

Database 102

Database Benchmarking Latency C++ 102

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability.

Performance 123

Performance Hardware Tuning Storage 123

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. While Oracle remains the #1 database on the market, its popularity has steadily declined by over 18% since 2013. Not available.

Open Source 244

Open Source Tuning C++ Database 244

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 124

Tuning Cache Storage Database 124

Percona

FEBRUARY 15, 2023

Bloom filters are an essential component of an LSM-based database engine like MyRocks. With MyRocks/RocksDB, data is stored in a set of large SST files. Tuning In terms of tuning, two parameters can be tuned, the size of the bitmap and the number of bits set by every value.

Storage 125

Storage Tuning Cache Engineering 125

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

SQL Performance

APRIL 15, 2020

SQL Server has always provided the ability to capture actual queries in an easily-consumable rowset format – first with legacy SQL Server Profiler, later via Extended Events, and now with a combination of those two concepts in Azure SQL Database. Unfortunately, my excitement was short lived for a couple of reasons.

Azure 96

Azure Database Tuning Network 96

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? That’s a heritage of the LAMP model when the same server would host both the database and the web server.

Tuning 134

Tuning Cache Servers Benchmarking 134

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 77

C++ Database Storage Testing 77

n0derunner

JULY 23, 2019

Effect of removing CPU constraints and maintaining data locality on a running DB instance. As the DB continues to run on the new host – the Nutanix storage detects the access patterns and “localizes” the data that the DB is accessing. The Postgres DB is totally un-tuned and contains purely default settings.

Benchmarking 76

Benchmarking Storage Tuning Cache 76

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. The basic tier provides up to 5 DTUs with standard storage. HyperScale Database. DTU Pricing Tier.

Azure 55

Azure Database Serverless Hardware 55

Dynatrace

FEBRUARY 14, 2022

Building on its advanced analytics capabilities for Prometheus data , Dynatrace now enables you to create extensions based on Prometheus metrics. Without any coding, these extensions make it easy to ingest data from these technologies and provide tailor-made analysis views and zero-config alerting. Customizable dashboard.

Technology 222

Technology Technology Metrics Infrastructure 222

Percona

AUGUST 7, 2023

In InnoDB, the undo log and the redo log are two indispensable components that play a vital role in maintaining data integrity and ensuring transactional consistency. Both logs are crucial in the ACID (Atomicity, Consistency, Isolation, Durability) properties of database systems.

Database 94

Database Tuning Storage Open Source 94

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. Traces collected from various microservices are ingested in a stream processing manner into the data store. Stream Processing: to sample or not to sample trace data?

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

OCTOBER 10, 2023

Databases are different from a lot of software. This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Stay tuned for more news about MongoDB offerings. For one, they often favor stability over innovation.

Availability 96

Availability Servers Database Open Source 96

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications.

Tuning 44

Tuning Cache Database Storage 44

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used. Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. It’s used for data management (shocker), application development, and data analytics. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 76

Open Source Healthcare Social Media Database 76

Percona

DECEMBER 6, 2023

This blog is regarding some of the usual MySQL database conversations and responses, which can appear “wrong” or “funny,” but there’s actually more to them. Avoiding unnecessary queries and fetching only the required data can significantly optimize the query’s performance.

Strategy 76

Strategy Database Best Practices Tuning 76

Percona

FEBRUARY 24, 2023

Today, we are excited to announce the release of Percona Monitoring and Management (PMM) V2.35 , including a tech preview of label-based access control, the general availability of Helm Chart, and a range of enhancements to our Database as a Service (DBaaS) offerings, among other improvements and features. Stay tuned!

Availability 92

Availability Metrics Monitoring Open Source 92

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Dynatrace

AUGUST 28, 2020

Azure Data Factory v1. Azure Data Factory v2. Azure Data Lake Analytics. Azure Data Lake Storage Gen1. For this, we selected three example services: Azure Automation, Azure Data Factory, and Azure Logic Apps. Ensure healthy data workflows by easily detecting failures in Azure Data Factory pipelines.

Azure 158

Azure Cloud Tuning Monitoring 158

Percona

DECEMBER 27, 2023

In our conversations with developers and engineers during the conference, we confirmed the CNCF GItOps Microsurvey data – 91% are already using GitOps. of respondents are currently utilizing databases in Kubernetes (k8s). Developers will receive the endpoint without needing to consider resources and tuning at all.

Cloud 77

Cloud Open Source Strategy Best Practices 77

The Netflix TechBlog

JUNE 13, 2023

They enable us to further fine-tune and configure the system, ensuring the new changes are integrated smoothly and seamlessly. The dialing steps can also be scoped at the data center level if traffic is served from multiple data centers. The dial also acts as a switch to turn off all writes to the new data store if necessary.

Traffic 279

Traffic Metrics Systems Strategy 279

Percona

JULY 2, 2023

The size of the database and your database environment—if it is on colo or cloud—matters. It is very important to understand how we can ensure minimalistic or no data loss at the time of disasters using our preferred backup tools. In setting up our demonstration system, we use pg_basebackup and continuous archiving.

Strategy 52

Strategy Database Storage Open Source 52

Dynatrace

APRIL 21, 2022

end-of-support for RUM data. for Dynatrace SaaS RUM data. end-of-support for RUM data. To stay tuned, keep an eye on our release notes. Log data acquisition. Log data analysis. Log data analysis. Log data alerting. See SQL data source. Announcements. For more details, see TLS 1.0

Azure 221

Azure Metrics AWS Monitoring 221

Percona

JANUARY 19, 2023

Some startups adopted MySQL in its early days such as Facebook, Uber, Pinterest, and many more, which are now big and successful companies that prove that MySQL can run on large databases and on heavily used sites. For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant.

Open Source 85

Open Source Storage Database Big Data 85

Scalegrid

OCTOBER 7, 2019

As this open source database continues to pull new users from expensive commercial database management systems like Oracle, DB2 and SQL Server, organizations are adopting new approaches and evolving their own to maintain the exceptional performance of their SQL deployments. PostgreSQL popularity is skyrocketing in the enterprise space.

Strategy 182

Strategy Cloud Java Open Source 182