The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases.

Storage 288

Storage Cache Metrics Database 288

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 197

Database Traffic Transportation Open Source 197

Percona

NOVEMBER 1, 2023

version, like this: ANALYZE TABLE removes the table from the table definition cache, which requires a flush lock. This makes the query wait for any long-running queries to finish but also can trigger cascading waiting for other incoming requests. In short, ANALYZE could lead to nasty stalls in busy production environments.

Servers 93

Servers Database Cache C++ 93

Dynatrace

AUGUST 12, 2019

With OneAgent installed on an application server, Davis, the Dynatrace AI causation engine, continuously analyzes all database statements within the context of your applications. Now, with Oracle database insights, we’re going even deeper, giving you visibility into what’s going on in the database layer.

Database 128

Database Metrics Cache Servers 128

Scalegrid

DECEMBER 21, 2023

In today’s data-driven world, the ability to effectively monitor and manage data is of paramount importance. Redis®, a powerful in-memory data store, is no exception. Redis® Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis® database requires active monitoring.

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

SEPTEMBER 1, 2023

MySQL performance tuning offers several significant advantages for effective database management and optimization. Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Dynatrace

DECEMBER 21, 2023

Growing awareness and increasing regulatory scrutiny have propelled carbon emissions data into the public consciousness. Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Level 1: Data centers This is the starting point for most organizations. A PUE of 1.0

Cloud 214

Cloud Energy Best Practices Cache 214

Scalegrid

OCTOBER 2, 2019

October 2, 2019 – ScaleGrid, a rapidly growing leader in the Database-as-a-Service (DBaaS) space, has just launched their new fully managed Hosting on Azure for Redis™ service. Redis™, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base.

Azure 100

Azure Availability Open Source Virtualization 100

ScaleOut Software

APRIL 22, 2020

In this time of extremely high online usage, web sites and services have quickly become overloaded, clogged trying to manage high volumes of fast-changing data. Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

In this time of extremely high online usage, web sites and services have quickly become overloaded, clogged trying to manage high volumes of fast-changing data. Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

Percona

MAY 1, 2023

It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. The performance of a PostgreSQL database has a significant impact on the overall effectiveness of an application.

Tuning 52

Tuning Efficiency Database Performance 52

Dynatrace

MAY 13, 2022

Apache Cassandra is an open-source, distributed, NoSQL database. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. Microsoft Azure offers multiple ways to manage Apache Cassandra databases.

Azure 239

Azure Latency Metrics Infrastructure 239

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. However, as the size of your database grows, it can become challenging to manage and optimize its performance. Pgpool-II This is where the pgpool-II comes in.

Cache 111

Cache Open Source Benchmarking Database 111

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. MySQL comes pre-configured to be conservative instead of making the most of the resources available in the server. Why is that?

Tuning 134

Tuning Cache Servers Benchmarking 134

Dynatrace

APRIL 10, 2023

And according to recent data from Enterprise Strategy Group, 59% of survey respondents indicated spending on public cloud applications would increase in 2023. We also couldn’t compromise on performance and availability.” “We can analyze the data from those services in context.”

Cloud 176

Cloud Ecommerce Performance Retail 176

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 129

Cache Cloud Performance Retail 129

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

Scalegrid

JULY 8, 2020

If you must kill the script at this point, there are two options available: SCRIPT KILL command can be used to stop a script that hasn’t yet done any writes. The complete information on methods to kill the script execution and related behavior are available in the documentation. Behavior on Sentinel-Monitored High Availability Systems.

Servers 239

Servers Database Availability Monitoring 239

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

High Scalability

FEBRUARY 17, 2021

This is guest post by Sachin Sinha who is passionate about data, analytics and machine learning at scale. This article is to simply report the YCSB bench test results in detail for five NoSQL databases namely Redis, MongoDB, Couchbase, Yugabyte and BangDB and compare the result side by side. Author & founder of BangDB. About YCSB.

Benchmarking 308

Benchmarking Latency C++ Database 308

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

Percona

MAY 2, 2023

In today’s data-driven world, losing critical data can be catastrophic for any organization. As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Why are MongoDB database backups important? Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

SEPTEMBER 2, 2020

As part of the Platform Extensions team, I’m one of those responsible for services that include the Dynatrace OneAgent SDKs, which are libraries that allow us to extend end-to-end visibility for technologies and frameworks for which there is no code module available yet. Database calls. The sqllite database. Messaging calls.

Monitoring 250

Monitoring Cache Open Source Database 250

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). In the Reliability space, our data teams focus on two main approaches. All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Amazon EventBridge: EventBridge to bridges the data gap between your applications and other services, such as Lambda or specific SaaS apps. Data Store. Improving data processing.

Serverless 286

Serverless AWS Lambda Storage 286

Dynatrace

AUGUST 30, 2019

Infrastructure Optimization: 100% improvement in Database Connectivity. We have several YouTube Tutorials and blog posts available that show how you can use Dynatrace RUM data for Web Performance & User Experience Optimization. Digital Performance: 99% reduction in Response Time, from 18.2s Digital Performance improvement.

Cache 201

Cache Architecture Database Government 201

Scalegrid

APRIL 16, 2020

Where you decide to host your cloud databases is a huge decision. But, if you’re considering leveraging a managed databases provider, you have another decision to make – are you able to host in your own cloud account or are you required to host through your managed service provider? Where to host your cloud database?

Cloud 242

Cloud Azure AWS Database 242

All Things Distributed

OCTOBER 12, 2016

Fast Data is an emerging industry term for information that is arriving at high volume and incredible rates, faster than traditional databases can manage. Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. This includes metrics such as query execution time, the number of queries executed per second, and the utilization of query cache and adaptive hash index.

Performance 102

Performance Monitoring Traffic Database 102

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. HyperScale Database. Hyperscale databases are provisioned using vCores. DTU Pricing Tier.

Azure 55

Azure Database Serverless Hardware 55

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Data Placement. Data Consistency. This fact is often referred to as the CAP theorem.

Database 213

Database Latency C++ Scalability 213

Dynatrace

NOVEMBER 3, 2021

Logging provides additional data but is typically viewed in isolation of a broader system context. Observability is the ability to understand a system’s internal state by analyzing the data it generates, such as logs, metrics, and traces. Monitoring typically provides a limited view of system data focused on individual metrics.

Monitoring 226

Monitoring Metrics DevOps Scalability 226

Scalegrid

JULY 29, 2020

PgBouncer defines one pool per user+database combination. This is shared between all clients, so a pooled connection is available to all clients. A client benefits from a pooled connection only if it connects to a child which has previously served a connection for this database+user combination. High availability.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

Percona

APRIL 24, 2023

This post is about PostgreSQL, but most of the problems also apply to other database systems. Effectively, the memory available for pages of the table gets less. The more indexes, the more the requirement of memory for effective caching. Cache requirements for indexes are generally much higher than associated tables.

Tuning 124

Tuning Cache Storage Database 124

The Netflix TechBlog

OCTOBER 29, 2020

This translates to a large number of app configurations to toggle feature availability and optimize the in-app experience for each production. These expressions are evaluated in the current app session context, and can access data such as A/B test assignments, locality, device attributes, etc.

Mobile 279

Mobile Cache Network Architecture 279