The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases.

Storage 288

Storage Cache Metrics Database 288

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 105

Performance Monitoring Traffic Database 105

Percona Community

OCTOBER 23, 2020

Tech that makes our databases perform better. In this blog post we’re going to see those technologies at work to give us awesome block storage performance with flexibility and simple operations. Mayastor + SPDK + NVMe = fast databases Mayastor is new tech, it’s fast, and it’s based on SPDK. Why is SPDK exciting?

Storage 52

Storage Latency Speed Database 52

Scalegrid

JANUARY 19, 2024

Data-bearing members face a higher risk of encountering issues caused by rollbacks, compared to others who utilize different storage methods. For example, memory-resident databases without persistent disks, such as Redis cluster setups or Apache Spark installations, rely on stand-alone machines.

Database 130

Database Network Servers Monitoring 130

Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Want to save money on your AWS RDS bill? IOPs) required by MySQL.

AWS 121

AWS Hardware Storage Tuning 121

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Caching partially stores your data and is not used as permanent storage. Caching Schemes.

Cache 126

Cache Performance Servers Social Media 126

Scalegrid

JANUARY 8, 2024

AI-driven cloud solutions like ScaleGrid offer a diverse range of database hosting options, robust infrastructure optimized for scalability and security, and enable significant cost reductions, supporting businesses in efficient growth and improved ROI. These services are tailored to meet various business requirements.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. Managed Instance provides two tiers for performance. The General Purpose tier is designed for applications with typical performance and I/O latency requirements and provides built-in HA. One size does not always fit all. GB per vCore.

Azure 63

Azure Performance Storage Latency 63

Randon ASCII

SEPTEMBER 8, 2019

Now that we suspect file I/O it’s necessary to go to Graph Explorer-> Storage-> File I/O. I get cranky when databases do 4-KiB reads but this is amazing. Don’t call ReadFile to get 68 bytes. Or, at least, don’t do it a hundred thousand times. I hope somebody fixes this. Hey, I shared an ETW trace and everything!

Latency 79

Latency Cache Programming Operating System 79

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT 78

IoT Analytics Big Data Architecture 78

Scalegrid

JUNE 4, 2020

ScaleGrid is a fully managed DBaaS that supports MySQL, PostgreSQL and Redis™, along with additional support for MongoDB® database and Greenplum® database. Along with many popular cloud providers, DigitalOcean also provides a Managed Databases service. So, which database service is right for your application?

Database 230

Database Latency Benchmarking Performance 230

All Things Distributed

SEPTEMBER 25, 2012

Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS). High Performance I/O.

Cloud 117

Cloud AWS Storage Database 117

The Morning Paper

AUGUST 29, 2019

We group the DBMS design choices and tradeoffs into three broad categories, which result from the need for dealing with (A) external storage; (B) query executors that are spun on demand; and (C) DBMS-as-a-service offerings. InS does now offer an NVMe variant too, and the authors perform limited testing on that as well. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. in the directory storage/innobase/ut the following section has UT_RELAX_CPU defined to call the PAUSE instruction on x86.

Testing 48

Testing Tuning Latency Storage 48

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Scalability Architecture 130

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 127

Performance Hardware Tuning Storage 127

VoltDB

JULY 10, 2018

But that fully self sufficient nature means that each of these services have their own end-to-end full stack of technology, including database. If the data is common between multiple services, the database layer gets extricated out of microservices in favor of the creation of a common shared data layer. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

VoltDB

JULY 10, 2018

But that fully self sufficient nature means that each of these services have their own end-to-end full stack of technology, including database. If the data is common between multiple services, the database layer gets extricated out of microservices in favor of the creation of a common shared data layer. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

InfoQ

JUNE 16, 2023

The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

All Things Distributed

DECEMBER 14, 2011

This new Region has been highly requested by companies worldwide, and it provides low-latency access to AWS services for those who target customers in South America. The new Sao Paulo Region provides better latency to South America, which enables AWS customers to deliver higher performance services to their South American end-users.

AWS 114

AWS Latency Storage Big Data 114

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. Here, we will discuss a notable new feature in Amazon RDS, the Dedicated Log Volume (DLV), that has been introduced to boost database performance. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 98

AWS Benchmarking Performance Traffic 98

The Morning Paper

MARCH 10, 2020

So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads. This benchmark can synthetically generate more precise key-value queries that represent the reads and writes of key-value stores to the underlying storage system.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. This was both expensive and time consuming to configure.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Percona

MAY 2, 2023

That’s why it’s essential to implement the best practices and strategies for MongoDB database backups. Why are MongoDB database backups important? Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks.

Best Practices 52

Best Practices Database Storage Servers 52

The Morning Paper

FEBRUARY 23, 2020

Our approach differs substantially by (1) providing economic incentives for data to be contributed and integrated into existing schemas, (2) offering a SQL interface instead of graph based approaches, (3) including the computational and storage infrastructure in the architectural vision. Contractors that don’t want to pay publishers?

Blockchain 94

Blockchain Internet Internet IoT 94

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. In those days, my main goal was to take the advances in building the highly dedicated High Performance Cluster environments and turn them into commodity technologies for the enterprise to use.

Cloud 118

Cloud AWS Automotive Latency 118

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications.

Tuning 45

Tuning Cache Database Storage 45

All Things Distributed

DECEMBER 3, 2009

This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. In addition, the EU (Ireland) Region is available to customers who want local access to services from Europe to address their performance or jurisdiction requirements. Contact Info. Werner Vogels.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Low-latency query resolution The query resolution functionality of Route 53 is based on anycast, which will route the request automatically to the DNS server that is the closest. Comments ().

Cloud 117

Cloud Internet Internet AWS 117

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. Block compression can improve performance by allowing data to be read and written in smaller chunks.

Storage 110

Storage Network Open Source Latency 110

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Storage is a critical aspect to consider when working with cloud workloads. What is workload in cloud computing?

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. High performance and mobility.

Big Data 154

Big Data Processing Lambda Database 154