Scalegrid

OCTOBER 24, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 183

AWS Latency Performance Benchmarking 183

Dynatrace

JANUARY 14, 2022

That is because Kubernetes provides several benefits from a performance perspective. However, setting the right parameters for Kubernetes clusters to ensure application availability, performance, and resilience while avoiding overspending isn’t a walk in the park. SREcon21 – Automating Performance Tuning with Machine Learning.

Latency 202

Latency Tuning Efficiency AWS 202

Scalegrid

NOVEMBER 20, 2019

By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries. During this time, you are also likely to experience a degraded performance of queries as your system resources are busy in index-creation work as well. Performance Benefits of Rolling Index Creation. EC2 instance m4.large

Best Practices 239

Best Practices Latency Tuning Database 239

Scalegrid

DECEMBER 14, 2023

How the MongoDB timeout is set up can significantly affect your application’s performance, no matter if you are an experienced MongoDB user or just starting with NoSQL databases. Typical applications are interacting with different database servers based on the business logic. Modifying this setting does affect performance.

Java 130

Java Network Servers Database 130

SQL Performance

SEPTEMBER 17, 2019

Many database administrators find themselves having to support instances of SQL Server Reporting Services (SSRS), or at least the backend databases that are required for SSRS. In each of the deployment models, the role of the database administrator is to make sure that SSRS is stable, dependable, and recoverable.

Tuning 67

Tuning Servers Database Best Practices 67

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. Replication lag is the delay between the time when data is written to the primary database and the time when it is replicated to the standby databases. What is replication lag?

Latency 84

Latency Tuning Open Source Network 84

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? That’s a heritage of the LAMP model when the same server would host both the database and the web server. Why is that?

Tuning 138

Tuning Cache Servers Benchmarking 138

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success.

Best Practices 90

Best Practices Hardware Tuning Scalability 90

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. This will get us straight to the application page, where we get more insight on how our front end actually performs.

Metrics 170

Metrics Monitoring Database Network 170

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. HyperScale Database. Hyperscale databases are provisioned using vCores. DTU Pricing Tier.

Azure 55

Azure Database Serverless Hardware 55

Scalegrid

OCTOBER 17, 2019

In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice. It would be a shame if your database crashed, after all. Developers are often strongly discouraged from holding a database connection while other operations take place.

Architecture 200

Architecture Database Latency Servers 200

Dynatrace

JANUARY 26, 2021

REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. When an application is triggered, it can cause latency as the application starts. Performing updates, installing software, and resolving hardware issues requires up to 17 hours of developer time every week.

Serverless 243

Serverless Efficiency Lambda Azure 243

Scalegrid

MARCH 22, 2024

It focuses on aligning organizational needs with cloud services, balancing performance and cost, and ensuring compliance, security, and effective cost management. They can also bolster uptime and limit latency issues or potential downtimes. Pick combinations that are not just affordable but also high-performing.

Strategy 130

Strategy Cloud Government Innovation 130

Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Want to save money on your AWS RDS bill? In practical terms, it was 3.7G

AWS 123

AWS Hardware Storage Tuning 123

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications.

Tuning 45

Tuning Cache Database Storage 45

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. The post Latency: Will it undermine the most interesting 5G use cases?

Latency 40

Latency Retail Virtualization Hardware 40

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. The post Latency: Will it undermine the most interesting 5G use cases?

Latency 40

Latency Retail Virtualization Hardware 40

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The Linux default is usually 60 , which is not ideal for database usage. The CFQ works well for many general use cases but lacks latency guarantees.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

AUGUST 30, 2021

By the following morning, alerts were received regarding high memory consumption and GC latencies, to the point where the service was unresponsive to HTTP requests. This setup is neither optimal nor break-proof since the Kafka message processing rate will vary depending on environmental factors, such as database latencies in our system setup.

Latency 213

Latency Traffic Transportation Cloud 213

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So what jumps out immediately here is the comment “The single-threaded PostgreSQL 12 performance was most surprising.” So lets switch the system to performance mode with one command./cpupower

Benchmarking 63

Benchmarking Performance Hardware C++ 63

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%.

Speed 126

Speed Java AWS Virtualization 126

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. In the recent MySQL 8.0.16 So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

HammerDB

OCTOBER 12, 2018

This post complements the previous best practice guides this time with the focus on MySQL and MariaDB and achieving top levels of performance with the HammerDB MySQL TPC-C test. Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB. 10 rows in set (0.02 order by c. SELECT c from sbtest where id=?

Best Practices 40

Best Practices Scalability Performance C++ 40

IO River

NOVEMBER 15, 2023

Two of them are particularly gnarly: fine-tuning rules to perfection and managing a WAF over a multi-CDN architecture. SQL Injection involves inserting malicious SQL queries into an input field, tricking the database into revealing sensitive information.Imagine a login page. Let's dive deep into these challenges.‍1.

Traffic 52

Traffic Network Logistics Architecture 52

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%.

Speed 40

Speed Java AWS Virtualization 40

IO River

NOVEMBER 2, 2023

Two of them are particularly gnarly: fine-tuning rules to perfection and managing a WAF over a multi-CDN architecture. SQL Injection involves inserting malicious SQL queries into an input field, tricking the database into revealing sensitive information.Imagine a login page. Let's dive deep into these challenges.‍1.

Traffic 40

Traffic Network Logistics Architecture 40

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. Logging Waits.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

O'Reilly Software

APRIL 4, 2018

Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components.

Architecture 80

Architecture Scalability Google Operating System 80

The Morning Paper

MARCH 10, 2020

So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads. The paper examines three different uses of RocksDB at Facebook: UDB , the underlying storage engine for the MySQL databases storing the social graph data.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

The Netflix TechBlog

JUNE 13, 2023

A small percentage of production traffic is redirected to the two new clusters, allowing us to monitor the new version’s performance and compare it against the current version. Canaries also provide an opportunity to measure system performance under different load conditions, allowing us to identify and resolve any performance bottlenecks.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

SQL Server According to Bob

JANUARY 11, 2020

KB sectors run on smaller sectors   14 System and sample databases   15 Determining the formatted sector size of database   15 What sector sizes does SQL Server support? ​​ SQL Server ​​ copy-on-write actions are used to maintain snapshot databases in SQL Server 2005.

Servers 40

Servers Cache Database Media 40

The Netflix TechBlog

JULY 26, 2021

Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain. In the initial stage, data consumers set up ETL pipelines directly pulling data from databases. When an upstream schema evolves (e.g.

Big Data 253

Big Data Government Analytics Processing 253

The Netflix TechBlog

OCTOBER 27, 2020

Iceberg is widely adopted in Netflix as a data warehouse table format that addresses many of the usability and performance problems with Hive tables. The data warehouse is not designed to serve point requests from microservices with low latency. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243