Scalegrid

NOVEMBER 20, 2019

There will be a short duration (tens of seconds) during which you will lose connectivity to your database due to the failover, but this can be overcome by having application-level retries. 95th Percentile Latency. The 95th percentile latency of queries was also 1.8 Stay tuned for my follow-on blog post with more details!

Best Practices 239

Best Practices Latency Tuning Database 239

SQL Performance

SEPTEMBER 17, 2019

Many database administrators find themselves having to support instances of SQL Server Reporting Services (SSRS), or at least the backend databases that are required for SSRS. In each of the deployment models, the role of the database administrator is to make sure that SSRS is stable, dependable, and recoverable.

Tuning 67

Tuning Servers Database Best Practices 67

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. Replication lag is the delay between the time when data is written to the primary database and the time when it is replicated to the standby databases. What is replication lag?

Latency 79

Latency Tuning Open Source Network 79

Scalegrid

DECEMBER 14, 2023

How the MongoDB timeout is set up can significantly affect your application’s performance, no matter if you are an experienced MongoDB user or just starting with NoSQL databases. Typical applications are interacting with different database servers based on the business logic. Careful consideration must be given before making changes.

Java 130

Java Network Servers Database 130

Scalegrid

OCTOBER 24, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 183

AWS Latency Performance Benchmarking 183

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? That’s a heritage of the LAMP model when the same server would host both the database and the web server.

Tuning 133

Tuning Cache Servers Benchmarking 133

Scalegrid

OCTOBER 17, 2019

In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice. It would be a shame if your database crashed, after all. Developers are often strongly discouraged from holding a database connection while other operations take place.

Architecture 200

Architecture Database Latency Servers 200

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success. In MongoDB 6.x:

Best Practices 85

Best Practices Hardware Tuning Scalability 85

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. HyperScale Database. Hyperscale databases are provisioned using vCores. DTU Pricing Tier.

Azure 55

Azure Database Serverless Hardware 55

Dynatrace

MAY 17, 2023

Think about items such as general system metrics (for example, CPU utilization, free memory, number of services), the connectivity status, details of our web server, or even more granular in-application tasks like database queries. Database monitoring Once more, under Applications & Microservices, we’ll also find Databases.

Metrics 171

Metrics Database Monitoring Network 171

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Benchmark before you decide.

Performance 123

Performance Hardware Tuning Storage 123

Dynatrace

JANUARY 26, 2021

REST APIs, authentication, databases, email, and video processing all have a home on serverless platforms. When an application is triggered, it can cause latency as the application starts. Security, databases, and programming languages effortlessly remain up to date and secure in the serverless model.

Serverless 243

Serverless Efficiency Lambda Azure 243

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications.

Tuning 44

Tuning Cache Database Storage 44

Percona

MAY 1, 2023

I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. ” Yes, this is true, io2 volumes are expensive, and honestly, I think they should be used only where really high IO capacity at expected latencies is required, and this didn’t seem to be the case.

AWS 117

AWS Hardware Storage Tuning 117

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. Ready to take your database management to the next level with ScaleGrid’s cutting-edge solutions? Register now for free and experience the seamless operation of your databases across multi-cloud and hybrid-cloud systems.

Strategy 130

Strategy Cloud Government Innovation 130

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. The post Latency: Will it undermine the most interesting 5G use cases?

Latency 40

Latency Retail Virtualization Hardware 40

VoltDB

JUNE 19, 2017

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. This requires 1 ms network latency. The post Latency: Will it undermine the most interesting 5G use cases?

Latency 40

Latency Retail Virtualization Hardware 40

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The Linux default is usually 60 , which is not ideal for database usage. The CFQ works well for many general use cases but lacks latency guarantees.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

AUGUST 30, 2021

By the following morning, alerts were received regarding high memory consumption and GC latencies, to the point where the service was unresponsive to HTTP requests. This setup is neither optimal nor break-proof since the Kafka message processing rate will vary depending on environmental factors, such as database latencies in our system setup.

Latency 213

Latency Traffic Transportation Hardware 213

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. top(1) showed that only the Cassandra database was consuming CPU. I've shared many posts about superpower observability tools, but often humble hacking is just as effective. These can be invisible to top(8).

Speed 126

Speed Java AWS Virtualization 126

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. In the recent MySQL 8.0.16 So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. hardware limits: 1000 MHz - 4.00 GHz available cpufreq governors: performance powersave current policy: frequency should be within 1000 MHz and 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

IO River

NOVEMBER 15, 2023

Two of them are particularly gnarly: fine-tuning rules to perfection and managing a WAF over a multi-CDN architecture. SQL Injection involves inserting malicious SQL queries into an input field, tricking the database into revealing sensitive information.Imagine a login page. Let's dive deep into these challenges.‍1.

Traffic 52

Traffic Network Logistics Architecture 52

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. top(1) showed that only the Cassandra database was consuming CPU. I've shared many posts about superpower observability tools, but often humble hacking is just as effective. These can be invisible to top(8).

Speed 40

Speed Java AWS Virtualization 40

IO River

NOVEMBER 2, 2023

Two of them are particularly gnarly: fine-tuning rules to perfection and managing a WAF over a multi-CDN architecture. SQL Injection involves inserting malicious SQL queries into an input field, tricking the database into revealing sensitive information.Imagine a login page. Let's dive deep into these challenges.‍1.

Traffic 40

Traffic Network Logistics Architecture 40

O'Reilly Software

APRIL 4, 2018

Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components.

Architecture 80

Architecture Scalability Google Operating System 80

The Morning Paper

MARCH 10, 2020

The paper examines three different uses of RocksDB at Facebook: UDB , the underlying storage engine for the MySQL databases storing the social graph data. YCSB lets you tune the query type ratio, KV-pair hotness distribution, and value size distribution. Three workloads. For one representative UDB server, about 10.2 Does that matter?

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. Oracle Log File Sync.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

HammerDB

OCTOBER 12, 2018

Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB. As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. As is exactly the same with PostgreSQL for system choice a 2 socket system is optimal for MySQL OLTP performance.

Best Practices 40

Best Practices Scalability Performance C++ 40

The Netflix TechBlog

JUNE 13, 2023

By collecting and analyzing key performance metrics of the service over time, we can assess the impact of the new changes and determine if they meet the availability, latency, and performance requirements. They enable us to further fine-tune and configure the system, ensuring the new changes are integrated smoothly and seamlessly.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

DECEMBER 21, 2020

These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. Other than these principles, there are some other design considerations to support and enable: Multi-tenancy with database and table prioritization. Transparency to end-users. More processing resources.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

JULY 26, 2021

Operational Reporting is a reporting paradigm specialized in covering high-resolution, low-latency data sets, serving detailed day-to-day activities¹ and processes of a business domain. In the initial stage, data consumers set up ETL pipelines directly pulling data from databases. Please stay tuned! Endnotes ¹ Inmon, Bill.

Big Data 253

Big Data Government Analytics Processing 253

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. How Bulldozer leverages Spark, Protobuf and KV DAL for moving the data.

Latency 243

Latency Storage Big Data Tuning 243

SQL Server According to Bob

JANUARY 11, 2020

KB sectors run on smaller sectors   14 System and sample databases   15 Determining the formatted sector size of database   15 What sector sizes does SQL Server support? SQL Server 2005 introduces the snapshot database feature for point-in-time databases ​​ and online DBCC operations.

Servers 40

Servers Cache Database Media 40