Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

DZone

SEPTEMBER 6, 2019

As application developers, your main focus is to design the most efficient queries for your application. You want to ensure the integrity of the data that your application pushes to the database, and construct the most efficient queries to retrieve the data needed for the application.

Performance 153

Performance Tuning Database Efficiency 153

Scalegrid

MARCH 22, 2024

Choosing the Right Cloud Services Choosing the right cloud services is crucial in developing an efficient multi cloud strategy. Ready to take your database management to the next level with ScaleGrid’s cutting-edge solutions? Elevate your cloud strategy today with ScaleGrid!

Strategy 130

Strategy Cloud Government Innovation 130

Percona

DECEMBER 27, 2023

of respondents are currently utilizing databases in Kubernetes (k8s). These indicators suggest that the adoption of databases on k8s is in its early stages and is likely to continue growing in the future. Customers will increasingly prioritize AI efficiency and education to tackle legal and ethical concerns.

Cloud 79

Cloud Open Source Strategy Best Practices 79

Scalegrid

JANUARY 11, 2024

Continuous cloud monitoring enables real-time detection and response to incidents, with best practices highlighting the importance of assessing cloud service providers, adopting layered security, and leveraging automation for efficient scanning and monitoring.

Best Practices 130

Best Practices Cloud Monitoring Strategy 130

Percona

DECEMBER 13, 2023

Error logging is a critical aspect of database administration, providing insights into issues, warnings, and errors that may affect the system’s stability and performance. MySQL 8 introduces Error Log Filtering as a mechanism to fine-tune the error log, allowing administrators to focus on the most critical issues.

Database 93

Database Open Source Tuning Traffic 93

Percona

OCTOBER 4, 2023

We discussed how roles can inherit permissions from other roles, simplifying access control in your database. Percona Distribution for PostgreSQL provides the best and most critical enterprise components from the open-source community, in a single distribution, designed and tested to work together.

C++ 99

C++ Open Source Tuning Database 99

Dynatrace

NOVEMBER 10, 2022

Containers are portable, self-contained operating environments that include applications and the dependencies they need to run, such as databases, middleware, and frameworks. While there are multiple ways to define cloud-native architecture, a consensus has formed around the following characteristics: Designed for automation.

Cloud 162

Cloud Architecture Serverless Infrastructure 162

Tech News Gather

JUNE 16, 2023

Building a successful UberEats clone requires a well-planned strategy that takes into account various aspects, including market research, feature prioritization, intuitive design, robust development, and targeted marketing campaigns. UberEats also excels in providing a reliable and efficient delivery service.

Social Media 52

Social Media Tuning Strategy Media 52

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. Most recently, in StackOverflow’s 2022 Stack Developer Survey , PostgreSQL took a slight lead over MySQL (46.48% to 45.68%) as the most popular database platform among professional developers. What is PostgreSQL used for? Is PostgreSQL enterprise-ready?

Open Source 79

Open Source Healthcare Social Media Database 79

SQL Performance

JANUARY 23, 2020

Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waits and Queues has been used as a SQL Server performance tuning methodology since Tom Davidson published the above article as well as the well-known SQL Server 2005 Waits and Queues whitepaper in 2006. The Top Queries That Weren't.

Tuning 115

Tuning Servers Monitoring Hardware 115

Percona

AUGUST 27, 2018

Database administrators with appropriate privileges can associate virtual CPUs with resource groups and assign threads to these groups. Dangerous , because if you set this to a thread when using connection pooling OR ProxySQL and multiplexing, you may end up assigning a limitation to queries that instead, you wanted to run efficiently.

Tuning 45

Tuning Virtualization Testing Servers 45

Percona

JANUARY 19, 2023

Some startups adopted MySQL in its early days such as Facebook, Uber, Pinterest, and many more, which are now big and successful companies that prove that MySQL can run on large databases and on heavily used sites. In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL.

Open Source 87

Open Source Storage Database Big Data 87

Percona

FEBRUARY 24, 2023

As a result, it becomes increasingly important to protect the confidentiality of information to prevent data leaks and facilitate easy access to relevant data sources and tools for the related teams without having to sift through unrelated databases or environmental data. to monitor and diagnose. +50

Metrics 106

Metrics Monitoring Database Engineering 106

Adrian Cockcroft

NOVEMBER 26, 2023

SUS101: Sustainability innovation in AWS Global Infrastructure AWS is determined to make the cloud the cleanest and most energy-efficient way to run customers’ infrastructure and business. This includes providing the efficient, resilient services AWS customers expect, while minimizing their environmental footprint. AWS speaker: T.

AWS 52

AWS Energy IoT Best Practices 52

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. If you don’t have well-designed and small columns for this composite primary key, it could enlarge all of your secondary indexes. Additionally, MySQL 8.0

Strategy 40

Strategy Storage Database Best Practices 40

Percona

JULY 2, 2023

The size of the database and your database environment—if it is on colo or cloud—matters. Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters.

Strategy 52

Strategy Database Storage Open Source 52

Percona

JULY 6, 2023

Performance is one of the essential aspects of a database management system. In PostgreSQL, there are different ways it can leverage the indexes to produce the most efficient plan. One way to verify a column’s number of distinct values is by querying the pg_stats view in our database.

Best Practices 89

Best Practices Tuning Database Testing 89

Scalegrid

JANUARY 8, 2019

Another configuration we can use to increase the efficiency of parallel execution on the slaves is to tune binlog_group_commit_sync_delay on the master. The default design of the ScaleGrid HA framework is to avoid falling back to asynchronous mode. Stay tuned!! Important Semisynchronous Replication Options.

Availability 113

Availability Tuning Speed Network 113

Percona

JANUARY 14, 2019

What if we use ClickHouse (which is a columnar analytical database) as our main datastore? Well, typically, an analytical database is not a replacement for a transactional or key/value datastore. However, ClickHouse is super efficient for timeseries and provides “sharding” out of the box (scalability beyond one node).

Database 40

Database Analytics Blockchain Healthcare 40

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. We earned the trust of our engineers by developing empathy for their operational burden and by focusing on providing efficient tracer library integrations in runtime environments. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

CSS Wizardry

NOVEMBER 3, 2020

So many false starts, tedious workflows, and a complete lack of efficiency really made it difficult for me to find momentum. I can see from the screenshot above that TTFB is my most stable metrics—no one page appears to have particularly expensive database queries or API calls on the back-end. That work is what comes next.

Speed 292

Speed Ecommerce Metrics Analytics 292

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute.

Programming 67

Programming Benchmarking Virtualization C++ 67

O'Reilly

MAY 25, 2021

Indeed, Google recently announced LaMDA , a model at GPT-3 scale that is designed to participate in conversations. These projects have created language models that are based on focused datasets (for example, models designed to be more accurate for academic papers, developer forum discussions, etc.). HODL for Fun & Profit.

Social Media 138

Social Media Media Internet Internet 138

SQL Performance

MARCH 8, 2021

This can make it difficult to draw sound performance-tuning conclusions. The following examples use the public Stack Overflow 2013 database ( download details ), with a single index added: CREATE INDEX PP ON dbo. Batch operators are implemented so that multiple threads can work efficiently on a single shared structure (e.g.

Servers 95

Servers Tuning Architecture Processing 95

The Netflix TechBlog

DECEMBER 21, 2020

We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 203

Storage Latency Efficiency Data Engineering 203

Particular Software

APRIL 9, 2018

To understand if our theme park is running efficiently or not, we'll need monitoring tools that understand how theme parks really work. While it's impossible to get rid of lines completely, understanding how they work can help us maximize our park's efficiency. So how do theme parks work? So we could narrow that down to two questions.

Systems 40

Systems Infrastructure Monitoring Tuning 40

The Netflix TechBlog

AUGUST 1, 2022

As the system evolves to solve more and more use cases, we have expanded its scope to handle not only the CDC use cases but also more general data movement and processing use cases such that: Events can be sourced from more generic applications (not only databases). They use different mechanisms to stream events out of the source databases.

Processing 272

Processing Transportation Entertainment Tuning 272

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

The Netflix TechBlog

JUNE 13, 2023

Therefore, the canary framework is designed to monitor operational and customer KPI metrics to detect persistent deviations and terminate the canary experiment if necessary. They enable us to further fine-tune and configure the system, ensuring the new changes are integrated smoothly and seamlessly.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

MARCH 25, 2019

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can push or pull.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

SQL Server According to Bob

JANUARY 11, 2020

KB sectors run on smaller sectors   14 System and sample databases   15 Determining the formatted sector size of database   15 What sector sizes does SQL Server support? This is different from ​​ the reference count design ​​ that was ​​ used in SQL Server 7.0

Servers 40

Servers Cache Database Media 40

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. As most key-value storage engines support efficiently deleting a namespace (e.g.

Latency 243

Latency Storage Big Data Tuning 243

SQL Performance

SEPTEMBER 2, 2021

A lot of things change over the course of a few major versions of our favorite database platform. He spent a lot of time fine-tuning this CLR function to efficiently parse a string. Then I added the following assembly and function to my database: CREATE ASSEMBLY CLRUtilities FROM 'c:DLLsCLRUtilities.dll'.

C++ 59

C++ Servers Testing Database 59

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events. Designed with High Availability in mind.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

JANUARY 10, 2024

Moving away from the use of dedicated instances that were constrained in quantity, we tapped into Netflix’s internal trough created due to autoscaling microservices, leading to significant improvements in computation elasticity as well as resource utilization efficiency. The results are saved to a database so they can be reused.

Processing 229

Processing Media Latency Innovation 229