Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

Dynatrace

JUNE 8, 2021

Observability is a topic at the top of mind for all architects, Site Reliability Engineers (SREs), and more – each wanting to use observability to proactively detect issues and guarantee the best experience and availability to users. Usual exceptions raised by our system that is now considered to be normal by Davis. Slow degradations.

Metrics 168

Metrics Tuning Programming Systems 168

The Netflix TechBlog

OCTOBER 15, 2019

Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2]. By their nature, they can only rely on the lowest common denominator of participating systems. That system quickly grew very complex and became difficult to maintain.

Transportation 192

Transportation Architecture Processing Storage 192

Scalegrid

JANUARY 25, 2024

These essential data points heavily influence both stability and efficiency within the system. It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. it signifies memory fragmentation. <code>127.0.0.1:6379>

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

AUGUST 7, 2023

Both logs are crucial in the ACID (Atomicity, Consistency, Isolation, Durability) properties of database systems. InnoDB Undo Log The undo log, also known as the rollback segment, is a crucial part of the InnoDB storage engine. In a database system, rollback segments are used to temporarily store undo data during transactions.

Database 97

Database Tuning Storage Open Source 97

Percona

AUGUST 17, 2023

In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). How-to documentation is readily available. It’s well-suited for organizations that require mission-critical applications with high availability.

Open Source 83

Open Source Healthcare Social Media Database 83

Dynatrace

APRIL 26, 2022

DEM provides an outside-in approach to user monitoring that measures user experience (UX) in real time to ensure applications and services are available, functional, and well-performing across all channels of the digital experience, including web, mobile, and IoT. Endpoint monitoring (EM). Endpoints can be physical (i.e.,

Monitoring 206

Monitoring Social Media IoT Metrics 206

Percona

DECEMBER 27, 2023

All of the database automation for running a highly available, resilient, and secure database is built into the operator to simplify the operation and management of your clusters. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 83

Cloud Open Source Strategy Best Practices 83

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

NOVEMBER 17, 2020

With these release candidate APIs available, instrumentation for web frameworks, storage clients, and much more can be built. Stay tuned, there’s more to come! Dynatrace fully embraces OpenTelemetry. I enjoy being part of a team of experts in different areas.

Open Source 152

Open Source Software Engineering Government Java 152

Percona

DECEMBER 20, 2018

Linux OS Tuning for MySQL Database Performance. In this post we will review the most important Linux settings to adjust for performance tuning and optimization of a MySQL database server. We’ll note how some of the Linux parameter settings used OS tuning may vary according to different system types: physical, virtual or cloud.

Database 41

Database Tuning Performance AWS 41

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 92

Storage Engineering Database Hardware 92

HammerDB

MAY 5, 2019

Also it is interesting to note that the impact of this change was not observed in other databases or other MySQL storage engines such as MyRocks the only noticeable impact with HammerDB workloads occurred in MySQL with InnoDB where in the source code ut0ut.cc So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 108

Storage Strategy Cloud Azure 108

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 130

Tuning Cache Storage Database 130

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Perhaps inspired by serverless in spirit and in terminology, the path forward proposed in this paper is towards a managed and model-less inference serving system.

Hardware 58

Hardware Latency Serverless Energy 58

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Operating system Linux is the most common operating system for high-performance MySQL servers. Typically a good value is 70%-80% of available memory. Setting oom_score_adj to -800.

Performance 130

Performance Hardware Tuning Storage 130

Percona

FEBRUARY 24, 2023

Today, we are excited to announce the release of Percona Monitoring and Management (PMM) V2.35 , including a tech preview of label-based access control, the general availability of Helm Chart, and a range of enhancements to our Database as a Service (DBaaS) offerings, among other improvements and features. Stay tuned!

Availability 97

Availability Metrics Monitoring Open Source 97

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. By collecting and analyzing key performance metrics of the service over time, we can assess the impact of the new changes and determine if they meet the availability, latency, and performance requirements. But what happens when this machinery needs a transformation?

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

MARCH 14, 2023

We must quickly surface the most stand-out highlights from the titles available on our service in the form of images and videos in the member experience. We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. Maintaining disparate systems posed a challenge.

Media 291

Media Innovation Energy Architecture 291

Scalegrid

JANUARY 8, 2019

In Part I , we introduced a High Availability (HA) framework for MySQL hosting and discussed various components and their functionality. Simply put, in a MySQL semisynchronous replication configuration, the master commits transactions to the storage engine only after receiving acknowledgement from at least one of the slaves.

Availability 113

Availability Tuning Speed Network 113

Percona

OCTOBER 18, 2023

Parallel run : Operating both the existing and new database system simultaneously during the transition, allowing for a seamless fallback in case of any issues. Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you.

Open Source 96

Open Source Database Hardware Strategy 96

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Managing a database is hard, as it needs continuous updating, tuning, and monitoring to ensure the performance of your website.

Database 166

Database Cloud Website Azure 166

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. In a nutshell, a data pipeline is a distributed system. If tuned for performance, there is a good change reliability is compromised - and vice versa.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? MySQL comes pre-configured to be conservative instead of making the most of the resources available in the server. Why is that?

Tuning 139

Tuning Cache Servers Benchmarking 139

The Netflix TechBlog

OCTOBER 27, 2020

For how our machine learning recommendation systems leverage our key-value stores, please see more details on this presentation. Then the KV DAL handles writing to the appropriate underlying storage engines depending on latency, availability, cost, and durability requirements.

Latency 243

Latency Storage Big Data Tuning 243

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. After being available in an Early Adopter Release, we’re happy to announce that AWS supporting services are now Generally Available (GA). Amazon Elastic File System (EFS). Amazon EMR.

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. After being available in an Early Adopter Release, we’re happy to announce that AWS supporting services are now Generally Available (GA). Amazon Elastic File System (EFS). Amazon EMR.

AWS 133

AWS Metrics IoT Storage 133

Dynatrace

JULY 6, 2022

Virtualization has revolutionized system administration by making it possible for software to manage systems, storage, and networks. This can reduce labor costs and enhance reliability by enabling systems to self-heal. Design, implement, and tune effective SLOs. Apply AIOps for analysis and automation.

Best Practices 190

Best Practices Open Source Tuning Infrastructure 190

Dynatrace

FEBRUARY 9, 2022

Cloud vendors such as Amazon Web Services (AWS), Microsoft, and Google provide a wide spectrum of serverless services for compute and event-driven workloads, databases, storage, messaging, and other purposes. In addition, Davis provides automatic alerting of service-to-service communication problems using queues and other event systems.

Serverless 190

Serverless Azure Lambda AWS 190

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Log monitoring vs log analytics.

Analytics 211

Analytics Monitoring Artificial Intelligence DevOps 211

Percona

DECEMBER 6, 2023

Additional read Mike’s blog on How to Find and Tune a Slow SQL Query Q: What is your disaster recovery (DR) strategy? We all know that saving plaintext passwords in this file is a significant security risk, as it could lead to unauthorized access if the file system is compromised. A: We have a replica under our primary database.

Strategy 81

Strategy Database Best Practices Tuning 81

The Netflix TechBlog

NOVEMBER 2, 2021

The coupling problem Until recently, video quality measurements were generated as part of our Reloaded production system. This system is responsible for processing incoming media files, such as video, audio and subtitles, and making them playable on the streaming service. We call this system Cosmos. The workflow is initiated.

Media 171

Media Innovation Metrics Latency 171