Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. It is advisable to have a dedicated production MySQL Server that can independently claim the system resources as needed.

Performance 108

Performance Monitoring Traffic Database 108

Percona

JULY 17, 2023

5 among all database management systems and No. 1 among non-relational/document-based systems ( DB-Engines, July 2023 ). Taking a deeper dive, MongoDB is a system for analyzing data because documents are easily shared across multiple nodes and because of its indexing, query-on-demand, and real-time aggregation capabilities.

Open Source 79

Open Source Database Scalability Software 79

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Operating system Linux is the most common operating system for high-performance MySQL servers. Setting swappiness to one is generally recommended, lowering the tendency of swapping.

Performance 129

Performance Hardware Tuning Storage 129

The Morning Paper

OCTOBER 26, 2020

As a production system within Microsoft capturing around a quadrillion events and indexing 16 trillion search keys per day it would be interesting in its own right, but there’s a lot more to it than that. These two narratives of reference architecture and ingestion/indexing system are interwoven throughout the paper.

Cloud 104

Cloud Big Data Latency Architecture 104

Percona

DECEMBER 26, 2023

Dashboard example 2: Monitoring in real time These two panels show read/write IO performance to the persistent storage while benchmarking a live run. Percona Distribution for PostgreSQL provides the best and most critical enterprise components from the open-source community, in a single distribution, designed and tested to work together.

Benchmarking 125

Benchmarking Metrics C++ Database 125

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

JANUARY 24, 2023

ALTER SYSTEM SET wal_compression=ON; SELECT pg_reload_conf(); PostgreSQL 15+ Modern compression algorithms started offering much better compression while taking fewer CPU cycles. Individual processes generate WAL records, and latency is very crucial for transactions. Lz4 is a good example.

Database 120

Database Benchmarking Open Source Latency 120

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks. Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. This capability is valuable for reverting to a previous state, whether to recover from data corruption or any other incident.

AWS 52

AWS Database Serverless Storage 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 7, 2023

Here’s how the same test performed when running Percona Distribution for PostgreSQL 14 on these same servers: Queries: reads Queries: writes Queries: other Queries: total Transactions Latency (95th) MySQL (A) 1584986 1645000 245322 3475308 122277 20137.61 MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 138

Tuning Cache Servers Benchmarking 138

The Morning Paper

MARCH 10, 2020

So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads. This benchmark can synthetically generate more precise key-value queries that represent the reads and writes of key-value stores to the underlying storage system.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. So to test I took a system with Skylake CPUs and all storage on a P4800X SSD. In the recent MySQL 8.0.16

Testing 48

Testing Tuning Latency Storage 48

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 37

AWS Entertainment Open Source Benchmarking 37

The Morning Paper

FEBRUARY 23, 2020

Our approach differs substantially by (1) providing economic incentives for data to be contributed and integrated into existing schemas, (2) offering a SQL interface instead of graph based approaches, (3) including the computational and storage infrastructure in the architectural vision. Market participants.

Blockchain 94

Blockchain Internet Internet IoT 94

The Morning Paper

SEPTEMBER 5, 2019

For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g A characteristic of latency distributions is that they have a long tail. Why do we need a new sketch? At the 50th percentile, an accuracy within 0.5%

Latency 52

Latency Metrics Open Source Java 52

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). A good example will be something like Pachyderm [8] [9] - a relatively young project which implements a distributed Pachyderm File System (PFS) and a data-aware scheduler Pachyderm Pipeline System (PPS) on top of Kubernetes. Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. In the MySQL open source ecosystem, we have only two consolidated ways to perform sharding — Vitess and ProxySQL.

Traffic 127

Traffic Scalability Database Servers 127

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput. I.e. if system A generated 1.5X

C++ 40

C++ Benchmarking Virtualization Open Source 40

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. In a nutshell, a data pipeline is a distributed system. to higher level data formats (JSON, XML, Arvo, Parquet, etc).

Latency 63

Latency Analytics Scalability Engineering 63

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. It’s now time to put our race-logic encoded decision trees in the context of an end-to-end system. Boosted race trees for low energy classification Tzimpragos et al.,

Energy 52

Energy Hardware Efficiency Architecture 52

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 53

Latency Engineering Systems Hardware 53

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Chrome has missed several APIs for 3+ years: Storage Access API. Media Session API.

Media 145

Media Games Education Engineering 145

Alex Russell

JULY 14, 2021

The predominant desktop situation is relatively straightforward: Browsers handle links, and non-browsers defer loading http and https URLs to the system, which in turn invokes the default browser. Instead, they load content referred by their hosting native app in system-provided WebViews. The Baseline Scenario #.

Google 121

Google Mobile Engineering Internet 121

High Scalability

SEPTEMBER 8, 2018

The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. The core component in Anna v11 is a monitoring system & policy engine that together enable workload-responsiveness and adaptability.

Storage 199

Storage Performance AWS Efficiency 199

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. The coupling problem Until recently, video quality measurements were generated as part of our Reloaded production system. We call this system Cosmos.

Media 171

Media Innovation Metrics Latency 171

Smashing Magazine

JANUARY 11, 2021

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. There are many tools allowing you to achieve that: SiteSpeed.io Large preview ). Large preview ).

Performance 145

Performance Cache Media Metrics 145

Abhishek Tiwari

NOVEMBER 3, 2018

Recently I was asked about content management systems (CMS) of the future - more specifically how they are evolving in the era of microservices, APIs, and serverless computing. In addition, open source CMS solutions also struggle with blotted plugin ecosystem. can generate an HTML-only website without involving a CMS.

Systems 63

Systems Cache Website Network 63

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io

Performance 145

Performance Cache Network Metrics 145

High Scalability

DECEMBER 21, 2018

odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been. kellabyte : “Open source” infrastructure companies are a giant s**t show right now. And if you know someone with hearing problems they might find Live CC useful.

Internet 137

Internet Internet Scalability Serverless 137

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. There are many tools allowing you to achieve that: SiteSpeed.io But this consideration needs to be deliberate.

Performance 103

Performance Cache Metrics Network 103