The Netflix TechBlog

OCTOBER 19, 2020

Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

HammerDB

OCTOBER 18, 2018

With this feature Oracle generates a wealth of performance data that can be reviewed once the test is complete. However what if you want to review performance data in real time as the test is running? With HammerDB 3.1 you can now do that with Oracle Metrics. .

Benchmarking 40

Benchmarking Monitoring Performance C++ 40

Scalegrid

OCTOBER 24, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. Slave-2 uses an EBS data disk, and you can configure the amount of IOPS required for your cluster. This configuration provides complete safety for your data, even in the event you lose the local SSD disks.

AWS 183

AWS Latency Performance Benchmarking 183

HammerDB

APRIL 19, 2023

GHz 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids) Up to 20% higher compute performance than z1d instances Up to 50 Gbps of networking speed Up to 40 Gbps of bandwidth to the Amazon Elastic Block Store (EBS) We can also verify these capabilities by running some simple benchmarks on the different subsystems.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Disk space usage Monitor the disk space usage of MySQL data files, log files, and temporary files. This KPI is also directly related to Query Performance and helps improve it.

Performance 105

Performance Monitoring Traffic Database 105

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. JOINER uses PXB to stream the data directory from DONOR. Percona XtraBackup copies the InnoDB data files. Percona XtraBackup copies the InnoDB data files. ibd2sdi data/test/t1.ibd ibd > t1.sdi

Cache 87

Cache Benchmarking Servers Design 87

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

Percona

MARCH 27, 2023

Disclaimer : This blog post is meant to show a less-known problem but is not meant to be a serious benchmark. I_S relies on opening.frm files from disk to retrieve table information, which can cause a performance drop when the amount of opened tables does not fit in the table_cache. Results for Percona Server for MySQL 8.0

Cache 103

Cache Hardware Servers Benchmarking 103

Percona

JANUARY 19, 2023

With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance. For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant. There are many compression tools and algorithms for data out there.

Open Source 89

Open Source Storage Database Big Data 89

SQL Performance

NOVEMBER 18, 2019

The sizes offer you options for the number of vCPUs, RAM, and data disks. The number of data disks will determine maximum IOPS (IOPS stands for input/output operations per second.) The common trend is to choose a VM based exclusively on vCPU, memory, and storage capacity without benchmarking the current IO and throughput requirements.

Azure 76

Azure Benchmarking Storage Virtualization 76

Percona

OCTOBER 12, 2023

A simple sysbench benchmark on MySQL shows an overhead between six and 10 percent on CPU-bound systems when running perf with the default sampling frequency of 4000 Hz. In some cases, it’s possible to run profilers manually on Kubernetes to have more control over the data collection process.

Code 111

Code Tuning C++ Benchmarking 111

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. Likewise it has very low requirements on the initial amount of training data.

Testing 163

Testing AWS Lambda Network 163

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. In the days before highly performant SSDs and persistent memory, database benchmarks had a significant challenge in comparing performance due to the available I/O performance.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Speed Curve

FEBRUARY 15, 2021

IMPORTANT: Before you overly invest in setting up performance budgets for any of these metrics, first take a good look at how these metrics align with your own data. The easiest way to do this is to look at rendering filmstrips in your synthetic test data. This is where you need to track your own real user data. Can I use it?

Performance 134

Performance Metrics Benchmarking Google 134

Percona

MAY 1, 2023

Schema design: Evaluating the database schema design and making adjustments such as partitioning large tables, eliminating redundant data, and denormalizing tables for frequently accessed information can improve performance. Slow queries and data retrieval can lead to frustrating delays that impact the user experience.

Tuning 52

Tuning Efficiency Database Performance 52

The Netflix TechBlog

NOVEMBER 22, 2019

Technology advancements in content creation and consumption have also increased its data footprint. To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Scalegrid

NOVEMBER 25, 2019

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9

Big Data 187

Big Data Database Open Source Azure 187

Smashing Magazine

FEBRUARY 15, 2021

Real-World Data. To figure out what exactly is the problem, we can use FFMPEG , which is open source and free, and proves to be one of the most reliable tools to optimize videos. But first, let’s look at the data we get from FFprobe. of the entire data consumed. The answer, as always, lies in the source.

Network 143

Network Speed Website Mobile 143

KeyCDN

AUGUST 15, 2019

Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. An interruption in data flow due to limited capacity is called a bottleneck. Test and collect data: Let your testing software do all the hard work, then assess the results.

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

The Morning Paper

MAY 27, 2019

CHERI adds a new hardware data type for strongly protected C-language pointers, the CHERI capability (the evaluation uses an FPGA-based implementation). If any violation is detected the tag bit is cleared, and the data can no longer be interpreted as a capability. For a macro-benchmark PostgreSQL’s initdb tool was used.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Percona

DECEMBER 20, 2018

With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies. Percona Monitoring and Management: Look After Your pmm-data Container.

Database 40

Database Tuning Performance AWS 40

Testsigma

MARCH 23, 2021

It is open source and its development can be ported across devices with relative ease. Unlike iOS development, Android development requires proper standards and varying benchmarks for performance and optimization. We don’t even need a moment to gather which operating system is the most used one.

Testing 52

Testing Mobile Testing Tools Strategy 52

Speed Curve

JULY 2, 2013

SpeedCurve focuses on a third which I like to call web performance benchmarking. It's often called synthetic testing as tests are run from servers in a data centre and don't accurately represent what speeds an actual user might get. Web Performance Benchmarking. Uptime Monitoring. Real User Monitoring.

Benchmarking 40

Benchmarking Performance Website Analytics 40

Percona

AUGUST 31, 2018

That means data is stored in memory twice, first in PostgreSQL buffer and then kernel buffer. The configuration really depends on your machine and the working data set. In the case of a server crash, data might be lost even though the client received a success message on commit. PostgreSQL’s Tuneable Parameters.

Tuning 57

Tuning Database Performance Benchmarking 57

Dynatrace

SEPTEMBER 23, 2021

Application developers commonly leverage open-source software when building containerized applications. In fact, the market research firm Forrester says that the average container image is comprised of 70% open-source software.[1] 1] And unfortunately, open-source software is often fraught with security vulnerabilities.

Open Source 243

Open Source Benchmarking Best Practices Network 243

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

OCTOBER 2, 2023

Teams can gain this understanding through topology mapping , with telemetry data from request traces, and understanding how the frontend ties to backend functions. Many organizations also find it useful to use an open source observability tool, such as OpenTelemetry.

Architecture 224

Architecture Artificial Intelligence Cloud Open Source 224

Smashing Magazine

JUNE 3, 2022

Since many new typefaces are not supplied with any objective concrete testing data, how do we determine how well they work and where they succeed or fail? Measuring Typefaces And The Resulting Performance Data. Diagram outlining the difficulties of testing and then cross comparing typeface testing data. Large preview ).

Performance 110

Performance Design Best Practices Testing 110

Rigor

SEPTEMBER 11, 2019

Sergey is an open source developer, tireless educator on performance topics, and author of many web performance-related tools, including ShowSlow , SVN Assets , drop-in.htaccess and more. He tweets about Chrome initiatives, open source tools, and performance news @ paul_irish. Scott Jehl. Scott Jehl.

Performance 89

Performance Education Google Website 89

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Percona

DECEMBER 11, 2023

It becomes more manageable and efficient by isolating logs and data to a dedicated mount. We performed a standard benchmarking test using the sysbench tool to compare the performance of a DLV instance vs a standard RDS MySQL instance, as shared in the following section. Are DLVs effective for your RDS instance? Get in touch

AWS 98

AWS Benchmarking Performance Traffic 98

Percona

DECEMBER 26, 2023

Configuring Grafana For our purposes, the Grafana datasource used in this PoC is also the Postgres data cluster that is generating the data to be monitored. It collects various statistics data such as query statistics, query plan, SQL comments, and other performance insights. And yes, it even works in PostgreSQL.

Benchmarking 123

Benchmarking Metrics C++ Database 123

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Dynatrace

SEPTEMBER 21, 2023

A single data center can consume the equivalent electricity of 50,000 homes.” Assessing our baseline cloud computing carbon footprint Using Carbon Impact, we can assess our baseline carbon footprint with accuracy and granularity that’s nearly impossible to glean from other sources.

Energy 226

Energy Cloud Airlines Strategy 226

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. Two benchmarks from users can be found here: [1] [2] 4. One of the key benefits of using PostgreSQL is its reliability, scalability, and performance.

Cache 115

Cache Open Source Benchmarking Database 115

Scalegrid

JUNE 4, 2020

As an open source database, it’s a highly popular choice for enterprise applications looking to modernize their infrastructure and reduce their total cost of ownership, along with startup and developer applications looking for a powerful, flexible and cost-effective database to work with. PostgreSQL Benchmark Setup. Query Mode.

Database 230

Database Latency Benchmarking Performance 230