Scalegrid

NOVEMBER 25, 2019

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 Google Cloud.

Big Data 187

Big Data Database Open Source Azure 187

Percona

DECEMBER 26, 2023

Configuring Grafana For our purposes, the Grafana datasource used in this PoC is also the Postgres data cluster that is generating the data to be monitored. It collects various statistics data such as query statistics, query plan, SQL comments, and other performance insights. And yes, it even works in PostgreSQL.

Benchmarking 120

Benchmarking Metrics C++ Database 120

The Morning Paper

SEPTEMBER 3, 2019

SLOG: serializable, low-latency, geo-replicated transactions Ren et al., That’s where SLOG (Serializable LOw-latency, Geo-replicated transactions) comes in. If every read of a data item is served from the location of the most recent write to that data item, then there is no need to synchronously replicate writes across regions.

Latency 70

Latency Processing Benchmarking Systems 70

John McCalpin

APRIL 25, 2023

With that in mind, I decided to mine some historical data (and run a few new experiments) to see how single-thread/single-core memory bandwidth has evolved over the last 10-15 years. GHz, 1530 GB/s peak BW from 6 HBM stacks), I see single-thread sustained memory bandwidth of 304 GB/s on the ReadOnly benchmark used here. Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Scalegrid

OCTOBER 24, 2019

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. Slave-2 uses an EBS data disk, and you can configure the amount of IOPS required for your cluster.

AWS 183

AWS Latency Performance Benchmarking 183

Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. It becomes more manageable and efficient by isolating logs and data to a dedicated mount. Who can benefit from DLV? Are DLVs effective for your RDS instance?

AWS 95

AWS Benchmarking Performance Traffic 95

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. For example, improving latency by as little as 0.1 latency is the number one reason consumers abandon mobile sites.

Benchmarking 182

Benchmarking Latency Speed Software 182

The Morning Paper

MARCH 10, 2020

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Scalegrid

NOVEMBER 26, 2020

It has high throughput and runs from memory, but also has the ability to persist data on disk. In fact, it is the number one key value store and eighth most popular database in the world. Redis is a great caching solution for highly demanding applications, and there are […].

Cache 130

Cache Azure Benchmarking Performance 130

Speed Curve

FEBRUARY 5, 2024

Looking at the industry benchmarks for US retailers , four well-known sites have backend times that are approaching – or well beyond – that threshold. Pagespeed Benchmarks - US Retail - LCP When you examine a waterfall, it's pretty obvious that TTFB is the long pole in the tent, pushing out render times for the page.

Servers 58

Servers Cache Retail Benchmarking 58

Scalegrid

JULY 29, 2020

So, we pitted the two connection poolers head-to-head, using the standard pgbench tool, to see which one provides better transactions per second throughput through a benchmark test. All of the PostgreSQL benchmark tests were run under the following conditions: Initialized pgbench using a scale factor of 100. Throughput Benchmark.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. Data loading patterns are an essential part of your application as they will determine which parts of your application are directly usable by visitors. But isn’t waiting for the data the point?

Cache 125

Cache Performance Servers Social Media 125

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

JUNE 27, 2022

Real user monitoring (RUM) is a performance monitoring process that collects detailed data about users’ interactions with an application. RUM collects data on each user action within a session, including the time required to complete the action, so IT pros can identify patterns and where to make improvements in experience.

Best Practices 175

Best Practices Monitoring Wireless Traffic 175

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. In early January a related paper was published by Satoshi Matsuoka et. petaflops, which is 0.8%

Architecture 52

Architecture Latency Benchmarking AWS 52

John McCalpin

APRIL 2, 2020

This data is from the 2007 presentation. To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It

Benchmarking 59

Benchmarking Performance Latency Architecture 59

The Netflix TechBlog

NOVEMBER 22, 2019

Technology advancements in content creation and consumption have also increased its data footprint. To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

Technology advancements in content creation and consumption have also increased its data footprint. To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. This covers everything from tech specs and what you expect from the service to security, how you’ll handle data, and how services will be managed. Each private cloud setup has perks and benefits, especially for handling specific tasks.

Strategy 130

Strategy Cloud Government Innovation 130

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Traces collected from various microservices are ingested in a stream processing manner into the data store.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. MySQL (B) 2517529 2610323 389048 5516900 194140 11523.48

Tuning 133

Tuning Cache Servers Benchmarking 133

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. Disk space usage Monitor the disk space usage of MySQL data files, log files, and temporary files.

Performance 103

Performance Monitoring Traffic Database 103

Scalegrid

JANUARY 12, 2024

Key Takeaways A cloud workload encompasses any application or service running on a cloud infrastructure, facilitating tasks ranging from basic functions to advanced data analysis with the help of resources like databases, collaboration tools, and disaster recovery systems. This applies to both virtual machines and container-based deployments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . Before the database is started your data should be in a consistent state on disk. When the database is started a component of the in-memory database instance is the data buffer.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

MARCH 20, 2023

In this case, we have a quite well-defined scenario that can resemble the image below: In this scenario, the proxies must sit inside Pods, balancing the incoming traffic from the Service LoadBalancer connecting with the active data nodes. Let us take a look also the latency: Here the situation starts to be a little bit more complicated.

Games 119

Games Latency Traffic Cache 119

The Morning Paper

NOVEMBER 8, 2020

If you think of this a bit like mapping memory addresses to data in memory, then another parallel comes to mind: the virtual address space. This separation of concerns moves reconfiguration into the VirtualLog control plane, leaving Loglets responsible for the data plane. Delos in production. Limitations and future work.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

MARCH 23, 2023

Nowadays, solid-state drives (SSDs) or non-volatile memory express (NVMe) drives are preferred over traditional hard disk drives (HDDs) for database servers due to their faster read and write speeds, lower latency, and improved reliability. Benchmark before you decide. Transparent huge pages (THP) disabled.

Performance 123

Performance Hardware Tuning Storage 123

Particular Software

OCTOBER 26, 2020

Backed by Cosmos DB, a fully managed, globally distributed, elastically scaled, pay-as-you-go service, your NServiceBus-based systems can benefit from guaranteed single-digit-millisecond latency with 99.999% availability. CosmosClient(new CosmosClient("ConnectionString")).DefaultContainer(

Azure 52

Azure Storage Benchmarking Latency 52

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. It is the shared storage that often causes performance issues for data bases which are otherwise separated across nodes. In such a case we have a Bandwidth heavy workload profile (reporting) sharing with a Latency Sensitive workload (transactional). 100% write.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., on end-to-end latency) and less than 0.15% on throughput. This tracing system is similar to Dapper and Zipkin and records per-microservice latencies and number of outstanding requests. ASPLOS’19. Seer in action.

Big Data 45

Big Data Cloud Performance Hardware 45

Percona

JANUARY 24, 2023

Reduced WAL segment size has further gains in replication and backup because less data need to be transmitted. Individual processes generate WAL records, and latency is very crucial for transactions. What is Full Page Writes? getconf PAGESIZE 4096 PostgreSQL deals with 8k pages as the “atomic unit” for reading and writing.

Database 115

Database Benchmarking Open Source Latency 115

The Morning Paper

AUGUST 29, 2019

There’s a broad set of choices including where you store the data, whether you run your own DBMS nodes or use a service, the kinds of instance types to go for if you do run your own, and so forth. We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems.

Architecture 76

Architecture Cloud Storage Serverless 76