Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

Dynatrace

DECEMBER 22, 2021

Observability gives developers and system operators real-time awareness of a highly distributed system’s current state based on the data it generates. Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage. What is observability?

Artificial Intelligence 183

Artificial Intelligence Metrics Architecture DevOps 183

Percona

JULY 17, 2023

Developers and DBAs like MongoDB’s ease-of-use. DBAs and developers appreciate its combination of flexibility, scalability, and performance. DBAs and developers appreciate its combination of flexibility, scalability, and performance. It ranks No. 5 among all database management systems and No.

Open Source 74

Open Source Database Scalability Software 74

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. It’s a cross-platform document-oriented database that uses JSON-like documents with schema, and is leveraged broadly across startup apps up to enterprise-level businesses developing modern apps. DigitalOcean Advantages for MongoDB.

Azure 187

Azure AWS Latency Database 187

Percona

NOVEMBER 3, 2023

xlarge 4vCPU 8GB-RAM Storage: EBS volume (root) 80GB gp2 (IOPS 240/3000) As well, high availability will be integrated, guaranteeing cluster viability in the case that one worker node goes down. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 102

Database Benchmarking Latency C++ 102

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. The inter-layer communication is based on our internally developed and maintained Timestone queuing system. We call this system Cosmos. The workflow is initiated.

Media 171

Media Innovation Metrics Latency 171

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Enter graph databases.

Database 134

Database Logistics Availability Social Media 134

High Scalability

DECEMBER 21, 2018

kellabyte : “Open source” infrastructure companies are a giant s**t show right now. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms. Don’t waste your developers’ time trying to shave off nickels and dimes from your bill.

Internet 137

Internet Internet Scalability Serverless 137

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

JANUARY 24, 2023

Individual processes generate WAL records, and latency is very crucial for transactions. Configured checkpoint frequency, the chance of checkpoints triggered by WAL generation, storage performance, acceptable CPU overhead, type of CPU architecture, and many other factors. The actual benefit of compression depends on many factors.

Database 115

Database Benchmarking Open Source Latency 115

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. Developers love the blazing fast performance and in-memory capabilities provided by Redis, making it among the most popular NoSQL key-value stores.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

JULY 1, 2023

Download our eBook, “ Enterprise Guide to Cloud Databases ” to help you make more informed decisions and avoid costly mistakes as you develop and execute your cloud strategy. Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

MARCH 10, 2020

Therefore, using the benchmarking results of YCSB as guidance for production might cause some misleading results… To address this issue, we propose a key-range based modelling and develop a benchmark that can better emulate the workloads of real-world key-value stores. It matters because RocksDB reads from storage in data blocks (e.g.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. So to test I took a system with Skylake CPUs and all storage on a P4800X SSD. In the recent MySQL 8.0.16

Testing 48

Testing Tuning Latency Storage 48

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Abhishek Tiwari

DECEMBER 27, 2017

faster development and deployment cycles. faster access to external storage and data locality (I/O, bandwidth). The good news is all of these challenges including performance can be tackled and in several cases, there are new developments to overcome them. Storage provisioning. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Morning Paper

SEPTEMBER 5, 2019

For response times (latencies) reporting a simple metric such as ‘average’ is next to useless. Instead we want to understand what’s happening at different latency percentiles (e.g For reasons we’ll see shortly though, none of those were good enough for Datadog, so they developed their own sketching data structure, DDSketch.

Latency 52

Latency Metrics Open Source Java 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Abhishek Tiwari

NOVEMBER 3, 2018

Unfortunately, due to the lack of a good developer experience (DX) total cost of ownership of a traditional CMS and implementation failure rate remains all-time high. Cost is one of the key reasons why most government organisations, mid to large sized business, and publisher prefer open source CMS options such as WordPress and Drupal.

Systems 63

Systems Cache Website Network 63

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. In recent times, in order to gain valuable insights or to develop the data-driven products companies such as Netflix, Spotify, Uber, AirBnB have built internal data pipelines.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. In the MySQL open source ecosystem, we have only two consolidated ways to perform sharding — Vitess and ProxySQL.

Traffic 121

Traffic Scalability Database Servers 121

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. The Compatibility Tax.

Media 145

Media Games Education Engineering 145

The Morning Paper

MAY 28, 2019

The resulting system can integrate seamlessly into a scikit-learn based development process, and dramatically reduces the total energy usage required for classification with very low latency. The Race Trees accelerator is fully integrated into a sci-kit learn based development flow. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. For systems that are latency sensitive, creating two independent ways to succeed is an important technique for greatly reducing the 99th percentile latency.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. For systems that are latency sensitive, creating two independent ways to succeed is an important technique for greatly reducing the 99th percentile latency.

Latency 53

Latency Engineering Systems Hardware 53

Alex Russell

JULY 14, 2021

Developers also suffer higher costs and reduced opportunities to escape Google, Facebook, and Apple's walled gardens. Web engineers frequently refer to browsers as "User Agents", a nod to their unique role as interpreters of developer intent that give users the final say over how the web is experienced. How can that be?

Google 121

Google Mobile Engineering Internet 121

Smashing Magazine

JANUARY 11, 2021

In many organizations, front-end developers know exactly what common underlying problems are and what strategies should be used to fix them. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Establish a performance culture. Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

In many organizations, front-end developers know exactly what common underlying problems are and what loading patterns should be used to fix them. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Establish a performance culture. Large preview ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

In many organizations, front-end developers know exactly what common underlying problems are and what loading patterns should be used to fix them. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Establish a performance culture. Setting Realistic Goals.

Performance 104

Performance Cache Network Metrics 104