ACM Sigarch

MARCH 25, 2019

How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? The M/M/1 queue will show us a required trade-off among (a) allowing unscheduled task arrivals, (b) minimizing latency, and (c) maximizing throughput.

Systems 53

Systems Latency Performance C++ 53

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 avg-cpu: %user %nice %system %iowait %steal %idle 14.86 avg-cpu: %user %nice %system %iowait %steal %idle 14.95 100.00 ^C. Tracing block device I/O. . ## 5.

Cache 105

Cache C++ AWS Latency 105

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF (extended Berkeley Packet Filter) is in the Linux kernel and is the new hotness in systems engineering. Here's key differences as of August 2018: Type DTrace bpftrace. Attaching 2 probes. ^C

C++ 40

C++ Virtualization Programming Latency 40

Speed Curve

FEBRUARY 5, 2024

Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Latency – How much time does it take to deliver a packet from A to B. In practice, it looks something like this: server-timing: processing_time; dur=123.4; desc="Time to process request at origin" NOTE: This is not a new API.

Servers 57

Servers Cache Retail Benchmarking 57

All Things Distributed

NOVEMBER 13, 2018

ENEL is using AWS to transform its entire business, closing all of their data centers by 2018, migrating workloads from over 6,000 on-premises servers onto AWS in nine months, and using AWS IoT services to better manage and understand energy consumption. ENEL is one of the leading energy operators in the world. million unique visits.

AWS 167

AWS Energy Automotive Traffic 167

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. system(".") Block I/O latency as a histogram. 6 * 7 * Copyright 2018 Netflix, Inc.

Latency 68

Latency C++ Cache Programming 68

All Things Distributed

JUNE 20, 2017

The new AWS Asia Pacific (Hong Kong) Region will have three Availability Zones and be ready for customers for use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. Over the past decade, we have seen tremendous growth at AWS.

AWS 149

AWS Logistics Cloud Social Media 149

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. Plus another AWS GovCloud (US) Region in the United States is coming online by the end of 2018. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 154

Cloud Education Energy Government 154

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. Organizations are taking advantage of having managed backups, lots of built-in security features, an uptime SLA of 99.99%, and an always up-to-date environment where they are no longer responsible for patching SQL Server or the operating system.

Azure 63

Azure Performance Storage Latency 63

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 avg-cpu: %user %nice %system %iowait %steal %idle 14.86 avg-cpu: %user %nice %system %iowait %steal %idle 14.95 41 33680 53408 0 78 100.0%

Cache 40

Cache C++ AWS Systems 40

HammerDB

MAY 5, 2019

However in the Skylake microarchitecture (you can see a list of CPUs here ) the PAUSE instruction changed and in the documentation it says “the latency of the PAUSE instruction in prior generation microarchitectures is about 10 cycles, whereas in Skylake microarchitecture it has been extended to as many as 140 cycles.”

Testing 48

Testing Tuning Latency Storage 48

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. A good example will be something like Pachyderm [8] [9] - a relatively young project which implements a distributed Pachyderm File System (PFS) and a data-aware scheduler Pachyderm Pipeline System (PPS) on top of Kubernetes.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. By integrating with studio content systems, we enabled the pipeline to leverage rich metadata from the creative side and create more engaging member experiences like interactive storytelling.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The first generation of this system went live with the streaming launch in 2007. Delivery?—?A

Serverless 228

Serverless Media Latency Social Media 228

KeyCDN

SEPTEMBER 12, 2019

This can be a problem in a lot of content management systems such as WordPress or Magento, because theme developers tend to scale images down in responsive themes using CSS. The main reason is because it decreases the latency to the user where they are located by serving your images from a POP physically closest to them.

Social Media 106

Social Media Media Google Website 106

Percona

AUGUST 10, 2018

In fact, you should not set it to OFF in a production system unless you are 100% sure about what you are doing and its implications. sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 1 second = 1000 milliseconds).

Tuning 44

Tuning Cache Database Storage 44

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” tef : You can use a message broker to glue systems together, but never use one to cut systems apart. CompSciFact : 'Fancy algorithms are slow when n is small, and n is usually small.' -- Rob Pike. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

DECEMBER 21, 2018

odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” Me : Nothing special. 1) Enterprise data centres will continue to close.

Internet 137

Internet Internet Scalability Serverless 137

The Netflix TechBlog

FEBRUARY 20, 2019

Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? to the broader community. Vector is open source and in use by multiple companies.

Performance 211

Performance Latency Open Source Metrics 211

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. To achieve this, organizations are utilizing distributed messaging system such as Apache Kafka.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Alex Russell

FEBRUARY 3, 2023

They understood that most websites lack tight latency budgeting, dedicated performance teams, hawkish management reviews, ship gates to prevent regressions, and end-to-end measurements of critical user journeys. The key thing about the tools that work more often than not is that they start with simple output.

Social Media 119

Social Media Website Technology Technology 119

Smashing Magazine

OCTOBER 31, 2023

The truth is that the two tools were fairly distinct until PSI was updated in 2018 to use Lighthouse reporting. If throttling is applied at the operating system level , then the metrics match what a real user with those network conditions would experience. The accuracy of observed data depends on how the test environment is set up.

Speed 97

Speed Google Website Metrics 97

All Things Distributed

APRIL 4, 2017

The new AWS EU (Stockholm) Region will have three Availability Zones and will be ready for customers to use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. Over the past decade, we have seen tremendous growth at AWS.

AWS 117

AWS Airlines Latency Games 117

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

High Scalability

SEPTEMBER 14, 2018

editingemily : "In peacetime, a ticketing system is great. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy. SCM slots between DRAM and flash in terms of latency, cost, and density. noahsussman : Complex systems are intrinsically hazardous systems.

Internet 30

Internet Internet Scalability Education 30

HammerDB

OCTOBER 8, 2018

This post gives a HOWTO guide on system configuration for achieving top levels of performance with the HammerDB PostgreSQL TPC-C test. Firstly for system choice a 2 socket system is optimal for PostgreSQL OLTP performance at the time of writing. maximum transition latency: Cannot determine or is not supported.

Best Practices 40

Best Practices Scalability Performance Hardware 40

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 197

Database Traffic Transportation Open Source 197

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. Similarly for this guide MySQL can be swapped for a mySQL based databases such as MariaDB.

Best Practices 40

Best Practices Scalability Performance C++ 40

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. We want to support these systems as a source so that they can provide their data for further consumption. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212

Alex Russell

JANUARY 30, 2024

If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch. Since 2010, volumes have been on a slow downward glide path , shrinking from ~350MM per year in a decade ago to ~260MM in 2018. was a system properly localised?

Performance 90

Performance Network Mobile Speed 90

HammerDB

NOVEMBER 5, 2018

Additionally for the log disk component it is latency for an individual write that is crucial rather than the total I/O bandwidth. SQL> alter system flush buffer_cache; System altered. These parameters can be set as follows: SQL> alter system set commit_logging='BATCH' scope=spfile; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Pointer Lock. Media Recorder.

Media 145

Media Games Education Engineering 145

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. We help Supercell to quickly develop, deploy, and scale their games to cope with varying numbers of gamers accessing the system throughout the course of the day.

AWS 124

AWS Cloud Games Serverless 124

Percona

JULY 1, 2023

This post was originally published in July 2018 and was updated in July 2023. It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. What are the differences between Aurora and RDS?

AWS 52

AWS Database Serverless Storage 52