CSS Wizardry

MAY 31, 2019

This is exactly what Rawgit did in October 2018, yet (at the time of writing) a crude GitHub code search still yielded over a million references to the now-sunset service, and almost 20,000 live sites are still linking to it! On a slower, higher-latency connection, the story is much, mush worse. Risk: Service Shutdowns. to just 3.6s.

Cache 274

Cache Latency Infrastructure Website 274

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". BrentToderian : What city went from 14% of all trips by bike in 2001, to 22% by 2012, then leaped to 30% in 3 years by 2015, & 35% by 2018? We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Speed Curve

FEBRUARY 5, 2024

Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Latency – How much time does it take to deliver a packet from A to B. In practice, it looks something like this: server-timing: processing_time; dur=123.4; desc="Time to process request at origin" NOTE: This is not a new API.

Servers 58

Servers Cache Retail Benchmarking 58

Brendan Gregg

OCTOBER 7, 2018

Screenshot: tracing read latency for PID 181: # bpftrace -e 'kprobe:vfs_read /pid == 30153/ { @start[tid] = nsecs; } kretprobe:vfs_read /@start[tid]/ { @ns = hist(nsecs - @start[tid]); delete(@start[tid]); }'. Here's key differences as of August 2018: Type DTrace bpftrace. It's shaping up to be a DTrace version 2.0: I wrote seeksize.d

C++ 40

C++ Virtualization Programming Latency 40

John McCalpin

JANUARY 9, 2019

This week I updated three of those posts — two really old ones (primarily of interest to computer architecture historians), and one from 2018: July 2012: Local and Remote Memory Latency on AMD Processors in 2-socket and 4-socket servers. December 2013: Notes on Memory Bandwidth on the Xeon Phi (Knights Corner) Coprocessor.

Latency 40

Latency Architecture Servers Performance 40

All Things Distributed

JUNE 20, 2017

The new AWS Asia Pacific (Hong Kong) Region will have three Availability Zones and be ready for customers for use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. Over the past decade, we have seen tremendous growth at AWS.

AWS 149

AWS Logistics Cloud Social Media 149

All Things Distributed

NOVEMBER 13, 2018

ENEL is using AWS to transform its entire business, closing all of their data centers by 2018, migrating workloads from over 6,000 on-premises servers onto AWS in nine months, and using AWS IoT services to better manage and understand energy consumption. ENEL is one of the leading energy operators in the world. million unique visits.

AWS 167

AWS Energy Automotive Traffic 167

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. Block I/O latency as a histogram. 6 * 7 * Copyright 2018 Netflix, Inc. 1 /* 2 * biolatency.bt

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 avg-cpu: %user %nice %system %iowait %steal %idle 14.81

Cache 105

Cache C++ AWS Latency 105

ACM Sigarch

MARCH 18, 2019

How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? These models are useful for insight regarding the basic computer system performance metrics of latency and throughput (bandwidth). Little’s Law.

Systems 60

Systems Latency Performance Analytics 60

ACM Sigarch

MARCH 25, 2019

How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? The M/M/1 queue will show us a required trade-off among (a) allowing unscheduled task arrivals, (b) minimizing latency, and (c) maximizing throughput.

Systems 53

Systems Latency Performance C++ 53

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. Plus another AWS GovCloud (US) Region in the United States is coming online by the end of 2018. This news marks the 22nd AWS Region we have announced globally.

Cloud 154

Cloud Education Government Energy 154

KeyCDN

OCTOBER 24, 2018

Although both countries are relatively close to one another, they are separated by a distance of approximately 500km, which adds up in terms of latency. As of August 2018, Helsinki alone had a population of almost 650,000 people. As for Finland, it covers an area of over 338,000 square kilometers and has a population of over 5.5

Internet 48

Internet Internet Speed Network 48

SQL Performance

FEBRUARY 26, 2020

Azure SQL Database Managed Instance became generally available in late 2018. The General Purpose tier is designed for applications with typical performance and I/O latency requirements and provides built-in HA. The Business Critical tier is designed for applications that require low I/O latency and higher HA requirements.

Azure 63

Azure Performance Storage Latency 63

HammerDB

MAY 5, 2019

However in the Skylake microarchitecture (you can see a list of CPUs here ) the PAUSE instruction changed and in the documentation it says “the latency of the PAUSE instruction in prior generation microarchitectures is about 10 cycles, whereas in Skylake microarchitecture it has been extended to as many as 140 cycles.”

Testing 48

Testing Tuning Latency Storage 48

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25 avg-cpu: %user %nice %system %iowait %steal %idle 14.81

Cache 40

Cache C++ AWS Systems 40

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. direct access to raw block storage [18] without the abstraction of a filesystem for workloads that require consistent I/O performance and low latency. Kubernetes has emerged as go to container orchestration platform for data engineering teams.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Serverless 228

Serverless Media Latency Social Media 228

High Scalability

JULY 20, 2018

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds.

Internet 121

Internet Internet Scalability Automotive 121

Percona

AUGUST 10, 2018

sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 1 second = 1000 milliseconds).

Tuning 45

Tuning Cache Database Storage 45

Dean Hume

APRIL 24, 2018

Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. With this in mind, here are some stats for my site for the month of March 2018: 30,000 users visited this site. CPU Utilization and Power Consumption (Source: Blackburn 2008).

Energy 40

Energy Cache Traffic Website 40

High Scalability

DECEMBER 21, 2018

Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” Whether it’s database or message queues it’s a really weird combo of licenses and features for hostage. Because nobody knows how to make money. Support contracts aren’t enough.

Internet 137

Internet Internet Scalability Serverless 137

Dean Hume

APRIL 24, 2018

Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. With this in mind, here are some stats for my site for the month of March 2018: 30,000 users visited this site. CPU Utilization and Power Consumption (Source: Blackburn 2008).

Energy 40

Energy Cache Traffic Website 40

Dean Hume

APRIL 24, 2018

Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. With this in mind, here are some stats for my site for the month of March 2018: 30,000 users visited this site. CPU Utilization and Power Consumption (Source: Blackburn 2008).

Energy 40

Energy Cache Traffic Analytics 40

KeyCDN

SEPTEMBER 12, 2019

The main reason is because it decreases the latency to the user where they are located by serving your images from a POP physically closest to them. KeyCDN Launches POP in Helsinki [link] #webperf — KeyCDN (@KeyCDN) October 25, 2018 There are different meta name properties per different Twitter card type.

Social Media 106

Social Media Media Google Website 106

The Netflix TechBlog

FEBRUARY 20, 2019

Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? to the broader community. Vector is open source and in use by multiple companies.

Performance 211

Performance Latency Open Source Metrics 211

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. With the arrival of new cloud-native tools and platform, ETL is becoming obsolete. More details on this approach.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Smashing Magazine

OCTOBER 31, 2023

The truth is that the two tools were fairly distinct until PSI was updated in 2018 to use Lighthouse reporting. INP is a measure of the latency for all interactions on a given page, where the highest latency — or close to it — informs the final score. It’s right there in the name!

Speed 97

Speed Google Website Metrics 97

All Things Distributed

APRIL 4, 2017

The new AWS EU (Stockholm) Region will have three Availability Zones and will be ready for customers to use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. Over the past decade, we have seen tremendous growth at AWS.

AWS 117

AWS Airlines Latency Games 117

High Scalability

SEPTEMBER 14, 2018

SCM slots between DRAM and flash in terms of latency, cost, and density. dr_c0d3 : 2000: Write 100s of lines of XML to "declaratively" configure your servlets and EJBs 2018: Write 100s of lines of YAML to "declaratively" configure your microservices At least XML had schemas. sethearley : 7 areas of opportunity for #AI in teaching.

Internet 30

Internet Internet Scalability Education 30

Alex Russell

FEBRUARY 3, 2023

They understood that most websites lack tight latency budgeting, dedicated performance teams, hawkish management reviews, ship gates to prevent regressions, and end-to-end measurements of critical user journeys. This raises a follow-on question: what's an interaction?

Social Media 119

Social Media Website Technology Technology 119

KeyCDN

MARCH 10, 2021

The image below shows a significant drop in latency once we've launched the new point of presence in Israel. In fact, latency has been reduced by almost 50%! With a total of 5 POPs in Oceania, this continent benefits from lower latency with every POP added. With a population of 2.5

Latency 110

Latency Internet Internet Tuning 110

CSS - Tricks

APRIL 1, 2021

Google’s industry benchmarks from 2018 also provide a striking breakdown of how each second of loading affects bounce rates. Source: Google /SOASTA Research, 2018. I’m going to update my referenced URL to the new site to help decrease latency that adds drag to the initial page load. Improvement #2: The Critical Render Path.

Cache 92

Cache Social Media Media Website 92

The Netflix TechBlog

MARCH 13, 2020

As mentioned in our earlier blog post , Intel and Netflix have been collaborating on the SVT-AV1 encoder and decoder framework since August 2018. The teams have been working closely on SVT-AV1 development, discussing architectural decisions, implementing new tools, and improving compression efficiency.

Open Source 154

Open Source Efficiency C++ Speed 154