Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. Try changing the kernel clocksource.

Speed 126

Speed Java AWS Virtualization 126

The Morning Paper

NOVEMBER 8, 2020

Back in 2017 the engineering team at Facebook had a problem. While ultimately this new system should be able to take advantage of the latest advances in consensus for improved performance, that’s not realistic given a 6-9 month in-production target. replacing Paxos with Raft), or they could be shims over external storage systems.

Virtualization 126

Virtualization Latency Storage Systems 126

All Things Distributed

SEPTEMBER 29, 2016

Based in the Paris area, the region will provide even lower latency and will allow users who want to store their content in datacenters in France to easily do so. The new region in France will be ready for customers to use in 2017. Cette nouvelle région sera disponible pour les clients dès 2017.

AWS 166

AWS IoT Internet Internet 166

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. The Moto G4 , for example. Here begins our 2021 adventure. Hard Reset.

Performance 124

Performance Network Cache Metrics 124

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

All Things Distributed

NOVEMBER 13, 2018

Since then, AWS has added another PoP in Palermo in 2017. This includes system integration (SI) and independent software vendor (ISV) partners who have built cloud practices and innovative technology solutions using AWS. In 2012, Amazon opened its first Italian office and its first Italian point of presence (PoP) based in Milan.

AWS 167

AWS Energy Automotive Traffic 167

All Things Distributed

SEPTEMBER 25, 2017

This Region will consist of three Availability Zones at launch, and it will provide even lower latency to users across the Middle East. 2017 continues a busy year for AWS in the Middle East. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 154

Cloud Education Energy Government 154

Alex Russell

JANUARY 30, 2024

If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch. So what did $650, give or take, buy in late 2017 or early 2018? was a system properly localised? but which blessedly sports 8GB of RAM. Equally advertised?),

Performance 90

Performance Network Mobile Speed 90

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. Try changing the kernel clocksource.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 Since then, Microsoft has changed the naming of this series to Lsv2. Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

SQL Performance

SEPTEMBER 17, 2019

For years SSRS was bundled with the installation of SQL Server, which helped add to some of the confusion around licensing and support for the product, so beginning with SSRS 2017, the installation package for Reporting Services is a separate download. Unlike the system database tempdb, ReportServerTempDB is not recreated at startup.

Tuning 67

Tuning Servers Database Best Practices 67

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? A message-oriented implementation requires an efficient messaging backbone that facilitates the exchange of data in a reliable and secure way with the lowest latency possible. Clean and reprocess it? At least once?

Architecture 80

Architecture Scalability Google Operating System 80

Alex Russell

OCTOBER 22, 2017

— Alex Russell (@slightlylate) October 4, 2017. Tools and CI systems help them monitor progress & prevent regressions. Some systems show median RTTs near ~100ms for 3G users. It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). First Load.

Performance 68

Performance Benchmarking Network Mobile 68

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing). cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Media Session API. Offscreen Canvas.

Media 145

Media Games Education Engineering 145

Alex Russell

FEBRUARY 3, 2023

They understood that most websites lack tight latency budgeting, dedicated performance teams, hawkish management reviews, ship gates to prevent regressions, and end-to-end measurements of critical user journeys. The key thing about the tools that work more often than not is that they start with simple output.

Social Media 119

Social Media Website Technology Technology 119

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Per se, GraphQL is a query language for your API, and a server-side runtime for executing queries by using a type system you define for your data. In exchange, your team gains maintainability and developer efficiency, of course.

Performance 103

Performance Cache Metrics Network 103

All Things Distributed

OCTOBER 25, 2018

The new AWS Africa (Cape Town) Region will have three Availability Zones and provide lower latency to end users across Sub-Saharan Africa. In 2017, we brought the Amazon Global Network to Africa, through AWS Direct Connect. With the AWS based system, Exatype can do this at a fraction of the cost.

AWS 167

AWS Cloud Education Programming 167

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more.

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 130

Internet Internet AWS Performance 130