Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 111

Systems Performance Education Technology 111

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system contains a number of privacy-enhancing building blocks, but the privacy guarantees of any end-to-end system will always depend on how they are used.

Systems 71

Systems Design Google Servers 71

Brendan Gregg

OCTOBER 28, 2017

For my first trip to Paris I gave the closing keynote at [EuroBSDcon 2017] on performance methodologies, using FreeBSD 11.1 In the past I've shared similar methodologies applied to other operating systems, and finished porting them to BSD for this talk. EuroBSDcon 2017]: [link] [thread state analysis]: [link] [tstates.d]: [link]

Systems 52

Systems Performance C++ Operating System 52

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

JUNE 15, 2023

If your application runs on servers you manage, either on-premises or on a private cloud, you’re responsible for securing the application as well as the operating system, network infrastructure, and physical hardware. What are some key characteristics of securing cloud applications? These alerts tend to slow down development.

Cloud 179

Cloud Open Source Architecture Monitoring 179

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. Comparison Overview.

Open Source 244

Open Source Tuning C++ Database 244

Dynatrace

MAY 6, 2021

Operating systems support. Future Dynatrace Managed operating systems support changes. The following operating systems will no longer be supported starting 01 September 2021. Linux: Amazon Linux AMI 2017.x. The following operating systems will no longer be supported starting 01 October 2021. x86 (64bit-only).

Operating System 232

Operating System AWS Metrics Storage 232

The Netflix TechBlog

MAY 1, 2019

In late 2017, we received some critical feedback from the brothers on the Stranger Things 2 audio mix: in some scenes, there was a reduced sense of where sounds are located in the 5.1-channel We want your experience to be brilliant even if you aren’t listening with a state-of-the-art home theater system. We began streaming 5.1

Engineering 274

Engineering Network Media Entertainment 274

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 90

Performance Network Mobile Speed 90

Alex Russell

MARCH 6, 2021

TL;DR: A lot has changed since 2017 when we last estimated a global baseline resource per-page resource budget of 130-170KiB. To update our global baseline from 2017, we want to update our priors on a few dimensions: The evolved device landscape. Modern network performance and availability. The Moto G4 , for example. Hard Reset.

Performance 124

Performance Network Cache Metrics 124

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

ACM Sigarch

APRIL 26, 2018

They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0 The new DGX-2, which achieves 2 petaFLOPS in the system, combines 16 fully interconnected GPUS with 10x the deep learning performance. TPU: Tensor Processing Unit (TPU) is Google’s specialized hardware for neural network.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 120

Database Design Cloud Storage 120

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

IO River

NOVEMBER 2, 2023

However, consumers often prioritize availability in many systems. Furthermore, there are many recognized standards to measure the availability of a service or system, and the most common one is to measure it as a percentage."Five minutes of downtime per year, which means the system is almost always operational.

Availability 52

Availability Social Media Traffic Games 52

Tim Kadlec

JANUARY 4, 2018

It’s not much of a surprise, then, that I read more books in 2017 than I have since I started keeping track back in 2009. His point, very Neil Postman-esque, is particularly true in today’s world of entertainment-driven news and fast-moving social networks that I’m increasingly convinced that, by default, only amplify existing biases.

BioTech 45

BioTech Social Media Entertainment Media 45

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 40

Systems Performance Education Technology 40

SQL Server According to Bob

MAY 19, 2019

The reduction effort started when we shipped SQL Server 2017 ( [link].) Partitioning allows SQL Server to scale to the largest systems with record-setting performance. When promoted to a super-latch on a 64 CPU system the memory requirement becomes 32 + (32 *64) = 2080 bytes. Networking Pump Threads. Async Pump Threads.

IoT 61

IoT Servers Development Cache 61

Dynatrace

OCTOBER 17, 2019

Everything as Code can be described as a methodology or practice which consists of extending the idea of how applications are treated as code and applying these concepts to all other IT components like operating systems, network configurations, and pipelines. We went from managing five EC2 instances in 2011 to around 1,000 in 2017.

Code 109

Code Infrastructure DevOps Serverless 109

Smashing Magazine

JANUARY 21, 2021

After the latest redesign in late 2017, it was Ilya Pukhalski on the JavaScript side of things (part-time), Michael Riethmueller on the CSS side of things (a few hours a week), and yours truly, playing mind games with critical CSS and trying to juggle a few too many things. Moving From Automated Critical CSS Back To Manual Critical CSS.

Performance 145

Performance Cache Mobile Network 145

All Things Distributed

NOVEMBER 13, 2018

Since then, AWS has added another PoP in Palermo in 2017. This helps support over 50 million searches every month on its networks across Italy. AWS also has a vibrant partner ecosystem in Italy as part of the AWS Partner Network (APN).

AWS 167

AWS Energy Automotive Traffic 167

All Things Distributed

SEPTEMBER 25, 2017

I'm also excited to announce today that we are launching an AWS Edge Network Location in the United Arab Emirates (UAE) in the first quarter of 2018. 2017 continues a busy year for AWS in the Middle East. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%.

Cloud 154

Cloud Education Energy Government 154

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2017: MongoDB goes public, trading as MDB. They came up with a horizontally scalable NoSQL database.

Open Source 79

Open Source Programming Database Servers 79

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Without enough infrastructure (physical or virtualized servers, networking, etc.), there cannot be high availability.

Availability 81

Availability Open Source Architecture Database 81

Adrian Cockcroft

JANUARY 29, 2023

There is no way to model how much more traffic you can send to that system before it exceeds it’s SLA. This is unfortunate, because we’d really like to be able to build systems that have an SLA that we can share with the consumers of our interfaces, and be able to measure how well we are doing.

Lambda 98

Lambda Latency Cache C++ 98

All Things Distributed

SEPTEMBER 29, 2016

The new region in France will be ready for customers to use in 2017. Our CDN and DNS network now has 18 points of presence across Europe, we have added a third AZ in Ireland, a second infrastructure region in Frankfurt and a third region in the UK (due in coming months). Cette nouvelle région sera disponible pour les clients dès 2017.

AWS 166

AWS IoT Internet Internet 166

Tasktop

JANUARY 27, 2021

Value Stream Networks. As detailed in Mik’s bestselling book Project to Product , in 2017 Mik was invited by René to BMW’s state-of-the-art Leipzig plant in Germany. Understanding how to create and connect a Value Stream Network, we must first understand the ground truth of enterprise IT tool networks.

Code 52

Code Automotive Government Network 52

Percona

AUGUST 15, 2023

This blog was originally published in February 2017 and was updated in August 2023. Network Connectivity: Establish a reliable network connection between the primary and replica servers. MySQL replication provides high availability, load balancing, and data redundancy, enhancing system reliability.

Servers 52

Servers Database Availability Traffic 52

SQL Server According to Bob

FEBRUARY 10, 2019

SQL Server 2017 CU10 does not show behavior. · SQL Server 2017 CU12 exhibits the behavior. Several event types are included in the health session, some of which include predicates to remove noise from the system health session. Network Trace. Looking at network traces helps build our understanding of the problem.

Servers 40

Servers Network Database Systems 40

Sutter's Mill

FEBRUARY 13, 2017

Additionally, low latency increasingly matters at all scales: In user interfaces, low latency means responsive apps and productive users without the dreaded “wait…” donut; in financial trading, low latency regularly saves large amounts of cash; in embedded real-time systems, low latency is crucial to meeting deadlines and can even save lives.

Latency 51

Latency C++ Hardware Performance 51

Tasktop

APRIL 2, 2020

from Project to Product (based on Perez 2017 ) . from Project to Product (based on Perez 2017 ) showing the technological revolutions, with added overlay to show the events that initiated each of the Turning Points . Perez’s models break each of the five technological revolutions into three distinct phases.

Government 109

Government Innovation Strategy Technology 109

O'Reilly

APRIL 23, 2024

Perhaps a more direct way to say this in the context of economic value creation is that companies such as Amazon and Google and Facebook had developed a set of remarkable advances in networked and data-enabled market coordination. But over time, something went very wrong.

Social Media 108

Social Media Google Internet Internet 108

SQL Server According to Bob

FEBRUARY 22, 2018

Prior to SQL Server 2017 CU4 for Linux (Linux only) the generation of a sequential UUID may not function as expected. On Windows the system stores this in the registry and during startup increments the value. Question: What if I change the time of the system clock? Answer: The system time does not impact the uuid generation.

Servers 40

Servers Software Engineering Database Network 40

Alex Russell

OCTOBER 22, 2017

We constrain ourselves to a real-world baseline device + network configuration to measure progress. — Alex Russell (@slightlylate) October 4, 2017. Budgets are scaled to a benchmark network & device. Tools and CI systems help them monitor progress & prevent regressions. The median user is on a slow network.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MARCH 31, 2022

De-duplication can prevent multiple copies on disk, but we're out of luck on reducing network costs. Shared caches must make sense within this value system. Multiple factors contribute, including the pain of updates on slow networks and devices, systems that are out of disk space, and harmful interactions with AV software.

Cache 82

Cache Government Traffic Network 82