Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 111

Systems Performance Education Technology 111

Brendan Gregg

APRIL 14, 2022

PMC analysis (2017). I hope my last two books, [Systems Performance 2nd Ed] and [BPF Performance Tools] serve Netflix well in my absence and everyone else who reads them. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture. offer letter logo (2014). flame graphs (2014). eBPF tools (2014-2019).

Java 145

Java Cloud Cache AWS 145

All Things Distributed

MARCH 30, 2017

This weekend I am travelling to Australia for the first AWS Summit of 2017. One topic that always gets me excited is how to take computer science research and implement it in production systems. real systems do not fail by stopping in a nice and clean way). At times, it makes research unsuitable for production (e.g.

Systems 93

Systems AWS Design Technology 93

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 200

Innovation Mobile Technology Technology 200

Brendan Gregg

OCTOBER 28, 2017

For my first trip to Paris I gave the closing keynote at [EuroBSDcon 2017] on performance methodologies, using FreeBSD 11.1 In the past I've shared similar methodologies applied to other operating systems, and finished porting them to BSD for this talk. EuroBSDcon 2017]: [link] [thread state analysis]: [link] [tstates.d]: [link]

Systems 52

Systems Performance C++ Operating System 52

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., This is a high level paper describing Google’s production system for federated learning. The FL system contains a number of privacy-enhancing building blocks, but the privacy guarantees of any end-to-end system will always depend on how they are used.

Systems 71

Systems Design Google Servers 71

The Netflix TechBlog

OCTOBER 27, 2023

These orphaned pods represent real pain for our users, even if they are a small percentage of the total pods in the system. 10/16/2017 [ 8374.555629] Call Trace: [ 8374.556147] <TASK> [ 8374.556601] dump_stack_lvl+0x45/0x5b [ 8374.557361] panic+0x103/0x2db [ 8374.558166] ? Where are they going, exactly? Why did they go away?

Hardware 228

Hardware Cloud Google Servers 228

Dynatrace

MARCH 2, 2023

Focusing on the fundamentals Grabner recalled a 2017 tweet from Hightower that outlined how his technology career gathered steam once he started to “focus on the fundamentals.” The whole goal is, we want to reduce the amount that a human needs to give to the system in order to make it do what you want it to do,” he said.

Best Practices 216

Best Practices Internet Internet Cloud 216

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I also built online serving systems and microservices powering Walmart’s e-commerce. At this conference, I also got to know my current team: Consolidated Logging (CL).

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

DECEMBER 14, 2020

The mystery begins Towards the end of 2017, I was on a conference call to discuss an issue with the Netflix application on a new set top box. Figure 2: Visualizing Audio Throughput and Thread Handler Timing The orange line is the rate that data moved from the streaming buffer into the Android audio system, in bytes/millisecond.

Engineering 352

Engineering Code Hardware Open Source 352

Tim Kadlec

JANUARY 4, 2018

It’s not much of a surprise, then, that I read more books in 2017 than I have since I started keeping track back in 2009. I can’t say I don’t occasionally dip in more than I probably should, but there’s a better balance now. There were fewer standouts this year though, at least for non-fiction.

BioTech 45

BioTech Social Media Entertainment Media 45

Brendan Gregg

JULY 4, 2021

I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0

Performance 52

Performance Latency Hardware Storage 52

Dynatrace

MAY 6, 2021

Operating systems support. Future Dynatrace Managed operating systems support changes. The following operating systems will no longer be supported starting 01 September 2021. Linux: Amazon Linux AMI 2017.x. The following operating systems will no longer be supported starting 01 October 2021. x86 (64bit-only).

Operating System 231

Operating System AWS Metrics Storage 231

Dynatrace

DECEMBER 16, 2019

Even small amounts of technical debt compound as new code branches from old, further embedding the shortcomings into the system. Technical Debt—Dilbert Comic Strip on 2017-01-03. The sudden lure of artificial intelligence (AI) and machine learning (ML) systems designed for IT brings new urgency to the topic of intellectual debt.

Artificial Intelligence 149

Artificial Intelligence Traffic Efficiency Innovation 149

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them.

Systems 40

Systems Performance Education Technology 40

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017 and have shared the full story here. ## 1. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel). Ahh, it makes sense now.

Cache 145

Cache Cloud Java Tuning 145

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

JUNE 15, 2023

If your application runs on servers you manage, either on-premises or on a private cloud, you’re responsible for securing the application as well as the operating system, network infrastructure, and physical hardware. What are some key characteristics of securing cloud applications?

Cloud 177

Cloud Open Source Architecture Monitoring 177

SQL Shack

OCTOBER 6, 2020

Introduction SQL Server 2017 & 2019 works on the cross-platform operating system: Windows and Linux. In this 29th article of the SQL Server Always On Availability Groups series, we configure the AG between SQL Server Linux instances. You […].

Servers 52

Servers Availability Operating System Systems 52

ACM Sigarch

APRIL 26, 2018

They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0 The new DGX-2, which achieves 2 petaFLOPS in the system, combines 16 fully interconnected GPUS with 10x the deep learning performance. In 2017, Intel Movidius announces its latest generation VPU, named Myriad X.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 120

Database Design Cloud Storage 120

All Things Distributed

SEPTEMBER 29, 2016

Voice makes access to digital services far more inclusive than traditional screen-based interaction, for example, an aging population may be much more comfortable interacting with voice-based systems than through tablets or keyboards. However, it is still Day One, and a lot of innovation is underway in this world.

Artificial Intelligence 139

Artificial Intelligence Healthcare AWS Government 139

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 77

Open Source Healthcare Social Media Database 77

Brendan Gregg

APRIL 27, 2023

Keeping overhead low can require tradeoffs in other areas: tcpdump(8), for example, will drop packets if the system is overloaded, resulting in incomplete visibility. Long ago I encountered systems which met strict security auditing requirements with the following behavior: If the kernel could not log an event, it would immediately halt !

Open Source 52

Open Source Monitoring Engineering Design 52

SQL Server According to Bob

FEBRUARY 10, 2019

SQL Server 2017 introduced a small change to SQL Server’s default worker thread calculation, accounting for smaller environments. The additional worker level is increased by 32 workers per CPU when the system presents 64 or more CPUs. When running on smaller environments SQL Server reduces the worker target.

Servers 40

Servers Design Systems 40

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). What is MariaDB? What is MySQL?

Open Source 52

Open Source Servers Storage Scalability 52

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. Xen AWS 2017 In 2015, AWS launched c4, which used hardware virtualization for EBS volumes. 0% performance overhead.

Virtualization 111

Virtualization AWS Hardware Storage 111

Adrian Cockcroft

JANUARY 29, 2023

There is no way to model how much more traffic you can send to that system before it exceeds it’s SLA. This is unfortunate, because we’d really like to be able to build systems that have an SLA that we can share with the consumers of our interfaces, and be able to measure how well we are doing.

Lambda 98

Lambda Latency Cache Traffic 98

All Things Distributed

SEPTEMBER 29, 2016

The new region in France will be ready for customers to use in 2017. Within the thousands of businesses using AWS in France, we count enterprises such as Schneider Electric, Lafarge and Dassault Systemes as customers as well as CAC40, multinational bank, Societe Generale Group. Ces dix dernières années, AWS s’est fortement développé.

AWS 166

AWS IoT Internet Internet 166

Particular Software

MAY 30, 2017

During Build 2017, Microsoft released.NET Core 2.0 is currently expected to be released in Q3 2017 , and we expect to release NServiceBus 7 shortly after that has happened. For those of you who do not have plans to move your systems to.NET Core, we are not abandoning you. Update : NServiceBus 7 for.NET Core has been released.

Transportation 49

Transportation Systems Performance 49

SQL Server According to Bob

APRIL 24, 2018

I also started my career developing on UNIX systems with C++ and databases like Ingres. As I moved to other jobs, the PC was becoming very popular as was the Windows Operating System. Last October we released SQL Server 2017 including support for Linux and Docker Containers. docker pull microsoft/mssql-server-linux:2017-latest.

Servers 40

Servers Internet Internet Open Source 40

Tech News Gather

NOVEMBER 15, 2022

Apple’s official move into augmented reality was announced at WWDC in 2017. In addition, the system uses the user’s gaze to optimize the visual quality and resolution precisely where it matters most: where the user is looking (exactly how the human eye does). Augmented reality (AR) is already making a big splash on mobile.

Development 52

Development Virtualization Government Media 52

All Things Distributed

SEPTEMBER 25, 2017

2017 continues a busy year for AWS in the Middle East. The BIPA has moved their Learning Management System to AWS, reducing costs by over 90%. They are also migrating 700 government websites, with more than 50 TB of data, onto AWS, helping them to meet their goal of decommissioning their hosting platform by the end of 2017.

Cloud 154

Cloud Education Energy Government 154