Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Virtual Memory. Not a lot has changed with these tunables since my [2014] talk. I shouldn't let this go to my head, as there were 42,000 attendees at re:Invent looking for something to see!)

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

JULY 4, 2021

BBR: Congestion-Based Congestion Control,” [link] 2016 - [Gregg 16] Brendan Gregg, “Unikernel Profiling: Flame Graphs from dom0,” [link] Jan 2016 - [Gregg 16b] Brendan Gregg, “Linux 4.X Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. It's an exciting development in cloud computing: hardware virtualization is now fast. Virtualized in Hardware**: Hardware support for virtualization, and near bare-metal speeds.

Virtualization 111

Virtualization AWS Hardware Storage 111

O'Reilly

APRIL 23, 2024

Google not only crawled and indexed virtually every page on the web, it looked at how sites linked to each other, tracked which of the ten top links it showed were clicked on the most, which ones led people to come back and try another and which sent them away satisfied. The market was maturing. By the end of 2012, it was up to 82%.

Social Media 108

Social Media Google Internet Internet 108

The Morning Paper

JANUARY 21, 2020

In the next post we’ll look at the detailed analysis of how a team at Etsy handled a particular incident on December 4th 2014, to see what we can learn from it. The organisations that build and operate these systems are themselves often geographically distributed and communicating virtually. Why is this even a thing?

Internet 98

Internet Internet Strategy Energy 98

The Polyglot Developer

JANUARY 29, 2015

Since starting this blog in July of 2014, I have had an unexpected amount of growth. So much, that a lot of strain has been placed on my virtual private server (VPS). A common issue that has plagued me and many other WordPress users is the awful MySQL crash due to exhausted resources.

Monitoring 40

Monitoring Internet Internet Traffic 40

ACM Sigarch

APRIL 26, 2018

EPU: Emotion Processing Unit is designed by Emoshape , as the MCU microchip design to enable a true emotional response in AI, robots and consumer electronic devices as a result of a virtually unlimited cognitive process. In 2014, Google’s Project Tango deployed Myriad1 to construct 3D indoor maps. FPU: Floating Processing Unit (FPU).

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Nick Desaulniers

OCTOBER 24, 2018

Before booting a compiled Linux kernel image on actual hardware, it can save us time and potential headache to do a quick boot in a virtual machine like QEMU. Also, QEMU has more flags than virtually any other binary I’ve ever seen (other than a google3 binary; shots fired), and simply getting it to print to the terminal is ¾ the battle.

C++ 56

C++ Hardware Virtualization Systems 56

Brendan Gregg

MARCH 16, 2024

2014: Java in Flames Broken Java Stacks (2014) When I joined Netflix in 2014, I found Java's lack of frame pointer support broke all application stacks (pictured in my 2014 Surge talk on the right). The actual overhead depends on your workload. This can be done using eBPF as well.

Java 145

Java Cache Google Hardware 145

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. It's an exciting development in cloud computing: hardware virtualization is now fast. Virtualized in Hardware**: Hardware support for virtualization, and near bare-metal speeds.

Virtualization 40

Virtualization AWS Hardware Storage 40

Smashing Magazine

OCTOBER 27, 2021

Another area that has been showing huge potential is eye-tracking in the context of virtual reality. Since 2014 , however, mobile users have been gaining more and more importance. Source: Oculid) ( Large preview ). Web designers worked until recently with a desktop-first approach.

Mobile 111

Mobile Website Hardware Social Media 111

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. How long does it take to read the time?

Speed 126

Speed Java AWS Virtualization 126

Brendan Gregg

JULY 14, 2019

It originated as Berkeley Packet Filter (BPF), an in-kernel execution engine that processes a virtual instruction set, and has been extended (aka eBPF) for providing a safe way to extend kernel functionality. I've been helping lead BPF observability since 2014, and I'm a major contributor and maintainer for the front-ends.

Systems 40

Systems Performance Education Technology 40

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. The FaaS model of cloud computing debuted in 2014 with startups like hook.io. FaaS enables developers to create and run a single function in the cloud using a serverless compute model.

Development 253

Development Serverless Best Practices Lambda 253

Dynatrace

MAY 31, 2021

Since Kubernetes emerged in 2014, it has become a popular solution for scaling, managing, and automating the deployments of containerized applications in distributed environments. This virtualization makes it possible to efficiently deploy and securely run a container independently of the hosting infrastructure. What is Kubernetes?

Virtualization 133

Virtualization DevOps Infrastructure Cloud 133

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The older Intel Xeon E5-26xx v3 (Haswell) series which was introduced in Q3 of 2014, had a maximum memory bandwidth of 2133MHz. Figure 2: Microsoft Project Olympus. 10 x 1.9TB NVMe SSD.

Azure 42

Azure Virtualization Storage Benchmarking 42

Dynatrace

JULY 13, 2020

These packages, known as container images, are immutable and because they abstract the environment on which they run, they ’re portable and can be moved from one environment to another , regardless of what platform it’s running on, i.e. a physical or virtual machine, on-premise, data center , or in the public cloud. .

Google 132

Google Ecommerce DevOps Cloud 132

Dynatrace

JULY 13, 2020

These packages, known as container images, are immutable and because they abstract the environment on which they run, they ’re portable and can be moved from one environment to another , regardless of what platform it’s running on, i.e. a physical or virtual machine, on-premise, data center , or in the public cloud. .

Google 130

Google Ecommerce DevOps Cloud 130

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. How long does it take to read the time?

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. How long does it take to read the time?

Speed 52

Speed Java AWS Virtualization 52

SQL Performance

FEBRUARY 1, 2022

The transaction log contains virtual log files, which contain log blocks, which store the actual log records. Virtual Log Files. The transaction log is split up into sections called virtual log files , commonly just called VLFs. Due to this problem, in SQL Server 2014 the algorithm changed for auto-growth of the log file.

Architecture 53

Architecture Servers Virtualization Database 53

Sutter's Mill

MARCH 11, 2024

The main improvement MSLs give is that a program data race will not corrupt the language’s own virtual machine (whereas in C++ a data race is currently all-bets-are-off undefined behavior). If we can get a 98% improvement and still have fully compatible interop with existing C++, that would be a holy grail worth serious investment.

C++ 139

C++ Programming Code Java 139

Dynatrace

FEBRUARY 25, 2021

Since its introduction by AWS in 2014, AWS Lambda has revolutionized the compute space and boosted the entire serverless movement. The virtual CPU is turned off. Dynatrace news. Gartner predicts that by 2025, 50% of all global enterprises will have deployed serverless function platforms as a service (fPaaS), up from only 20% today.

Lambda 221

Lambda AWS Monitoring Serverless 221

Enprowess

JANUARY 11, 2022

React got popular due to the virtual document object model (DOM) which enables it to enhance performance of web apps and PWA significantly. Usage of Virtual DOM allows efficient rendering where only certain part of webpage is rerendered speeding up performance. Absence of Virtual DOM results in less memory intensive applications.

Virtualization 64

Virtualization Website Speed Mobile 64

Alex Russell

APRIL 29, 2021

Delayed three years ( Chrome 40, November 2014 vs. Safari 11.1, A subset ( element.animate() ) has enabled developers to more easily create high-performance visual effects with lower risk of visual stuttering in Chrome and Firefox since 2014. Critical in adapting web content to mobile, particularly regarding multi-touch gestures.

Media 145

Media Games Education Engineering 145

Brendan Gregg

SEPTEMBER 5, 2017

I've suggested adding a command to docker to make listing at least the top-level PIDs in containers easier. ## Virtual Machines The two main technologies on Linux are Xen and KVM (and there's Bhyve for BSD). What happens if processes really do try to populate all that virtual memory?

Virtualization 76

Virtualization AWS Engineering Hardware 76

KeyCDN

OCTOBER 10, 2018

Although a beta version was released in 2014, the first stable release of Kubernetes was just made available in September 2018. The result was Kubernetes, which allows developers to create and manage “clusters” of physical and virtual machines in order to coordinate cooperation via a shared network.

Virtualization 47

Virtualization Open Source Network Architecture 47

SQL Performance

JUNE 21, 2019

For SQL Server 2008R – 2014, you could lower this threshold using trace flag 2371. If you are on SQL Server 2008 – SQL Server 2014, for a single NUMA node with less than 8 logical processors, keep MAXDOP at or below the number of logical processors. That can take a long time on larger tables.

Servers 49

Servers Azure Hardware Database 49

Enprowess

SEPTEMBER 28, 2021

The presence of virtual DOM and SPA are the key influencing USPS of React JS. is a progressive JavaScript framework created by Even You in 2014. is based on Virtual DOM structure, and on the other hand, Angular is based on the MVC model. React JS is used to develop single-page applications (SPAs). Source: [link].

Open Source 52

Open Source Mobile Entertainment Virtualization 52

Enprowess

SEPTEMBER 20, 2021

Created by Evan You, Vue had its first public appearance in 2014. Like React, Vue features two-way binding, uses components and a virtual DOM. They use lazy loading to extend performance rates and reduce loading times and code refreshes via virtual DOMs. It expands on many concepts found in React and Angular. What is React?

Open Source 52

Open Source Mobile Scalability Google 52

SQL Server According to Bob

DECEMBER 31, 2018

protected virtual void Dispose(bool bDisposing) { if (true == bDisposing) { m_MatchingTree.Dispose(); m_MatchingTree = null; if (null != virtual public void AbortAllWorkers() { if (null != protected virtual void Dispose(bool bDispose) { CompleteAllWork(); // If not shutdown do so now }. Start(); }. ScatterGather.cs.

Efficiency 40

Efficiency Code Servers Cache 40

Randon ASCII

AUGUST 23, 2018

On any modern operating system each process gets their own virtual memory address space so that the operating system can isolate processes and protect memory. GetProcessVaData in 2014 or earlier , but they didn’t leave enough information to be useful. Additional wasted memory.

Operating System 58

Operating System Code Processing Systems 58

Brendan Gregg

AUGUST 8, 2017

And here's an excerpt from [Linux] today (include/linux/sched/loadavg.h): #define EXP_1 1884 /* 1/exp(5sec/1min) as fixed-point */ #define EXP_5 2014 /* 1/exp(5sec/5min) */ #define EXP_15 2037 /* 1/exp(5sec/15min) */. EXPFF: EXP 0.920043902 ;C = 1 MIN EXP 0.983471344 ;C = 5 MIN EXP 0.994459811 ;C = 15 MIN. 3 tar termb$ iostat -x 60. [.]

Latency 111

Latency Metrics C++ Systems 111