The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 200

Innovation Mobile Technology Technology 200

O'Reilly Software

FEBRUARY 27, 2018

From the O'Reilly Software Architecture Conference in New York 2018. Adrian Cockcroft outlines the architectural principles of chaos engineering and shares methods engineers can use to exercise failure modes in safety and business-critical systems. Watch highlights covering the latest tools and techniques of software architecture.

Software Architecture 62

Software Architecture Architecture Software Software 62

High Scalability

OCTOBER 19, 2018

cpeterso : Your quote reminds me of cybernetics' Law of Requisite Variety: "If a system is to be stable, the number of states of its control mechanism must be greater than or equal to the number of states in the system being controlled.". UW's massive computer-science school is now named for him. ” -Larry Tesler.

Internet 123

Internet Internet Scalability Lambda 123

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” jaybo_nomad : The Allen Institute for Brain Science is in the process of imaging 1 cubic mm of mouse visual cortex using TEM at a resolution of 4nm per pixel. That means multiple data indirections mean multiple cache misses.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

SEPTEMBER 21, 2018

Too often, those who already hold power, those who are least able to recognize the flaws in our current systems, are the ones who decide our technological future. They'll love you even more. More quotes.

Internet 126

Internet Internet Scalability Traffic 126

High Scalability

JUNE 15, 2018

1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble? Dave Snowden ~ A key principle of complex design is shift a system to an adjacent possible.

Internet 113

Internet Internet Scalability Blockchain 113

Abhishek Tiwari

DECEMBER 27, 2017

There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures. Obviously, this has a clear impact on traditional ETL process which provides a fixed set of views.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

High Scalability

AUGUST 16, 2023

If you’re unfamiliar with this story, Swedbank had a major outage in April 2022 that was caused by an unapproved change to their IT systems. After investigation, the regulator found that Swedbank had not followed their change management process and issued a SEK850M (~85M USD) fine. Tell me if you’ve heard this one before?

Monitoring 100

Monitoring Processing Systems DevOps 100

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

Dynatrace

JANUARY 5, 2023

These are precisely the business goals of AIOps: an IT approach that applies artificial intelligence (AI) to IT operations, bringing process efficiencies. In its most basic form, IT automation executes scripts or processes on a schedule or in response to particular events. What is AIOps? What is AIOps?

Artificial Intelligence 147

Artificial Intelligence Innovation Technology Technology 147

KeyCDN

OCTOBER 2, 2018

That’s why we’ve compiled an exhaustive list of web development blogs and newsletters to make this process easier. It’s awesome for discovering how grid systems, CSS animation, Big Data, etc all play roles in real-world web design. Be sure to check it out if your dev process needs a creative kick in the pants.

Development 75

Development Website Design Code 75

The Netflix TechBlog

MARCH 1, 2021

Background The Media Cloud Engineering and Encoding Technologies teams at Netflix jointly operate a system to process incoming media files from our partners and studios to make them playable on all devices. The first generation of this system went live with the streaming launch in 2007. Delivery?—?A

Serverless 228

Serverless Media Latency Social Media 228

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

MARCH 3, 2020

By 2024, over 50% of all IT spending will be directly put towards digital transformation and innovation (up from 31% in 2018). PayPal, a popular online payment systems organization, implemented a full performance as a self-service model for developers to get their code performance tests. Industry apps explosion. Get started today! .

Performance 237

Performance Education Innovation Software Architecture 237

ACM Sigarch

MARCH 18, 2019

Computer systems, from the Internet-of-Things devices to datacenters, are complex and optimizing them can enhance capability and save money. Developing simulators, however, is time-consuming and requires a great deal of infrastructure development regarding a prospective system. Answered in Part 2.). Lazowska, et al.

Systems 60

Systems Latency Performance Analytics 60

Dynatrace

OCTOBER 15, 2021

Loosely defined, observability is the ability to understand what’s happening inside a system from the knowledge of the external data it produces, which are usually logs, metrics, and traces. This information is gathered from remote, often inaccessible points within your ecosystem and processed by some sort of tool or equipment.

Open Source 212

Open Source Metrics Cloud Transportation 212

Dynatrace

APRIL 3, 2020

Because OneAgent operates on your critical hosts where the services that comprise your business applications are located, Dynatrace must ensure the highest possible security in monitoring the operating systems and services that run on these hosts. It leverages Linux kernel system capabilities.

Operating System 173

Operating System Monitoring Systems Code 173

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. Comparison Overview.

Open Source 244

Open Source Tuning C++ Database 244

Dynatrace

DECEMBER 14, 2021

Already in 2018, 82% of all travel bookings globally took place without human interaction. During the booking process, I attempted to use some of my travel vouchers – but the button to apply these credits didn’t work. I lost an entire day due to an IT system problem that nobody noticed.

Airlines 215

Airlines Social Media Entertainment Transportation 215

Dynatrace

FEBRUARY 25, 2021

At AWS re:Invent in 2018, the Lambda team presented an excellent talk. What the Lambda team introduced in 2018, for example, the new Firecracker VM, has since been fully rolled out. In theory, an existing code module or agent can be used to monitor a Lambda function if there’s a way to load it into the running Lambda process.

Lambda 212

Lambda AWS Monitoring Serverless 212

Dynatrace

AUGUST 14, 2019

For the complete list of systems and technologies that are supported by OneAgent, see the Dynatrace supported technologies page. Improved Oracle process recognition. Previously, all Oracle processes were represented by one Oracle process group and one Oracle process group instance on each host. with Java 6.

Java 104

Java Cloud Traffic Virtualization 104

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF (extended Berkeley Packet Filter) is in the Linux kernel and is the new hotness in systems engineering. Pages paged in by process bpftrace -e 'software:major-faults:1 { @[comm] = count(); }'.

C++ 40

C++ Virtualization Programming Latency 40

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. A time where you can pose arbitrary questions of the system, and it can answer them. BPF is in the Linux kernel. ## Why Your Book?

Systems 40

Systems Performance Education Technology 40

Dynatrace

DECEMBER 14, 2021

Already in 2018, 82% of all travel bookings globally took place without human interaction. During the booking process, I attempted to use some of my travel vouchers – but the button to apply these credits didn’t work. I lost an entire day due to an IT system problem that nobody noticed.

Airlines 182

Airlines Social Media Entertainment Transportation 182

Brendan Gregg

AUGUST 29, 2021

Problem Statement The microservice managed and processed large files, including encrypting them and then storing them on S3. 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 No editing, spell checking, or comments.

Cache 105

Cache C++ AWS Latency 105

Dynatrace

JULY 30, 2021

Back in 2018, we taught those DevOps concepts and implemented unbreakable pipelines for cloud-native delivery projects. For easy access to all configuration files relevant for Dynatrace Cloud Automation, we start by setting an upstream git to our own GitHub, GitLab, Bitbucket, Azure DevOps, or any other git compliant version control system.

Cloud 212

Cloud DevOps Azure Virtualization 212

ACM Sigarch

MARCH 25, 2019

The M/M/1 queue also assumes that the arrival rate is not affected by the unbounded number of tasks in the queue (called an “open system”). How long can the computer take to process (service) each packet (not counting waiting), denoted S? Figure 2 plots the M/M/1 queue’s latency-throughput trade-off.

Systems 53

Systems Latency Performance C++ 53

Dynatrace

JULY 31, 2020

Loosely defined, Observability boils down to inferring the internal health and state of a system by looking at the external data it produces, which most commonly are logs, metrics, and traces. The in-process Exporter allows you to configure which backed(s) you want the telemetry sent. The Collector has two deployment models: .

Open Source 177

Open Source Metrics Google Java 177

High Scalability

SEPTEMBER 14, 2018

events processed to date 300k+ users globally 50% of the Fortune 100 use @pagerduty 10,500+ customers of every size 300+ integrations ?? editingemily : "In peacetime, a ticketing system is great. Because of that big servers and other memory systems need to have another kind of memory in the hierarchy. RachFrieee : 3.6B

Internet 30

Internet Internet Scalability Education 30

Alex Russell

FEBRUARY 21, 2023

is astonishingly dense with delayed features, inadvertantly emphasising just how far behind WebKit has remained for many years and how effective the Blink Launch Process has been in allowing Chromium to ship responsibly while consensus was witheld in standards by Apple. Regardless, Safari 16.4 31st : Web Share changes Feb. Safari 16.4

Energy 79

Energy Games Engineering Design 79

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0 TFLOPS FP-64, 14.8

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

FEBRUARY 20, 2019

Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? Having the right metrics available on demand and at a high resolution is key to understanding how a system behaves and helps to quickly troubleshoot performance issues. 10–20 MB/sec (it is, unsurprisingly, receiving lots of data).

Performance 211

Performance Latency Open Source Metrics 211

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Some of DBLog’s features are: Processes captured log events in-order.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212

Dynatrace

SEPTEMBER 7, 2019

The latest chapter in the story of how we reached this major milestone took place in May, 2018 when in an article explaining new and upcoming changes to OneAgent , we announced the Early Adopter program for a new operation mode for OneAgent for Linux that allows OneAgent to be run in non-admin mode (i.e., “non-privileged mode”).

Programming 102

Programming Monitoring Software Software 102