The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

SQL Performance

AUGUST 2, 2019

From the customer side, this has been the limit of what can be done*, until SQL Server 2019. The latest adaptation by the SQL Server team is moving the system tables (metadata) for tempdb to In-Memory OLTP (aka memory-optimized). Now that 2019 CTP 3.2 Now that 2019 CTP 3.2 I have SQL Server 2019 CTP 3.2

Servers 95

Servers C++ Testing Systems 95

Brendan Gregg

MARCH 7, 2020

Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. I've heard many companies use my [Systems Performance] book as recommended or required reading for new engineers (thank you), and this is an updated talk on the topic.

Systems 52

Systems Performance Benchmarking Tuning 52

Brendan Gregg

MARCH 7, 2020

Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. I've heard many companies use my [Systems Performance] book as recommended or required reading for new engineers (thank you), and this is an updated talk on the topic.

Systems 52

Systems Performance Benchmarking Tuning 52

O'Reilly Software

FEBRUARY 5, 2019

Gregor Hohpe explains how software architects can use what they know about technical systems to help refactor organizations. Stuart Halloway explains how to augment agility with principles for designing systems. Below you'll find links to highlights from the event. Architecting IT transformation.

Software Architecture 100

Software Architecture Architecture Software Software 100

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

O'Reilly Software

JUNE 13, 2019

Michael Feathers explores various scaling strategies in light of research about human cognition and systems cohesion. Watch " From the trenches with Rebecca Parsons ". --> Continue reading Highlights from the O'Reilly Software Architecture Conference in San Jose 2019. Watch " Next Architecture ". Choices of scale.

Software Architecture 89

Software Architecture Architecture Software Software 89

DZone

SEPTEMBER 5, 2019

For system administrators, operations engineers, and others with strong systems and software backgrounds, there’s perhaps no better time than the present to transition into DevOps. As of August 2019, there are currently over 50,000 LinkedIn DevOps job listings in the United States alone.

DevOps 275

DevOps Software Engineering Infrastructure Engineering 275

Brendan Gregg

JULY 14, 2020

Eight years ago I wrote _Systems Performance: Enterprise and the Cloud_ (aka the "sysperf" book) on the performance of computing systems, and this year I'm excited to be releasing the second edition. A year ago I announced [BPF Performance Tools: Linux System and Application Observability]. It's already listed on Amazon.com.

Systems 52

Systems Cloud Performance Tuning 52

Brendan Gregg

JULY 14, 2020

Eight years ago I wrote _Systems Performance: Enterprise and the Cloud_ (aka the "sysperf" book) on the performance of computing systems, and this year I'm excited to be releasing the second edition. A year ago I announced [BPF Performance Tools: Linux System and Application Observability]. It's already listed on Amazon.com.

Systems 52

Systems Cloud Performance Tuning 52

Dynatrace

APRIL 4, 2023

“In 2019, we actually recognized a few gaps in our previous monitoring solution.” For example, most monitoring solutions are deployed piecemeal or simply don’t support integration with other critical systems. Recently, the university adopted Dynatrace to help monitor its applications.

Education 211

Education Monitoring C++ Design 211

SQL Performance

NOVEMBER 1, 2019

I helped Bob Ward ( @bobwardms ) with technical editing for his most recent book, " SQL Server 2019 Revealed ," and have been actively engaged with the product teams and my MVP peers throughout the CTP and RC cycles. But what if I've already done that on another system with the same workload? Parting Thoughts.

Servers 40

Servers Hardware Database Availability 40

CSS Wizardry

OCTOBER 2, 2023

From identifying their operating system, platform, and browser, to trying to guide them—invisibly!—through send ( ' Forbidden: Invalid Referer ' ); } Clear-Site-Data for Developers This isn’t the first time I’ve written about Clear-Site-Data —I mentioned it briefly in my 2019 article all about setting the correct caching headers.

Cache 166

Cache Operating System Availability Development 166

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". What happens when no new open source comes out of the smaller companies, and the big-3 decide they don't really need or want to play nice anymore? We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

The Morning Paper

JUNE 6, 2019

Towards federated learning at scale: system design Bonawitz et al., SysML 2019. This is a high level paper describing Google’s production system for federated learning. At the core of the system is a federated learning approach called Federated Averaging , with an optional extension for Secure Aggregation.

Systems 71

Systems Design Google Servers 71

High Scalability

MARCH 8, 2019

There was already a payment system — it was called the credit card. All of the heavy-lifting infrastructure was already in place for it. There was already a telecommunication network, which became the backbone of the internet.

Internet 146

Internet Internet Scalability Lambda 146

Dynatrace

SEPTEMBER 13, 2023

Our journey began in 2019 with the introduction of the Dynatrace Citrix monitoring extension. By adopting an outside-in perspective, Citrix admins gain insight into end-user experience and how it correlates with the Citrix system activities that admins are responsible for.

Monitoring 216

Monitoring Healthcare Infrastructure Metrics 216

Alex Podelko

APRIL 18, 2021

These two papers provide many more insights: Automated system performance testing at MongoDB , DBTest 2020 [ Video ]. The Use of Change Point Detection to Identify Software Performance Regressions in a Continuous Integration System , ICPE 2020 [ Video ]. One of most important issues in continuous performance testing is variability.

Performance Testing 182

Performance Testing Performance Testing Education 182

Scalegrid

NOVEMBER 29, 2023

Data Center Dynamics highlights a significant uptick in DBaaS adoption, growing from 40% to 45% between 2019 and 2020. Additional security measures as provided by the DBaaS already work with the configuration stored on their system. Future-Proofing Your Database System Future-proof your database operations when you scale up.

Healthcare 130

Healthcare Hardware Database Scalability 130

Brendan Gregg

APRIL 14, 2022

eBPF tools (2014-2019). I hope my last two books, [Systems Performance 2nd Ed] and [BPF Performance Tools] serve Netflix well in my absence and everyone else who reads them. A large and unexpected opportunity has come my way outside of Netflix that I've decided to try. offer letter logo (2014). flame graphs (2014). PMC analysis (2017).

Java 145

Java Cloud Cache AWS 145

Scalegrid

JUNE 6, 2019

June 6, 2019 – ScaleGrid , the Database-as-a-Service (DBaaS) leader in the SQL and NoSQL space, has announced the expansion of their fully managed MySQL Hosting services to support Amazon Web Services (AWS) cloud. PALO ALTO, Calif.,

AWS 191

AWS Cloud Open Source Virtualization 191

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. In 2019, Netflix moved thousands of container hosts to bare metal.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Dynatrace

MAY 31, 2023

Uptime Institute’s 2022 Outage Analysis report found that over 60% of system outages resulted in at least $100,000 in total losses, up from 39% in 2019. At the lowest level, SLIs provide a view of service availability, latency, performance, and capacity across systems. availability. Service-level indicators (SLIs).

Best Practices 219

Best Practices DevOps Latency Metrics 219

Brendan Gregg

JULY 4, 2021

I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

NOVEMBER 13, 2023

In this blog post, we will introduce speech and music detection as an enabling technology for a variety of audio applications in Film & TV, as well as introduce our speech and music activity detection (SMAD) system which we recently published as a journal article in EURASIP Journal on Audio, Speech, and Music Processing.

Architecture 224

Architecture Energy Benchmarking Processing 224

O'Reilly

NOVEMBER 7, 2019

People from across the cloud native and distributed systems worlds came together in Berlin for the O’Reilly Velocity Conference. Watch “ Observability: Understanding production through your customers’ eyes “ Secure reliable systems. billion years “ The ultimate guide to complicated systems.

Open Source 52

Open Source DevOps Infrastructure Engineering 52

The Netflix TechBlog

MARCH 21, 2019

The system had significant issues that we were grateful to hear about so we could retire the system. In 2019, we also started publishing quarterly program updates to highlight new product areas for testing. We received a report from a researcher that found a service they didn’t believe should be available on the internet.

Entertainment 166

Entertainment Programming Internet Internet 166

Dynatrace

JULY 31, 2020

The vendor has de-supported this technology and version with 2019-09-30. The vendor has de-supported this technology and version with 2019-09-30. Current Operating systems support changes. The following operating systems will no longer be supported starting 01 August 2020. Upcoming Operating systems support changes.

Operating System 117

Operating System Java Infrastructure Monitoring 117

The Netflix TechBlog

OCTOBER 15, 2019

Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2]. By their nature, they can only rely on the lowest common denominator of participating systems. That system quickly grew very complex and became difficult to maintain. Online Event Processing.

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

MAY 28, 2021

Whether they worked at a manufacturer for very large industrial ventilation systems , or in finance, healthcare, or elsewhere in tech (big or small), most people on my team have unique paths to their current positions at Netflix. Structures, dynamics, control systems, fluids, design…pass, pass, pass, pass, and pass! By March 2020?—?less

Healthcare 200

Healthcare Entertainment Analytics Programming 200

The Morning Paper

SEPTEMBER 24, 2019

50 ways to leak your data: an exploration of apps’ circumvention of the Android permissions system Reardon et al., USENIX Security Symposium 2019. Side-channels are typically an unintentional consequence of a complicated system.

Systems 74

Systems Traffic Network Google 74

Dynatrace

APRIL 15, 2022

” Despite many challenges, when the project concluded in 2019, the team had the confidence and experience to migrate anything to the cloud. In the past, severe database issues seriously hurt system performance, causing delayed shipping times for prescriptions. . “We kind of did the opposite.

Cloud 173

Cloud Infrastructure Innovation Monitoring 173

Scalegrid

JULY 17, 2019

July 17, 2019 – ScaleGrid, a leader in the Database-as-a-Service (DBaaS) space, has just announced support for PostgreSQL hosting in the cloud. PALO ALTO, Calif., The ScaleGrid platform allows PostgreSQL users to automate their daily operations without having to sacrifice control over their deployments.

Azure 182

Azure AWS Open Source Database 182

O'Reilly

NOVEMBER 7, 2019

Brian Sletten takes a deep dive into the intersection of data, models, hardware, language, architecture, and machine learning systems. Watch “ The three-headed dog: Architecture, process, structure “ Modern machine learning architectures: Data and hardware and platform, oh my.

Software Architecture 53

Software Architecture Architecture Software Software 53

Dynatrace

JUNE 9, 2020

As part of the instructions, you can also make sure that your machine meets the system and hardware requirements for setting up a private Synthetic location. As you might already know, starting with Dynatrace version 1.193, Windows Server 2019 is supported. What’s next. In the near future, you can also expect support for: Ubuntu 18.

Monitoring 133

Monitoring Hardware Servers Infrastructure 133

Scalegrid

OCTOBER 2, 2019

October 2, 2019 – ScaleGrid, a rapidly growing leader in the Database-as-a-Service (DBaaS) space, has just launched their new fully managed Hosting on Azure for Redis™ service. PALO ALTO, Calif.,

Azure 100

Azure Availability Open Source Virtualization 100

Particular Software

JANUARY 27, 2020

Microsoft Message Queuing, better known by its nickname MSMQ, passed away peacefully in its hometown of Redmond, Washington on October 14, 2019, at the age of 22. Since it exists in Windows 10 and Windows Server 2019, MSMQ will continue to live on until at least 2029—and much longer assuming it isn't removed from future versions of Windows.

Transportation 98

Transportation Azure Open Source Systems 98