The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. Engineers want their alerting system to be realtime, reliable, and actionable. It allows us to overcome high dimensionality/cardinality limitations of the time-series database.

Storage 288

Storage Cache Metrics Database 288

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. It also becomes inefficient as the data scale increases.

Data Engineering 264

Data Engineering Engineering Processing Games 264

Dynatrace

FEBRUARY 20, 2024

Monitoring myriad tools and the accompanying data silos make it increasingly difficult for enterprises to optimize application performance and availability. Making waves was the theme of this year’s Perform conference. For the latest news and insights from the Dynatrace Perform 2024 conference, check out our guide.

Monitoring 152

Monitoring Education Technology Technology 152

Dynatrace

FEBRUARY 13, 2020

Across both his day one and day two mainstage presentations, Steve Tack, SVP of Product Management, described some of the investments we’re making to continue to differentiate the Dynatrace Software Intelligence Platform. This drives precise answers in real-time about performance issues and anomalies across the full stack.

Performance 235

Performance Analytics Mobile Innovation 235

Dynatrace

JANUARY 16, 2023

The rapid adoption is driven—and challenged by—an ever-growing ecosystem of Kubernetes technologies that add advanced platform features, such as security, microservice communications, observability, scaling, resource utilization, and so on. This Kubernetes survey shows how organizations actually use Kubernetes in production.

Open Source 342

Open Source Java Operating System Programming 342

The Netflix TechBlog

NOVEMBER 9, 2021

This allows us to present the content exactly as creatively envisioned on devices and plans which support such high resolution and frame-rate playback. The Client and UI Engineering team built a certification test with these streams to analyze both the device logs as well as the pictures rendered on the screen. Some titles (e.g.,

Media 246

Media Open Source Efficiency Software Engineering 246

Alex Podelko

AUGUST 18, 2019

First, I’d like to elaborate on “It may be less need for simple load testing due to increased scale and sophistication of systems” I meant that the traditional way – testing the system before deploying in production using production-type workload – is not the only way anymore.

Performance Testing 243

Performance Testing Testing Performance Testing Tools 243

Dynatrace

MAY 6, 2021

At Perform 2021 , Dynatrace lead data scientist Thomas Natschläger gave a deep dive into the Dynatrace AI engine, Davis. The underlying assumption of the Davis AI engine is that not every one of these individual metrics, timeseries, and unexpected fluctuations are important. So, how can Davis handle this problem?

Games 172

Games Metrics Monitoring Cloud 172

The Netflix TechBlog

MARCH 5, 2019

Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

JANUARY 25, 2023

The databases we pick should be able to scale horizontally. One of the key initiatives at Netflix, Media Search Platform, now uses Marken to store annotations and perform various searches explained below. Different types of search queries are supported using the Elasticsearch as a backend search engine.

Scalability 283

Scalability Latency Media Architecture 283

Dynatrace

FEBRUARY 14, 2022

As a guest keynote speaker at Dynatrace Perform 2022 , Tegmark set the stage for AI as the ultimate technology for game-changers. But at the scale of AGI, a reactive trial-and-error approach can be costly and potentially catastrophic. billion years of cosmic history and the potential of the human race to influence the next 13.8

Artificial Intelligence 215

Artificial Intelligence Games Technology Technology 215

Alex Podelko

DECEMBER 19, 2019

Even when I took out the sessions that don’t directly cover the topics of my primary interests as well as mainframe-specific presentations, I ended up with 21 sessions in 2.5 ITIL Version 4 Capacity and Performance Management in an Agile Container World by Chris Molloy, IBM. Meeting of the Minds: Performance Engineering.

Efficiency 100

Efficiency Artificial Intelligence Scalability Performance 100

Dynatrace

APRIL 15, 2022

At Dynatrace Perform 2022 , David Catanoso, acting director of cloud and edge solutions at the U.S. As a result, VA had to rapidly scale its on-premises Citrix environment. ” Since then, VA solved many cloud performance problems and kept its complex hybrid environment running without interrupting remote work.

Cloud 176

Cloud Infrastructure Innovation Monitoring 176

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! In this session, we deep-dive into how Amazon EC2 Auto Scaling works to simplify continuous fleet management and automatic scaling with changing load.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! In this session, we deep-dive into how Amazon EC2 Auto Scaling works to simplify continuous fleet management and automatic scaling with changing load.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Dynatrace

JUNE 10, 2020

Having been named as a Leader in the 2020 Gartner APM Magic Quadrant for the 10 th consecutive time proves that Dynatrace is the best-of-breed application performance monitoring tool available. Our Davis AI causation engine can easily detect root causes that are related to service slowdowns or increases in failures.

Infrastructure 160

Infrastructure Availability Monitoring Processing 160

The Netflix TechBlog

OCTOBER 27, 2021

It allows data scientists to define ML workflows, test them locally, scale-out to the cloud, and deploy to production in idiomatic Python code. It makes it easy for data scientists to express even complex machine learning applications in idiomatic Python, test them locally, or scale them out in the cloud?—?all

Open Source 222

Open Source Monitoring Scalability Code 222

Dynatrace

FEBRUARY 14, 2022

As a guest keynote speaker at Dynatrace Perform 2022 , Tegmark set the stage for AI as the ultimate technology for game-changers. But at the scale of AGI, a reactive trial-and-error approach can be costly and potentially catastrophic. billion years of cosmic history and the potential of the human race to influence the next 13.8

Artificial Intelligence 202

Artificial Intelligence Games Technology Technology 202

The Netflix TechBlog

AUGUST 28, 2020

In this blog post, we present benefits of applying the above-mentioned optimizations to standard dynamic range (SDR) 10-bit and 4K streams (some titles are also HFR). The encodes are decoded and scaled to a 4K canvas prior to extracting the cutouts. The 8-bit stream profiles go up to 1080p resolution.

Network 330

Network Storage Innovation Mobile 330

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success. In MongoDB 6.x:

Best Practices 85

Best Practices Hardware Tuning Scalability 85

Adrian Cockcroft

FEBRUARY 13, 2023

The new information from October 2022 states: To achieve our goal of powering our operations with 100% renewable energy by 2025 — five years ahead of our original 2030 target — Amazon contracts for renewable power from utility scale wind and solar projects that add clean energy to the grid. SUS209 — there was no talk with this code.

AWS 64

AWS Energy Architecture Programming 64

Smashing Magazine

NOVEMBER 8, 2021

We work with millions of merchants, and as many companies, we obsess about storefront performance. We obsess even more about finding the optimal balance between performance, capabilities, and merchants’ business objectives. Commerce At Shopify Scale: Hydrogen Powered By Oxygen. Large preview ). Large preview ).

Cache 135

Cache Best Practices Strategy Servers 135

Alex Podelko

JUNE 12, 2019

If we talk about commercial vendors targeting the corporate market, I guess only Neotys remains independent and active (I mean contributing into the performance testing ecosystem – innovation, publishing content, participating in events, etc). Microfocus acquired both LoadRunner from HP and Silk Performer (as a part of Borland).

Testing 243

Testing Open Source Testing Tools Performance Testing 243

Alex Russell

JUNE 22, 2022

As penance for this error, and for being short with Miguel , I must deconstruct the ways Apple has undermined browser engine diversity. Contrary to claims of Apple partisans, iOS engine restrictions are not preventing a "takeover" by Chromium — at least that's not the primary effect. And that's a choice. "WebKit

Engineering 110

Engineering Traffic Government Google 110

The Netflix TechBlog

FEBRUARY 14, 2020

We also need to source multiple images for each title representing different themes so we can present an image that is relevant to each member’s taste. Through testing we have learned that with proper checks and human curation in place, assisted artwork candidates can perform on par with agency designed artwork.

Design 182

Design Open Source C++ Availability 182

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. The Netflix Media Database (NMDB) is one such example.

Lambda 189

Lambda Media Open Source Metrics 189

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL.

Database 120

Database Design Cloud Storage 120

Dynatrace

NOVEMBER 24, 2022

The key topic Michael brought to Amplify was around the opportunity the changing economic and technological landscape presents, explaining that observability shouldn’t be seen as a bolt-on but instead be seen as a built-in element to an intelligent platform. This series of challenges present an opportunity for advancement.

Innovation 158

Innovation Virtualization Programming Energy 158

The Netflix TechBlog

JUNE 4, 2019

However, the key insight here is that these caches are partially shared among the CPUs, which means that perfect performance isolation of co-hosted containers is not possible. Traditionally it has been the responsibility of the operating system’s task scheduler to mitigate this performance isolation problem. Linux to the rescue?

Cache 251

Cache Latency Airlines Logistics 251

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

OCTOBER 23, 2020

Large-scale software deployments rarely depend on the manual invocation of installers. In order to scale up and perform such operations within predefined maintenance windows (that are typically short), deployment administrators have inspired the creation of CMDB solutions and mass-deployment mechanisms. Operation modes.

Tuning 130

Tuning Monitoring Availability Architecture 130

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. Elevate your MariaDB environment with Percona Support for MariaDB. Contact us to learn more!

Open Source 52

Open Source Servers Storage Scalability 52

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 61

Tuning AWS Best Practices Network 61

Jos

JUNE 2, 2018

Web Performance is not only about understanding what makes a site fast. Performance is a feature and needs to be prioritized as such. Performance is a topic that has interested me for a long time. Moving over to web, the performance problems are different. This is not a post explaining why web performance is important.

Performance 237

Performance Speed Google Media 237

KeyCDN

SEPTEMBER 12, 2019

We normally focus solely on the performance aspect, but today we want to dive into additional ways you can optimize images for the web. The file size of your images of course is very important, but SEO and social media also play an important part in helping your website perform and convert better.

Social Media 106

Social Media Media Google Website 106