The Netflix TechBlog

NOVEMBER 13, 2023

In this blog post, we will introduce speech and music detection as an enabling technology for a variety of audio applications in Film & TV, as well as introduce our speech and music activity detection (SMAD) system which we recently published as a journal article in EURASIP Journal on Audio, Speech, and Music Processing.

Architecture 224

Architecture Energy Benchmarking Processing 224

The Netflix TechBlog

NOVEMBER 29, 2023

HDR was launched at Netflix in 2016 and the number of titles available in HDR has been growing ever since. For a given rate-quality operating point, the DO process helps allocate bits among the various shots while maximizing an overall objective function. The DO encodes are shot-based and so the IDR frames align with shot boundaries.

Open Source 252

Open Source Software Engineering Internet Internet 252

Dynatrace

MARCH 24, 2023

Container orchestration is a process that automates the deployment and management of containerized applications and services at scale. Container orchestration enables organizations to manage and automate the many processes and services that comprise workflows.

Infrastructure 182

Infrastructure Open Source Operating System Cloud 182

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 200

Innovation Mobile Technology Technology 200

SQL Performance

JULY 24, 2022

A Big Deal : SQL Server 2016 Service Pack 1. Toward the end of the year, I was able to spread the news that a SQL Server 2016 service pack would make most Enterprise-only features available in all editions. I detailed all the changes and explained why this was such a huge win for non-Enterprise customers.

Servers 66

Servers Strategy Availability Processing 66

DZone

AUGUST 23, 2019

This became alarmingly clear when the massive series of DDoS attacks hit Dyn in 2016, and much of the websites and applications on the Internet became inaccessible to huge swaths of users across North America and Europe. It is also arguably the most important element of web performance to monitor.

Monitoring 100

Monitoring Internet Internet Website 100

Dynatrace

MAY 3, 2021

To mitigate security risks, comply with regulations, and align with good governance requires a coordinated effort among people, processes, and technology. While DevOps processes streamline the software development life cycle and improve time to value for developers and stability for operations, they often bypass security risks. .

Code 156

Code DevOps Speed Government 156

Percona

FEBRUARY 2, 2023

The challenge, of course, is reconstituting the logical replication process as quickly as possible, ideally without any data loss. The good news is that there are hacks that can speed up the entire recovery process, although they all have their own quirky limitations. Alter the subscription and point to the newly promoted PRIMARY.

Games 91

Games Open Source Tuning Speed 91

Scalegrid

JANUARY 19, 2024

Key Takeaways Rollbacks in MongoDB are triggered by disruptions in the replication process due to primary node crashes, network partitions, or other failures, which can lead to substantial data loss and inconsistencies. This process initiates recording and tracking, ensuring a more thorough approach than the default, low-level options.

Database 130

Database Network Servers Monitoring 130

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

OCTOBER 15, 2021

This information is gathered from remote, often inaccessible points within your ecosystem and processed by some sort of tool or equipment. Traces are the act of following a process (for example, an API request or other system activity) from start to finish, showing how services connect. In-process exporter. Read eBook now!

Open Source 216

Open Source Metrics Cloud Transportation 216

O'Reilly Software

AUGUST 23, 2018

Recently, we dove into our assessment data to discover—and quantify —trends in software development, each time comparing 2016 to 2017. Trend 1: The percentage of teams that do not automate deployment shrank from 26% in 2016 to 11% in 2017. Trend 4: More teams are enforcing full quality control (31% in 2017, up from 23% in 2016).

Software 73

Software Software Development Code 73

SQL Performance

OCTOBER 14, 2020

In Part 4 of the series, which focused on optimization of derived tables, I described a process of unnesting/substitution of table expressions. The TL;DR version of substitution/unnesting of CTEs is that the process is the same as it is with derived tables. You can find the script that creates and populates PerformanceV5 here.

C++ 52

C++ Servers Code Efficiency 52

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

The Netflix TechBlog

DECEMBER 10, 2019

By Adam Wang , Andy Swan , Raja Senapati , Shilpa Jois , Anjali Chablani , Deepa Krishnan , Vidya Sundaram , and Casey Wilms You can also check out highlights from our past events: May 2019 , November 2018 , March 2018 , August 2017 , January 2017 , May 2016 , November 2015 , March 2015 , February 2014 & August 2014.

Innovation 130

Innovation Mobile Technology Technology 130

Dynatrace

APRIL 11, 2023

As digital transformation escalates, vulnerabilities are increasing as well, by more than 290% since 2016. Shifting left is the practice of moving testing, quality, and performance evaluation early in the development process, often before code is written.

Cloud 183

Cloud DevOps Open Source Retail 183

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Advances in browser content processing. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively.

Performance 124

Performance Network Cache Metrics 124

ACM Sigarch

APRIL 26, 2018

APU: Accelerated Processing Unit is the AMD’s Fusion architecture that integrates both CPU and GPU on the same die. BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. They unveiled their first two embedded AI chips fabricated with TSMC 40nm process in December 2017: “Journey 1.0

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Brendan Gregg

OCTOBER 8, 2018

Some one-liners: # New processes with arguments bpftrace -e 'tracepoint:syscalls:sys_enter_execve { join(args->argv); }'. Files opened by process bpftrace -e 'tracepoint:syscalls:sys_enter_open { printf("%s %sn", comm, str(args->filename)); }'. Pages paged in by process bpftrace -e 'software:major-faults:1 { @[comm] = count(); }'.

C++ 110

C++ Virtualization Programming Latency 110

Dynatrace

JULY 31, 2020

OpenTracing became a CNCF project back in 2016, with a goal of providing a vendor-agnostic specification for distributed tracing, offering developers the ability to trace a request from start to finish by instrumenting their code. The in-process Exporter allows you to configure which backed(s) you want the telemetry sent.

Open Source 179

Open Source Metrics Google Java 179

All Things Distributed

SEPTEMBER 29, 2016

As part of the research and judging process, millions of Alexa customers will have the opportunity to converse with the socialbots on popular topics by saying, “Alexa, let’s chat about (a topic, for example, baseball playoffs, celebrity gossip, scientific breakthroughs, etc.).” For more information, check out the Alexa Prize page.

Artificial Intelligence 139

Artificial Intelligence Healthcare AWS Government 139

Simform

AUGUST 2, 2021

It was during the cold January of 2016 that Google Nest Smart Thermostat had one of the epic software failures - talk about being unlucky! The incident proves that while the software development process requires meticulous planning, a testing methodology is equally crucial for delivering a quality product.

Software 40

Software Software Testing Google 40

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. Still, if you stack a bunch of high-transaction databases on there, checkpoint processing can get pretty sluggish. SQL 2016 – It Just Runs Faster: Indirect Checkpoint Default.

C++ 58

C++ Database Servers Storage 58

SQL Performance

MARCH 20, 2020

In SQL Server 2016, STRING_SPLIT solved a long-missing gap in a language that, admittedly, was not intended for complicated string processing. For years before SQL Server 2016 (and for years since), we've written our own versions, improved them over time, and even argued about whose was fastest.

Database 109

Database Servers C++ AWS 109

Dynatrace

JULY 31, 2020

The in-process Exporter allows you to configure which backed(s) you want the telemetry sent. A standalo ne process completely separate from the application . Using Kubernetes as the analog for what OpenTelemetry can become , it is easy to see the benefits it can provide to the entire industry. .

Open Source 130

Open Source Metrics Google Java 130

Alex Russell

DECEMBER 18, 2022

Add to this the fact that desktop devices have a lifespan between five and eight years, on average, and that the P75 device was sold in 2016. That is, what was the average device in 2016? These devices feature: Eight slow, big.LITTLE ARM cores (A75+A55, or A73+A53) built on last-generation processes with very little cache.

Performance 113

Performance Network Mobile Latency 113

Alex Podelko

OCTOBER 18, 2016

I am looking forward to share my thoughts on ‘Reinventing Performance Testing’ at the imPACt performance and capacity conference by CMG held on November 7-10, 2016 in La Jolla, CA. In agile development / DevOps environments it should be interwoven with the whole development process. – Cloud. – Agile.

Performance Testing 100

Performance Testing Testing Performance DevOps 100

Dynatrace

OCTOBER 28, 2021

Chaos engineering matured at organizations such as Netflix, and gave rise to technologies such as Gremlin (2016) , becoming more targeted and knowledge-based. The discoveries form inputs into the software development and delivery process, so new software and microservices will better stand up to unforeseeable events.

Engineering 221

Engineering Entertainment Cloud Infrastructure 221

Brendan Gregg

MAY 16, 2017

I previously wrote about Netflix in [2015] and [2016], and if you are interested in what it's like to work here, I already covered much in those posts. Instead, it has been a process of continual improvements, by many engineers across the company. ## A Day in the Life (Performance Engineering) What do I actually do all day?

Java 75

Java Entertainment Engineering Scalability 75

All Things Distributed

MAY 19, 2017

That database engine is now known as Amazon Aurora and launched in 2014 for MySQL and in 2016 for PostgreSQL. We believe the central constraint in high throughput data processing has moved from compute and storage to the network.

Database 117

Database Design Cloud Storage 117

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Percona

AUGUST 18, 2023

10) starting as process 20477 2023-07-10T05:26:52.094196Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. 10) starting as process 20546 2023-07-10T05:27:02.179449Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. root@ip-172-31-128-38 share]# cat /usr/lib/systemd/system/mysqld@.service

Programming 86

Programming Servers Database Hardware 86

SQL Performance

DECEMBER 9, 2020

I mainly experimented with different table value constructor cardinalities, with serial versus parallel processing, and with row mode versus batch mode processing. The plan is serial, and all operators in the plan use row mode processing by default. Batch processing. Figure 5: Plan with batch processing.

C++ 114

C++ Servers Testing Processing 114

Testsigma

JANUARY 7, 2022

In 2016, Google made it clear that since mobile traffic is more than all else, mobile-friendly websites will be prioritised when a user searches on mobile. QAOps is a term derived by combining the two processes – the DevOps and QA into one. When we fuse QA into the DevOps process the newly integrated process is called QAOps.

Artificial Intelligence 89

Artificial Intelligence IoT Software Software 89

Alex Russell

FEBRUARY 21, 2023

is astonishingly dense with delayed features, inadvertantly emphasising just how far behind WebKit has remained for many years and how effective the Blink Launch Process has been in allowing Chromium to ship responsibly while consensus was witheld in standards by Apple. Regardless, Safari 16.4 31st : Web Share changes Feb. Safari 16.4

Energy 79

Energy Games Engineering Design 79

SQL Performance

JUNE 21, 2019

Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Part of that process is his Index Optimize procedure, which can take additional parameters to update statistics.

Servers 49

Servers Azure Hardware Database 49

The Polyglot Developer

SEPTEMBER 12, 2017

Back in 2014 I started The Polyglot Developer on WordPress with the intention of documenting what I learn and helping others in the process. The blog was later rebranded in early 2016, but the look and feel stayed the same. However, back then, it was not called The Polyglot Developer, but instead Nic Raboy’s Code Blog.

Development 52

Development Code Processing 52