The Netflix TechBlog

NOVEMBER 9, 2021

To achieve this goal, the Encoding Technologies team made the following design decisions about AV1 encoding recipes: We always encode at the highest available source resolution and frame rate. For example, for titles where the source is 4K and high frame rate (HFR) such as “Formula 1: Drive to Survive” , we produce AV1 streams in 4K and HFR.

Media 246

Media Open Source Efficiency Software Engineering 246

The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 design , Sheng, CIDR’20. This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ ’ design. But in Software 2.0

Systems 84

Systems Design Software Software 84

Dynatrace

NOVEMBER 22, 2021

EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. AWS Lambda makes it easy to design, run, and maintain application systems without having to provision or manage infrastructure. Here are a few of the most popular. Amazon EC2. Amazon Fargate.

Best Practices 204

Best Practices AWS Monitoring Serverless 204

The Netflix TechBlog

FEBRUARY 1, 2022

The interview panel consists of two or three engineers, a hiring manager and a recruiter. The engineers assess your technical skills by asking you to solve various design and coding problems. The interview panel comprises an engineering director, a partner engineer or manager, and another engineering leader.

Engineering 199

Engineering Games Entertainment Innovation 199

The Netflix TechBlog

JUNE 1, 2021

Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team.

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

The Netflix TechBlog

OCTOBER 27, 2021

Requirements for a Metaflow GUI Metaflow is a human-centered system by design. Based on our experiences with other GUIs operating at Netflix-scale, this is not a trivial requirement: scalability needs to be baked into the design from the very beginning. For example, Netflix has its container orchestration platform called Titus.

Open Source 222

Open Source Monitoring Scalability Code 222

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

SQL Server According to Bob

SEPTEMBER 9, 2019

Previous posts have discussed partitioning, for example, a partitioned memory object [link] and how a latch maintains the desired access (exclusive, shared, …) [link]. The lock manager (LockMgr) is designed to track partitioned and non-partitioned locks. Bob Dorr – Principal Software Engineer SQL Server.

Servers 103

Servers Database Scalability Tuning 103

Dynatrace

JANUARY 23, 2024

For example, high-quality data and predictive AI enable causal AI to provide precise, continuous, and actionable insights in real time. But for organizations to maximize the business benefits of AI, they need to continuously evaluate their data to ensure it’s high-quality data, which is the bedrock of solid decision making.

Performance 179

Performance DevOps Innovation Artificial Intelligence 179

Strategic Tech

JANUARY 19, 2020

A natural tendency for software engineers is to gravitate towards the most technically interesting challenges. Developers who follow a Domain-Driven Design approach, however, have a counter-balance. for example, the complexity is still handled manually by employees and the software system is just replacing paper.

Open Source 87

Open Source Games Innovation Strategy 87

The Morning Paper

JULY 7, 2019

Software engineering for machine learning: a case study Amershi et al., More specifically, we’ll be looking at the results of an internal study with over 500 participants designed to figure out how product development and software engineering is changing at Microsoft with the rise of AI and ML. ICSE’19.

Software Engineering 92

Software Engineering Engineering Software Software 92

The Morning Paper

JANUARY 21, 2020

Routing, for example, is non-deterministic. In summary, software engineers find themselves in a very unenviable position when attempting to resolve an outage with their service. Preventative design is not enough. Business-critital Internet systems inherit all of the challenges of distributed systems.

Internet 98

Internet Internet Strategy Energy 98

Dynatrace

JUNE 4, 2024

Build an umbrella for Development and Operations In modern software engineering, the discipline of platform engineering delivers DevSecOps practices to developers to bridge the gaps between development, security, and operations and enhance the developer experience.

Metrics 222

Metrics Engineering Code Tuning 222

Smashing Magazine

JANUARY 5, 2022

Ten Tips For The Aspiring Designer Beginners (Part 1). Ten Tips For The Aspiring Designer Beginners (Part 1). In this article, I want to share ten tips that helped me grow and become a better designer, and I hope these tips will also help you while you’re trying to find more solid ground under your feet. Luis Ouriach.

Design 127

Design Social Media Website Best Practices 127

SQL Server According to Bob

MARCH 18, 2018

SQL Server is designed to scale across the spectrum of small machines to enterprise class servers. For example, we are always reviewing the Linux package files in order to reduce the size of the package. Bob Dorr – Principal Software Engineer SQL Server. Default Max Worker Threads. What Is A Small System?

Servers 40

Servers Best Practices Software Engineering Operating System 40

SQL Server According to Bob

JUNE 22, 2016

Instead the design of CMemThread was updated. A CMemThread can still be created with designated partitioning. For example, the memory object supporting spatial is created with CPU partitioning by default so partitioning is never adjusted for the spatial memory object. There are several benefits to this design.

Servers 40

Servers Azure Software Engineering Design 40

Smashing Magazine

JUNE 28, 2021

Designing With Code: A Modern Approach To Design. The Rise Of Design Thinking As A Problem Solving Strategy. Drew McLellan: He’s a Senior Software Engineer for an agency called Echobind. But for me, I don’t have design sense. A little bit, but I’m not a designer by any means. Mike on Twitter.

Website 63

Website Design Open Source Software 63

The Netflix TechBlog

FEBRUARY 13, 2024

An example data stream for an A/B test where each observation represents play-delay for the control (left) and treatment (right). For example, one situation we might face is that the median or mean play-delay is the same in treatment and control, but the treatment group experiences an increase in the upper quantiles of play-delay.

Testing 239

Testing Software Software Metrics 239

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 37

AWS Entertainment Open Source Benchmarking 37

SQL Server According to Bob

OCTOBER 17, 2019

The iterator is designed to remain lock free whenever possible to avoid contention with active queries. The next Lock Owner in the example will be Lock Owner #83. Bob Dorr – Principal Software Engineer SQL Server. link] [link]. To accomplish this the iterator uses a marker ( bookmark ) approach and the lock type of NL.

Servers 40

Servers Software Engineering Database Monitoring 40

Testsigma

FEBRUARY 12, 2021

The way we now look at software engineering has revolutionized test automation, with QA teams adapting automation to expand test scope, increase efficiency and do more testing in less time. The tester can find a bug in the specifications, design, or development phase. A tester can detect the error and afterwards address it.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

SQL Performance

APRIL 17, 2020

For example, a value of 255 can fit in one byte for tinyint , but requires two bytes in any of the signed formats. Integer Example. With careful planning, the other steps required can be made as efficient as possible, for example using minimally-logged or ONLINE operations. Be Careful with Syntax. Test2 ; GO. CREATE TABLE dbo.

Servers 63

Servers Database Testing Efficiency 63

SQL Server According to Bob

AUGUST 8, 2016

For example, when your teenager says something is “BAD” they really mean is it GOOD. Take a metal pole as an example. For internal structures SQL Server often applies partitioning designs. For example, SQL Server may employ a per NODE or per CPU based design. COLD, WARM, HOT.

Cache 40

Cache Energy Database Servers 40

ACM Sigarch

FEBRUARY 23, 2018

In his book “ Misbehaving: The Making of Behavioral Economics ”, he cites example after example of how human behavior does not follow economic expectations based on rational behavior, resulting in flawed economic models . We tend to focus more on things that are closer to us in time and experience. Present Bias.

Architecture 47

Architecture Cache Hardware Virtualization 47

SQL Server According to Bob

MARCH 27, 2017

Lets look at a few examples (areas in green represent memory pages included in a capture.). When designing the core-mini dump capabilities we looked at several solutions before landing on Breakpad. For example, Linux provides an madvise ABI, with the option to exclude the region from a dump. Various globals. Module list.

Servers 40

Servers Virtualization Storage Design 40

High Scalability

NOVEMBER 12, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Apply here. Make your job search O (1), not O ( n ). Apply here. Generous free tier.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

OCTOBER 29, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Apply here. Make your job search O (1), not O ( n ). Apply here. Generous free tier.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

OCTOBER 15, 2019

Sisu Data is looking for machine learning engineers who are eager to deliver their features end-to-end, from Jupyter notebook to production, and provide actionable insights to businesses based on their first-party, streaming, and structured relational data. Apply here. Make your job search O (1), not O ( n ). Apply here. Generous free tier.

Education 22

Education Java Engineering Software Engineering 22

SQL Server According to Bob

JUNE 27, 2016

For example, if we had a UI application we would do things like sweep the entire keyboard with our hand to get random key strokes. I have 20+ years of support experience that I am able to bring directly to the designs and implementations. For example, we were designing how to capture a crash dump.

Servers 40

Servers Games Azure Software Engineering 40

The Morning Paper

NOVEMBER 12, 2019

I’m sure that Google engineers do indeed take extreme care when building the low level networking code that powers Google’s datacenters, but their fundamental design point was to enable frequent releases for fast iteration, feedback on their designs, and yes, early detection of problems. If verification fails (e.g.,

Code 45

Code Systems Programming Google 45

High Scalability

JULY 19, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 22

Education Metrics Engineering Java 22

High Scalability

AUGUST 20, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 22

Education Metrics Engineering Java 22

High Scalability

AUGUST 6, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 22

Education Metrics Engineering Java 22

High Scalability

SEPTEMBER 3, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 21

Education Metrics Engineering Java 21

High Scalability

OCTOBER 1, 2019

T riplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 21

Education Metrics Engineering Java 21

High Scalability

SEPTEMBER 17, 2019

Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet.

Education 21

Education Metrics Engineering Java 21