The Morning Paper

FEBRUARY 16, 2020

Migrating a privacy-safe information extraction system to a software 2.0 design , Sheng, CIDR’20. This is a comparatively short (7 pages) but very interesting paper detailing the migration of a software system to a ‘Software 2.0’ ’ design. traditional software) to a Software 2.0

Systems 84

Systems Design Software Software 84

Dynatrace

NOVEMBER 14, 2023

For example, how much does a reduction in MTTR impact revenue? Customer empathy is key to a fully optimized site reliability engineering practice Software engineering can often be an impersonal discipline. Generative AI and the future of site reliability engineering “AI is not new in the APM world,” reminded Aguiar.

Best Practices 188

Best Practices Engineering DevOps Software Engineering 188

The Netflix TechBlog

NOVEMBER 9, 2021

The Android launch leveraged the open-source software decoder dav1d built by the VideoLAN, VLC, and FFmpeg communities and sponsored by AOMedia. While software decoders enable AV1 playback for more powerful devices, a majority of Netflix members enjoy their favorite shows on TVs.

Media 246

Media Open Source Efficiency Software Engineering 246

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. Another key theme at Dynatrace Perform 2024 is organizations’ growing adoption of platform engineering , which helps accelerate the delivery of software applications.

Performance 182

Performance DevOps Innovation Artificial Intelligence 182

Dynatrace

JANUARY 18, 2023

According to recent Dynatrace research , organizations expect to make software updates 58% more frequently in the coming year. DevOps and DevSecOps practices help organizations release software faster and more frequently, paving the way for digital transformation. Site reliability engineers, or SREs, lead these efforts.

DevOps 194

DevOps Best Practices Innovation Strategy 194

The Netflix TechBlog

FEBRUARY 1, 2022

The interview panel consists of two or three engineers, a hiring manager and a recruiter. The engineers assess your technical skills by asking you to solve various design and coding problems. The interview panel comprises an engineering director, a partner engineer or manager, and another engineering leader.

Engineering 199

Engineering Games Entertainment Innovation 199

Dynatrace

NOVEMBER 22, 2021

EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. AWS Lambda makes it easy to design, run, and maintain application systems without having to provision or manage infrastructure. Here are a few of the most popular. Amazon EC2. Amazon Fargate.

Best Practices 208

Best Practices AWS Monitoring Serverless 208

Strategic Tech

AUGUST 26, 2018

A trip to the supermarket can teach you a lot about designing software systems and shaping teams to build them… I was recently in need of some chocolate sauce. The Chocolate Sauce Heuristic for Software Design There are a few lessons about software development we can learn from this story, but I want to focus on design.

Design 40

Design Software Architecture Architecture Software 40

O'Reilly Software

SEPTEMBER 7, 2018

From chaos architecture to event streaming to leading teams, the O'Reilly Software Architecture Conference offers a unique depth and breadth of content. We received more than 200 abstracts for talks for the 2018 O'Reilly Software Architecture Conference in London—on both expected and surprising topics. How will you handle it?"

Software Architecture 64

Software Architecture Architecture Software Software 64

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

JUNE 1, 2021

Interview with Samuel Setegne Samuel Setegne This post is part of our “Data Engineers of Netflix” interview series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Samuel Setegne is a Senior Software Engineer on the Core Data Science and Engineering team.

Data Engineering 130

Data Engineering Engineering Big Data Healthcare 130

Strategic Tech

JANUARY 22, 2024

To demonstrate this process, we will build a canvas for the following fictitious example (inspired by real examples from our consulting work): A large logistics company wants to expand into new verticals and integrate its offerings into an emerging open marketplace. They are targeting 3–5x revenue growth in the next 5 years.

Architecture 98

Architecture Metrics Logistics Strategy 98

The Netflix TechBlog

OCTOBER 27, 2021

Requirements for a Metaflow GUI Metaflow is a human-centered system by design. Based on our experiences with other GUIs operating at Netflix-scale, this is not a trivial requirement: scalability needs to be baked into the design from the very beginning. For example, Netflix has its container orchestration platform called Titus.

Open Source 222

Open Source Monitoring Scalability Code 222

Strategic Tech

AUGUST 14, 2021

There’s an aspect of Domain-Driven Design that rarely gets talked about. I think it’s the most important aspect of DDD, yet if you search online for “Domain-Driven Design”, you won’t find it. Our project was to build software to track and support this whole process. This treasure has been hiding in plain sight all along.

Design 52

Design Software Engineering Innovation Engineering 52

SQL Server According to Bob

SEPTEMBER 9, 2019

Previous posts have discussed partitioning, for example, a partitioned memory object [link] and how a latch maintains the desired access (exclusive, shared, …) [link]. The lock manager (LockMgr) is designed to track partitioned and non-partitioned locks. Bob Dorr – Principal Software Engineer SQL Server.

Servers 103

Servers Database Scalability Tuning 103

Dynatrace

JANUARY 19, 2021

For example, Amazon Alexa extensions are implemented as AWS Lambda functions. For example, they’re highly dynamic and often short-lived, which makes it difficult to identify issues and find their root causes before they impact business revenue or customer experience. – Robert Trueman, Head of Software Engineering at CDL.

Lambda 205

Lambda Serverless AWS Mobile 205

Strategic Tech

FEBRUARY 19, 2020

I’ve been disappointed for a long time with the way in which companies organise software development teams. I remember as a young, naive software developer, I assumed there would be structured processes and patterns similar to those used for designing a software architecture. There are too many variables involved.

Architecture 64

Architecture Strategy Design Software Architecture 64

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. Enter Google! Emphasis mine). This rules out a ‘library’ approach.

Network 92

Network Transportation Latency Entertainment 92

Strategic Tech

NOVEMBER 1, 2021

The 2010s were a turning-point in the history of software engineering. or “How do software architecture, domains, Conway’s Law, Team Topologies, and value streams all fit together?”. At the start of the decade, Eric Ries disrupted traditional approaches to building digital products with The Lean Startup.

Software Architecture 98

Software Architecture Architecture DevOps Software 98

Strategic Tech

JANUARY 19, 2020

How we spend our time and apply our resources when developing software systems is possibly the most fundamental and difficult challenge. A natural tendency for software engineers is to gravitate towards the most technically interesting challenges. An example of a commoditised core is a search engine.

Open Source 87

Open Source Games Innovation Strategy 87

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Engineering decisions involve making lots of trade-offs. Millions of tiny databases , Brooker et al.,

Database 106

Database AWS Network Design 106

Abhishek Tiwari

JULY 20, 2019

One thing stand-out to me is being intentional and practical about your engineering organisation design. First and foremost, being intentional about organisation design requires good and honest discussions about all possible option. Let's take an example of retail as a domain of interest. You want to move fast.

Engineering 61

Engineering Retail Airlines Healthcare 61

ACM Sigarch

APRIL 8, 2019

For example, the existence and support of open-source frameworks such as LLVM or Tensorflow/Pytorch are an attractive element to many newcomers. Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Lena Olson is a Software Engineer at Google. .

Architecture 74

Architecture Open Source Hardware Software Engineering 74

O'Reilly

MAY 19, 2020

Software engineers represent the largest cohort, comprising almost 20% of all respondents (see Figure 1 ). Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Almost one-quarter (23%) of respondents work in the software industry ( Figure 3 ). Respondent Demographics.

Cloud 141

Cloud Serverless AWS Architecture 141

The Netflix TechBlog

FEBRUARY 13, 2024

These observations are from a particular type of A/B test that Netflix runs called a software canary or regression-driven experiment. An example data stream for an A/B test where each observation represents play-delay for the control (left) and treatment (right).

Testing 239

Testing Software Software Metrics 239

Strategic Tech

FEBRUARY 16, 2022

It seems unrealistic wanting the best of both world (speed and reliability) but the field of software engineering established during the past decade that speed and reliability can both be achieved. A good engineering organization moves at speed with high reliability. It doesn’t need to be a choice of one over the other.

Innovation 52

Innovation Speed Google Strategy 52

The Morning Paper

JANUARY 21, 2020

Routing, for example, is non-deterministic. In summary, software engineers find themselves in a very unenviable position when attempting to resolve an outage with their service. Preventative design is not enough. Business-critital Internet systems inherit all of the challenges of distributed systems.

Internet 98

Internet Internet Strategy Energy 98

The Morning Paper

NOVEMBER 21, 2019

It’s easy to make experimental design mistakes that invalidate your online controlled experiments. PlanAlyzer acts a bit like a linter for online experiment designs, where those designs are specified in the PlanOut language. Experimental design with PlanOut. What can go wrong in experiment design?

Programming 52

Programming Internet Internet Design 52

SQL Server According to Bob

JUNE 3, 2016

The new column store engine and query processing technology could increase query performance up to 100X and the new In-memory OLTP engine can process 1.25million batches/sec on a single 4 socket server, which is more than 3X of SQL 2014. “ – Rohan Kumar, Director of SQL Software Engineering. Auto-soft NUMA.

Hardware 40

Hardware Software Engineering Transportation Scalability 40

Testsigma

FEBRUARY 12, 2021

The way we now look at software engineering has revolutionized test automation, with QA teams adapting automation to expand test scope, increase efficiency and do more testing in less time. Test Automation is a software testing method that uses automatic methods to carry out a test case collection. Fast Feedback.

Testing 54

Testing Testing Tools Software Engineering Efficiency 54

Smashing Magazine

JUNE 28, 2021

Designing With Code: A Modern Approach To Design. The Rise Of Design Thinking As A Problem Solving Strategy. Drew McLellan: He’s a Senior Software Engineer for an agency called Echobind. But for me, I don’t have design sense. A little bit, but I’m not a designer by any means. Mike on Twitter.

Website 62

Website Design Open Source Software 62

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. Wednesday?—?December Thursday?—?December

AWS 37

AWS Entertainment Open Source Benchmarking 37

SQL Server According to Bob

MARCH 18, 2018

SQL Server is designed to scale across the spectrum of small machines to enterprise class servers. For example, we are always reviewing the Linux package files in order to reduce the size of the package. Bob Dorr – Principal Software Engineer SQL Server. Default Max Worker Threads. What Is A Small System?

Servers 40

Servers Best Practices Software Engineering Operating System 40

SQL Server According to Bob

JANUARY 31, 2017

On Linux the capabilities are called “ Vectored I/O.” – Example writev SQL Server on Linux takes full advantage of vectored I/O, retaining the performance and design benefits. Bob Dorr – Principal Software Engineer SQL Server. Scatter/gather is not limited to the Windows platform. On Linux there is one small twist.

Servers 40

Servers Software Engineering Operating System Database 40

SQL Server According to Bob

JUNE 22, 2016

Instead the design of CMemThread was updated. A CMemThread can still be created with designated partitioning. For example, the memory object supporting spatial is created with CPU partitioning by default so partitioning is never adjusted for the spatial memory object. There are several benefits to this design.

Servers 40

Servers Azure Software Engineering Design 40

The Morning Paper

JULY 9, 2019

Last time out we looked at machine learning at Microsoft , where we learned among other things that using an online controlled experiment (OCE) approach to rolling out changes to ML-centric software is important. Online Controlled Experiments (OCEs) are becoming a standard operating procedure in data-driven software companies.

Metrics 42

Metrics Design Testing Software 42