The Netflix TechBlog

JUNE 14, 2023

By Jennifer Shin , Tejas Shikhare , Will Emmanuel In 2022, a major change was made to Netflix’s iOS and Android applications. We migrated Netflix’s mobile apps to GraphQL with zero downtime, which involved a total overhaul from the client to the API layer. Until recently, an internal API framework, Falcor , powered our mobile apps. They are now backed by Federated GraphQL , a distributed approach to APIs where domain teams can independently manage and own specific sections of the API.

Testing 360

Testing Servers Traffic Cache 360

DZone

JUNE 20, 2023

Applications nowadays are distributed as microservices all over the cloud. Organizations use Kubernetes to manage these applications at scale, which has brought great flexibility and agility for development teams. However, microservices and multicloud applications have given rise to new challenges. Now, it is harder to configure communication between distributed services and secure the data in transit.

Cloud 352

Cloud Development 352

CSS Wizardry

JUNE 30, 2023

Honestly, I started writing this article, for no real reason and somewhat without context, in December 2022—over half a year ago! But, I left it in _drafts/ until today, when a genuinely compelling scenario came up that gives real opportunity for explanation. It no longer feels like trivia-for-the-sake-of-it thanks to a recent client project. I never thought I’d write an article in defence of DOMContentLoaded , but here it is… For many, many years now, performance engineers have been making a co

Metrics 320

Metrics Code Monitoring Performance 320

Dynatrace

JANUARY 16, 2023

Kubernetes adoption survey executive summary. Modern, cloud-native computing is impossible to separate from containers and Kubernetes adoption. While Kubernetes is still a relatively young technology, a large majority of global enterprises use it to run business-critical applications in production. The rapid adoption is driven—and challenged by—an ever-growing ecosystem of Kubernetes technologies that add advanced platform features, such as security, microservice communications, observability, s

Java 332

Java Open Source Cache Database 332

High Scalability

FEBRUARY 22, 2023

This is a guest article by NK. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work?

Virtualization 318

Virtualization Website Performance 318

All Things Distributed

APRIL 27, 2023

Developer tools are one area where generative AI is already having a tangible impact on productivity and speed, and it's the reason I'm excited about Amazon CodeWhisperer.

Development 184

Development Code Speed 184

Sutter's Mill

JUNE 17, 2023

Minutes ago, the ISO C++ committee finished its meeting in-person in Varna, Bulgaria and online via Zoom, where we formally began adopting features into C++26. Our hosts, VMware and Chaos, arranged for high-quality facilities for our six-day meeting from Monday through Saturday. We had over 170 attendees, about two-thirds in-person and the others remote via Zoom, formally representing 20 nations.

C++ 145

C++ Code Testing Development 145

Percona

MAY 10, 2023

I have seen many Linux Performance engineers looking at the “IOWait” portion of CPU usage as something to indicate whenever the system is I/O-bound. In this blog post, I will explain why this approach is unreliable and what better indicators you can use. Let’s start by running a little experiment – generating heavy I/O usage on the system: sysbench --threads=8 --time=0 --max-requests=0 fileio --file-num=1 --file-total-size=10G --file-io-mode=sync --file-extra-flags=direct

Cache 141

Cache Monitoring Database Systems 141

InfoQ

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Systems 145

Systems Design Storage Scalability 145

Brendan Gregg

APRIL 27, 2023

eBPF has many uses in improving computer security, but just taking eBPF observability tools as-is and using them for security monitoring would be like driving your car into the ocean and expecting it to float. Observability tools are designed have the lowest overhead possible so that they are safe to run in production while analyzing an active performance issue.

Monitoring 141

Monitoring Open Source Engineering Systems 141

The Netflix TechBlog

JUNE 1, 2023

By Jose Fernandez , Ed Barker , Hank Jacobs Introduction In November 2022, we introduced a brand new tier —  Basic with ads. This tier extended existing infrastructure by adding new backend components and a new remote call to our ads partner on the playback path. As we were gearing up for launch, we wanted to ensure it would go as smoothly as possible.

Traffic 353

Traffic Testing Systems Infrastructure 353

DZone

FEBRUARY 17, 2023

If you use Windows, you will want to monitor Windows Events. A recent contribution of a distribution of the OpenTelemetry (OTel) Collector makes it much easier to monitor Windows Events with OpenTel. You can utilize this receiver either in conjunction with any OTel collector: including the OpenTelemetry Collector. In this article, we will be using observIQ’s distribution of the collector.

Monitoring 358

Monitoring Operating System Cloud Google 358

CSS Wizardry

SEPTEMBER 28, 2023

At the time of writing, 99.9% of pages on the web include at least one image. The median image-weight per page landed at 881KB in 2022 , which is more than HTML, CSS, JS, and fonts combined! And while images do not block rendering (unless you do something silly ), it’s important to consider how we offer a reasonably pleasant experience while users are waiting for images to load.

Games 233

Games Cache Systems Ecommerce 233

Dynatrace

SEPTEMBER 8, 2023

In part 1 of this blog series , we explored the concept of business observability, its significance, and how real-time visibility aids in making informed decisions. In part 2, we’ll show you how to retrieve business data from a database, analyze that data using dashboards and ad hoc queries, and then use a Davis analyzer to predict metric behavior and detect behavioral anomalies.

Database 258

Database Monitoring Metrics Artificial Intelligence 258

Particular Software

SEPTEMBER 11, 2023

Migrating a message-based system from on-premises to the cloud is a colossal undertaking. If you search for “how to migrate to the cloud”, there are reams of articles that encourage you to understand your system, evaluate cloud providers, choose the right messaging service, and manage security and compliance. Curiously, what’s often missing from the discussion is details , like how to handle all the other on-prem systems that integrate with your system, both upstream and downstream, that can’t b

Cloud 126

Cloud Azure Systems Mobile 126

All Things Distributed

JUNE 29, 2023

As we are about to start the planning meetings for 2024 at AWS, I’ve been thinking a lot about how I take notes.

AWS 214

AWS 214

O'Reilly

SEPTEMBER 12, 2023

A few weeks ago, I saw a tweet that said “Writing code isn’t the problem. Controlling complexity is.” I wish I could remember who said that; I will be quoting it a lot in the future. That statement nicely summarizes what makes software development difficult. It’s not just memorizing the syntactic details of some programming language, or the many functions in some API, but understanding and managing the complexity of the problem you’re trying to solve.

Software 125

Software Software Development Code 125

tRPC

JANUARY 16, 2023

Ever wondered how tRPC works? Maybe you want to start contributing to the project but you're frightened by the internals? The aim of this post is to familiarize you with the internals of tRPC by writing a minimal client that covers the big parts of how tRPC works. info It's recommended that you understand some of the core concepts in TypeScript such as generics, conditional types, the extends keyword and recursion.

Servers 138

Servers Code Database Testing 138

Adrian Cockcroft

FEBRUARY 9, 2023

Picture by Adrian — Ka’anapali sunset 2023 There’s been a lot of discussion about platforms recently, I talked about why I think it’s a current hot meme on the WTF Podcast with Charles Humble recently, and Sam Newman just wrote a blog post “ Don’t call it a platform ”. What I want to cover in this blog post is how I think platforms should be structured, and why it’s always plural, there isn’t one platform or one platform team.

Engineering 137

Engineering Serverless AWS Lambda 137

InfoQ

SEPTEMBER 25, 2023

When it comes to deploying Large Language Models (LLMs) in production, the two major challenges originate from the huge amount of parameters they require and the necessity of handling very long input sequences to represent contextual information. Hugging Face has documented a list of techniques to tackle those hurdles based on their experience serving such models.

Scalability 120

Scalability Data Engineering Performance Engineering 120

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? It has always bothered me that “out-of-the-box” MySQL performance is subpar: if you install MySQL or Percona Server for MySQL in a new server and do not “tune it” (as in change default values for configuration settings), it just won’t be able to make the best use of the serve

Cache 132

Cache Servers Tuning Database 132

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. Behind the scenes, a myriad of systems and services are involved in orchestrating the product experience.

Traffic 351

Traffic Latency Testing Servers 351

DZone

FEBRUARY 27, 2023

Kubernetes is an open-source container orchestration platform that helps manage and deploy applications in a cloud environment. It is used to automate the deployment, scaling, and management of containerized applications. It is an efficient way to manage application health with Kubernetes probes. This article will discuss Kubernetes probes, the different types available, and how to implement them in your Kubernetes environment.

Open Source 356

Open Source Cloud Monitoring Efficiency 356

CSS Wizardry

JULY 23, 2023

Google’s Core Web Vitals initiative was launched in May of 2020 and, since then, its role in Search has morphed and evolved as roll-outs have been made and feedback has been received. However, to this day, messaging from Google can seem somewhat unclear and, in places, even contradictory. In this post, I am going to distil everything that you actually need to know using fully referenced and cited Google sources.

Engineering 245

Engineering Google Speed Metrics 245

Dynatrace

SEPTEMBER 5, 2023

Technology and operations teams work to ensure that applications and digital systems work seamlessly and securely. They handle complex infrastructure, maintain service availability, and respond swiftly to incidents. But when these teams work in largely manual ways, they don’t have time for innovation and strategic projects that might deliver greater value.

DevOps 252

DevOps Artificial Intelligence Engineering Analytics 252

Speed Curve

MARCH 5, 2023

"I made my pages faster, but my business and user engagement metrics didn't change. WHY???" "How do I know how fast my pages should be?" "How can I demonstrate the business value of performance to people in my organization?" If you've ever asked yourself any of these questions, then you could find the answers in identifying and understanding the performance poverty line for your site.

Performance 128

Performance Metrics C++ Monitoring 128

All Things Distributed

SEPTEMBER 1, 2023

It is time to celebrate EC2-Classic, which defined early cloud computing, and which is finally retiring.

Cloud 202

Cloud 202

O'Reilly

JANUARY 17, 2023

What would you say is the job of a software developer? A layperson, an entry-level developer, or even someone who hires developers will tell you that job is to … well … write software. Pretty simple. An experienced practitioner will tell you something very different. They’d say that the job involves writing some software, sure. But deep down it’s about the purpose of software.

Code 131

Code Software Software AWS 131

Sutter's Mill

SEPTEMBER 28, 2023

Since the 2022-12-31 year-end mini-update and the 2023-04-30 spring update , progress has continued on cppfront. (If you don’t know what this personal project is, please see the CppCon 2022 talk on YouTube for an overview, and the CppNow 2023 talk on YouTube for an interim update.) I’ll be giving a major update next week at CppCon. I hope to see many of you there!

C++ 100

C++ Code Cache Testing 100

Alex Russell

FEBRUARY 3, 2023

For most of the past decade, I have spent a considerable fraction of my professional life consulting with teams building on the web. It is not going well. Not only are new services being built to a self-defeatingly low UX and performance standard, existing experiences are pervasively re-developed on unspeakably slow, JS-taxed stacks. At a business level, this is a disaster, raising the question: "why are new teams buying into stacks that have failed so often before?

Latency 121

Latency Servers Development Performance 121

InfoQ

SEPTEMBER 11, 2023

LinkedIn developed a new open-source service called "iris-message-processor" to enhance the performance and reliability of its existing Iris escalation management system. "iris-message-processor" significantly improves processing speeds, being ~4.6x faster under average loads and ~86.6x faster under high loads than its predecessor.

Open Source 123

Open Source Speed Performance Systems 123

Percona

JUNE 14, 2023

A few days ago, Heikki Linnakangas posted a message in the PostgreSQL mailing list titled “Let’s make PostgreSQL multi-threaded.” This topic got quite a discussion on Hacker News too. The poll I’ve done on Twitter shows there is great interest in this topic and overwhelming support for such an effort! Should PostgreSQL become multi-threaded ?

Architecture 126

Architecture Operating System Database Performance 126

The Netflix TechBlog

MARCH 14, 2023

By Guru Tahasildar , Amir Ziai , Jonathan Solórzano-Hamilton , Kelli Griggs , Vi Iyengar Introduction Netflix leverages machine learning to create the best media for our members. Earlier we shared the details of one of these algorithms , introduced how our platform team is evolving the media-specific machine learning ecosystem , and discussed how data from these algorithms gets stored in our annotation service.

Media 304

Media Innovation Architecture Systems 304

DZone

FEBRUARY 23, 2023

In the past few years, there has been a growing number of organizations and developers joining the Docker journey. Containerization simplifies the software development process because it eliminates dealing with dependencies and working with specific hardware. Nonetheless, the biggest advantage of using containers is down to the portability they offer.

Cloud 354

Cloud Lambda AWS Azure 354

Official Blog - World Web Technology

SEPTEMBER 22, 2023

In the digital landscape of business, B2B ecommerce has arisen as a diligent force, changing the way enterprises run commerce and foster shift. To take this prospect, dedicated B2B commerce solutions and masterful B2B marketplace development services are necessary. Let’s find out how these services can open new possibilities for maturing for B2B enterprises.

Ecommerce 102

Ecommerce Development Efficiency Monitoring 102

Dynatrace

MARCH 14, 2023

Dynatrace is proud to be an AWS launch partner in support of Amazon Linux 2023 (AL2023). Amazon’s new general-purpose Linux for AWS is designed to provide a secure, stable, and high-performance execution environment to develop and run cloud applications. The Dynatrace Software Intelligence Platform accelerates cloud operations, helping organizations achieve service-level objectives (SLOs) with automated intelligence and unmatched scalability.

AWS 268

AWS Lambda Serverless Servers 268

Randon ASCII

JANUARY 17, 2023

I tend to launch most programs on my Windows 10 laptop by typing the <Win> key, then a few letters of the program name, and then hitting enter. On my powerful laptop (SSD and 32 GB of RAM) this process usually takes as long as it takes me to type these characters, just a fraction of a second. Usually. Sometimes, however, it takes longer. A lot longer.

Processing 114

Processing Performance Programming Code 114