The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. The original assumptions and architectural choices were no longer viable.

Cache 224

Cache Latency Traffic Systems 224

Scalegrid

JANUARY 8, 2024

Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. Like ScaleGrid’s offerings for multi-cloud architecture compatibility, its solutions are well-suited for use within a single cloud provider or a hybrid cloud setup as well.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Downtime due to SPOFs can also be attributed to bottlenecks from architectures designed for applications instead of databases.

Availability 82

Availability Open Source Architecture Database 82

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. It provides detailed information about memory utilization as well as presenting visual representations of CPU consumption with little effort required from users.

Strategy 130

Strategy Monitoring Latency DevOps 130

All Things Distributed

MAY 19, 2017

It gave us the opportunity to invent a new database architecture that would address to needs of modern cloud-scale applications, departing from the traditional approaches that had their roots in the databases of nineties. In this paper, we describe the architecture of Aurora and the design considerations leading to that architecture.

Database 117

Database Design Cloud Storage 117

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar helps Netflix teams troubleshoot distributed systems efficiently with the help of a summarized presentation of request tracing, logs, analysis, and metadata. While this abundance of dashboards and information is by no means unique to Netflix, it certainly holds true within our microservices architecture. What is Edgar?

Latency 296

Latency Transportation Engineering Traffic 296

The Netflix TechBlog

FEBRUARY 9, 2021

We need to be able to easily determine what imagery is present for a given platform, region, and language. The homepage needs to load in a reasonable amount of time, even in poor network conditions. This requires an asset storage solution. Asset Storage We refer to asset storage and management simply as asset management.

Engineering 165

Engineering Storage Latency Entertainment 165

Percona

JUNE 22, 2023

When planning your database HA architecture, the size of your company is a great place to start to assess your needs. This base architecture keeps the database available for your applications in case the primary node goes down, whether that involves automatic failover in case of a disaster or planned switchover during a maintenance window.

Availability 104

Availability Database Open Source Hardware 104

Dynatrace

MAY 9, 2019

Some time ago, we decided to take a stab at a number of architectural challenges present in the OneAgent installer for Windows. Consequently, each new version of OneAgent for Windows consumed double storage space: one for the *.exe And it added to the network traffic in terms of new version distribution. Dynatrace news.

Storage 115

Storage Tuning Traffic Architecture 115

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Common components of DR and HA architectures By definition, there are differences between high availability (HA) and disaster recovery (DR). It’s suitable for databases with moderate change rates.

Database 85

Database Hardware Open Source Strategy 85

Abhishek Tiwari

NOVEMBER 3, 2018

Case-in-point, most enterprise CMS vendors lack robust full-site content delivery network (CDN) integration. Unfortunately, other than cost advantage Wordpress and Drupal have similar deficiencies i.e. legacy monolith architecture. Most of cloud object/blob storage services have native support for static site hosting.

Systems 63

Systems Cache Website Network 63

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Adrian Cockcroft

APRIL 5, 2023

At the instance level, many CPU and system architectures have direct access to power consumption metrics. Clock rates also change, some ARM architectures include a mixture of high performance and low power cores in the same CPU, and Intel architecture CPUs have hyperthreading, so the performance of an execution thread will vary over time.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. For example: Read/Write tickets WiredTiger uses tickets to control the number of read / write operations simultaneously processed by the storage engine. The report focuses on MySQL, but it is valid for MongoDB as well.

Best Practices 52

Best Practices Design Tuning Database 52

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

Enprowess

JANUARY 12, 2022

Serverless Architecture. Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. The dark mode is a significant consideration of every web development at present. Serverless Architecture. AI-powered Chatbots.

Blockchain 59

Blockchain IoT Development Serverless 59

The Netflix TechBlog

JULY 30, 2019

In this blog, we would like to present the latest updates to Conductor, address some of the frequently asked questions and thank the community for their contributions. Push based task scheduling interface Current Conductor architecture is based on polling from a worker to get tasks that it will execute.

Lambda 189

Lambda Media Open Source Metrics 189

All Things Distributed

JULY 16, 2012

It is shaping up to be a great event with many Amazonians, partners and customers presenting in well over 150 sessions. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega.

AWS 83

AWS Big Data Media Storage 83

Apica

OCTOBER 17, 2022

A typical user journey would include all the actions in a typical human user’s session using a website or application – the screens they are presented with, what objects they click on, and what screens and data payloads are returned. Distracted by distributed, dynamic architectures. Metrics and observability data hoarding.

Retail 52

Retail Website Infrastructure Software Architecture 52

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. As a consequence, the vast majority of the papers in the past has usually focused on conventional X86 or GPU-accelerated architectures.

Architecture 12

Architecture Hardware Cache Storage 12

All Things Distributed

NOVEMBER 29, 2017

As there are few individuals with this expertise, an easier process presents a significant opportunity for companies who want to accelerate their ML usage. In the hosted notebook environment, Amazon SageMaker takes care of establishing secure network connections in your VPC and launching an ML instance.

Tuning 94

Tuning AWS Scalability Infrastructure 94

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. This object-oriented approach allows distributed caches to be viewed as more of an extension of an application’s in-memory data storage than as a separate storage tier.

Cache 52

Cache Storage Servers Database 52

The Symphonia

JUNE 19, 2018

This summer also marks the 4-yearly event that is La Copa Mundial (we only get Telemundo in my apartment, not Fox Sports Network) but since the good old US of A are absent from the men’s World Cup this year, football fever is distinctly frigid. Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage?

Serverless 40

Serverless AWS DevOps Open Source 40

All Things Distributed

APRIL 27, 2011

Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. Service-oriented architecture -- or SOA -- is the fundamental building abstraction for Amazon technologies. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Technology 151

Technology Technology AWS Storage 151

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

APRIL 30, 2018

Apart from networking, attending conferences like LISA in person is an effective way to upgrade your skills: you can block out work interruptions and absorb new knowledge that's been neatly summarized into sessions. Have something to say on the present & future of #ops? Hope to see you in Nashville!

DevOps 43

DevOps Network Best Practices Programming 43

The Morning Paper

MAY 28, 2019

So decision trees are essentially networks of threshold functions. An end-to-end architecture. One such possible representation is pure analog signalling. When it comes to making a decision at a node in the tree, each node has a fixed threshold t , learned during the training phase, against which it compares the input value.

Energy 52

Energy Hardware Efficiency Architecture 52

Brendan Gregg

APRIL 29, 2018

Apart from networking, attending conferences like LISA in person is an effective way to upgrade your skills: you can block out work interruptions and absorb new knowledge that's been neatly summarized into sessions. Have something to say on the present & future of #ops? Hope to see you in Nashville!

DevOps 40

DevOps Network Best Practices Programming 40

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

O'Reilly Software

APRIL 30, 2018

When designing cloud architecture, it’s critical to consider that your applications could be affected by failures and that you must be prepared to respond to those failures quickly and effectively. Modern hybrid applications typically utilize public cloud components, including content delivery networks and cloud storage.

Cloud 68

Cloud Traffic Internet Internet 68

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform, on the other hand, presents a stark contrast.

Open Source 52

Open Source DevOps AWS Infrastructure 52

Alex Russell

JULY 14, 2021

Because they lean on the system-provided WebView component, they do not need to pay the expense of a heavier app download to support rendering HTML, running JavaScript, decoding images, or loading network resources. Apps can customise UI to add deeper integrations, e.g., "pinning" images from a hosted page to Pinterest.

Google 121

Google Mobile Engineering Internet 121

IO River

NOVEMBER 2, 2023

Whether you're scaling storage solutions like S3 buckets, compute resources like EKS clusters, or content delivery mechanisms via CDNs, Terraform offers a streamlined approach. Terraform, on the other hand, presents a stark contrast. Their expertise lies in ensuring everything runs smoothly, from servers to networks.

Open Source 40

Open Source DevOps AWS Infrastructure 40

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs. HotOS’19.

Hardware 58

Hardware Latency Serverless Energy 58

Smashing Magazine

SEPTEMBER 26, 2019

As you can see, however, even though styling for the Vue component tells the subheader to be green, it is entirely off, and the example presents as many as four (but there are really many more) trivial ways of breaking component’s styling. Microservices Architecture. Web Components. Large preview ). Independently deployable.

Architecture 75

Architecture Virtualization Servers Technology 75

Smashing Magazine

JANUARY 11, 2021

Defining The Environment Choosing a framework, baseline performance cost, Webpack, dependencies, CDN, front-end architecture, CSR, SSR, CSR + SSR, static rendering, prerendering, PRPL pattern. Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145