The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. A second job taps the data feed from the first job, does tail sampling of data and writes traces to the storage system.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Morning Paper

JANUARY 30, 2020

Seamless offloading of web app computations from mobile device to edge clouds via HTML5 web worker migration , Jeong et al., Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. in the cloud). SoCC’19 [^1].

Mobile 104

Mobile Cloud Latency Games 104

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? AWS Identity and Access Management brings together on-premises and cloud identity management. Comments ().

Storage 115

Storage AWS Virtualization Cloud 115

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. The first 5G networks are now deployed and operational.

Energy 130

Energy Latency Performance Network 130

Dynatrace

APRIL 26, 2022

With DEM solutions, organizations can operate over on-premise network infrastructure or private or public cloud SaaS or IaaS offerings. It is proactive monitoring that simulates traffic with established test variables, including location, browser, network, and device type. One of the key advantages of DEM is its versatility.

Monitoring 202

Monitoring Social Media IoT Metrics 202

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? For those systems where you provide your own compute instances, the default configuration tested used a 4-node r4.8xlarge cluster with 10Gb/s networking.

Architecture 76

Architecture Cloud Storage Serverless 76

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

JUNE 7, 2017

We have seen that such devices can benefit greatly from the elastic resources of the cloud. Some applications – medical equipment, industrial machinery, and building automation are just a few – can't rely exclusively on the cloud for control, and require some form of local storage and execution. Law of Economics.

AWS 118

AWS IoT Lambda Storage 118

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. A local AWS Region enables companies to deploy a global cloud platform for their operations.

AWS 112

AWS Cloud Games Latency 112

Scalegrid

MARCH 14, 2024

Mastering Hybrid Cloud Strategy Are you looking to leverage the best private and public cloud worlds to propel your business forward? A hybrid cloud strategy could be your answer. This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. Let’s take a closer look at today’s conventional streaming analytics architectures, which can be hosted in the cloud or on-premises.

IoT 78

IoT Analytics Big Data Architecture 78

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Route 53 provides Authoritative DNS functionality implemented using a world-wide network of highly-available DNS servers. This achieves very low-latency for queries which is crucial for the overall performance of internet applications. Expanding the Cloud â??

Cloud 117

Cloud Internet Internet AWS 117

Scalegrid

JANUARY 12, 2024

What is workload in cloud computing? Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. The environments, which were previously isolated, are now working seamlessly under central control.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. Uploading and downloading data always come with a penalty, namely latency. Supporting those workflows poses new challenges to our packaging service.

Cloud 237

Cloud Media Storage Cache 237

O'Reilly

DECEMBER 2, 2019

The most obvious change 5G might bring about isn’t to cell phones but to local networks, whether at home or in the office. High-speed networks through 5G may represent the next generation of cord cutting. Those waits can be significant, even if you’re on a corporate network. What will 5G mean in practice? I don’t, do you?

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Scalegrid

MARCH 28, 2024

can enhance Redis by handling management tasks, backups, and scalability, facilitating global reach and easy cloud integration for global businesses. This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. 3d render.

Cache 130

Cache Storage Scalability Architecture 130

The Morning Paper

JUNE 13, 2019

Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Adrian Cockcroft

APRIL 18, 2018

This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads. In addition, for cloud native applications, a feedback loop is used to auto-scale the application resources based on metrics that report the utilization of current capacity.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Abhishek Tiwari

DECEMBER 27, 2017

portability between cloud and on-premises. faster access to external storage and data locality (I/O, bandwidth). optimised container networking and security. Storage provisioning. But Kubernetes storage is evolving quite quickly. better cluster resource utilization. frictionless multi-tenancy with versioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. This new region, which is located on the West Coast of the US, helps US government agencies and contractors move more of their workloads to the cloud by implementing a number of US government-specific regulatory requirements. Cloud First. Cloud Firstâ?? Comments ().

AWS 111

AWS Government Big Data Cloud 111

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. Every time data spikes - a phenomenon which will be not predictable in most cases - overall latency to process the data using data pipeline will go up.

Latency 63

Latency Analytics Scalability Engineering 63

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " Cloud providers count on this to ease provisioning and fault-tolerance.

Serverless 99

Serverless Storage Latency Cloud 99

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. When a new leader is elected it loads all data from external storage. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 224

Cache Latency Traffic Systems 224

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. This increases the cores and network bandwidth available to serve common requests.

Storage 199

Storage Performance AWS Efficiency 199

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Amazon Simple Storage Service (S3). Dynatrace news.

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Amazon Simple Storage Service (S3). Dynatrace news.

AWS 133

AWS Metrics IoT Storage 133

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. We launched Edge Network locations in Denmark, Finland, Norway, and Sweden. " Hemnet. million unique visitors and 26 million searches made every week.

AWS 124

AWS Cloud Games Serverless 124

O'Reilly Software

APRIL 30, 2018

When designing cloud architecture, it’s critical to consider that your applications could be affected by failures and that you must be prepared to respond to those failures quickly and effectively. Modern hybrid applications typically utilize public cloud components, including content delivery networks and cloud storage.

Cloud 68

Cloud Traffic Internet Internet 68

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Since we were optimizing at the logging level for storage and performance, we had less data and metadata to play with to optimize the query performance.

Storage 187

Storage Design Scalability Latency 187