The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

Dynatrace

APRIL 25, 2023

These functions are executed by a serverless platform or provider (such as AWS Lambda, Azure Functions or Google Cloud Functions) that manages the underlying infrastructure, scaling and billing. Higher latency and cold start issues due to the initialization time of the functions. And serverless support is a core capability.

Serverless 213

Serverless Lambda Azure AWS 213

All Things Distributed

NOVEMBER 5, 2015

Yesterday, AWS evangelist Jeff Barr wrote that AWS will be opening a region in South Korea in early 2016 that will be our 5th region in Asia Pacific. The AWS UK region will be our third in the European Union (EU), and we're shooting to have it ready by the end of 2016 (or early 2017).

AWS 167

AWS Retail Entertainment IoT 167

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Scalegrid

NOVEMBER 25, 2019

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. of all ScyllaDB cloud deployments are running on AWS from our survey participants. AWS vs. Azure vs. GCP Click To Tweet.

Big Data 187

Big Data Database Open Source Azure 187

All Things Distributed

JUNE 7, 2017

Unlocking the value of data is a primary goal that AWS helps our customers to pursue. Some applications may also rely on timely decisions: when maneuvering heavy machinery, an absolute minimum of latency is critical. AWS Greengrass provides the following features: Local execution ofAWS Lambda functions written in Python 2.7

AWS 118

AWS IoT Lambda Storage 118

All Things Distributed

SEPTEMBER 29, 2016

Today, I am very excited to announce our plans to open a new AWS Region in France! Based in the Paris area, the region will provide even lower latency and will allow users who want to store their content in datacenters in France to easily do so. Over the past 10 years, we have seen tremendous growth at AWS.

AWS 166

AWS IoT Internet Internet 166

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

All Things Distributed

JANUARY 6, 2016

In November, Amazon Web Services announced that it would launch a new AWS infrastructure region in South Korea. For example, Samsung Electronic Printing used AWS to deploy its Printing Apps Center in a way that didn’t require them to invest up-front capital and kept total costs quite low.

AWS 110

AWS Cloud Games Latency 110

Dynatrace

MAY 17, 2023

It is available for the major OS and cloud platforms (for example, Windows, Linux, Solaris, AWS, Azure, and more) and only requires the deployment of a single service to monitor its environment. Among the usual details, like the top N errors and pages, we’ll find here the two main areas for performance analysis and user behavior.

Metrics 176

Metrics Monitoring Database Network 176

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN303 BPF performance analysis (repeats) Learn how Netflix uses eBPF to create powerful performance analysis tools. Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN303 BPF performance analysis (repeats) Learn how Netflix uses eBPF to create powerful performance analysis tools. Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis.

Speed 126

Speed Java AWS Virtualization 126

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. Data lakehouses deliver the query response with minimal latency. Agent and open technologies make it easy to ingest large volumes of observability, security, and business data. Data management.

Artificial Intelligence 214

Artificial Intelligence Storage Analytics Government 214

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 140

Performance Latency Hardware Storage 140

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

The Netflix TechBlog

SEPTEMBER 24, 2021

Uploading and downloading data always come with a penalty, namely latency. Figure 3: Video Processing with Index and Virtual Assembly Using virtual assembly greatly improves the latency performance of the ProRes 422 HQ proxy generation by removing one round trip of cloud downloading and cloud uploading by the physical assembler.

Cloud 237

Cloud Media Storage Cache 237

Dynatrace

AUGUST 27, 2019

The Dynatrace all-in-one software intelligence platform gives your team real-time visibility into your underlying infrastructure —be it on bare metal, VMware, OpenStack, AWS, Azure, or a hybrid solution. Step 5 – xMatters triggers a runbook in Ansible to fix the disk latency. xMatters creates a dedicated Slack channel.

Systems 177

Systems DevOps Latency Azure 177

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. AWS has invested in optimizing Ethernet for HPC via the Elastic Fabric Adaptor (EFA) option, and the l ibfabric library.

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

JULY 10, 2019

OneAgents are optimized to send data to the Dynatrace servers with the smallest possible impact, querying the metrics every minute, and the data is a first-class citizen for the Dynatrace AI root-cause analysis. Dynatrace provides out-of-the-box support for VMware, AWS, Azure, Pivotal Cloud Foundry, and Kubernetes.

Java 140

Java Best Practices Metrics Azure 140

Scalegrid

JANUARY 8, 2024

Artificial intelligence can automate tasks ranging from: data analysis resource provisioning system maintenance decision-making natural language processing This not only improves accuracy and reliability but also frees up valuable time for IT teams to focus on strategic tasks, such as resource management on platforms like Google Cloud.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values. The opposite is true.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

FEBRUARY 18, 2022

Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies. Event Priority Based Clusters AWS Instance Clusters that subscribe to the corresponding queues with the same priority.

Systems 334

Systems Traffic Architecture Mobile 334

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

MAY 8, 2021

There are also cases where I can't tell either: The tools only provide clues for further analysis. An average of 434 ms is awful, and a small queue size (aqu-sz) indicates it's a problem with the disk and not the workload applied. Analysis is similar whether the disk is rotational magnetic or flash-memory based.

Performance 142

Performance Latency Speed Systems 142

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis.

Speed 52

Speed Java AWS Virtualization 52

The Netflix TechBlog

AUGUST 16, 2023

An even distribution of traffic to origins is critical for accurate canary analysis and preventing hot-spotting of traffic on origin instances. Each of the 3 colors represents our deployment regions in AWS, and the blue vertical line shows when we turned on the feature.

Traffic 170

Traffic Servers Google Metrics 170

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Scalegrid

JANUARY 12, 2024

Key Takeaways A cloud workload encompasses any application or service running on a cloud infrastructure, facilitating tasks ranging from basic functions to advanced data analysis with the help of resources like databases, collaboration tools, and disaster recovery systems. Additionally.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

The Netflix TechBlog

AUGUST 13, 2020

It usually has dependencies, talks to other services, and lives in different AWS regions. For example, a latency increase is less critical than error rate increase and some error codes are less critical than others. An application lives in an ecosystem The Application Health Model A microservice doesn’t live in isolation.

Monitoring 210

Monitoring Tuning Traffic Metrics 210

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. This was a weird problem to think about: Time itself had now become a resource and target of performance analysis. I'm including this step as a reminder for anyone following this kind of analysis.

Speed 40

Speed Java AWS Virtualization 40

Smashing Magazine

AUGUST 3, 2023

Large preview ) Storing Data In BigQuery For Comprehensive Analysis Once we capture the Web Vitals metrics, we store this data in BigQuery , Google Cloud’s fully-managed, serverless data warehouse. Addressing Many Pages With Rare Visits Adopting the AWS CloudFront CDN significantly improved our website’s performance. LCP in seconds.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

AUGUST 20, 2015

Similarly, relationships are essential in many other use cases such as financial modeling, risk analysis, genome research, search, gaming, and others. When using relational databases, traversing relationships requires expensive table JOIN operations, causing significantly increased latency as table size and query complexity grow.

Database 134

Database Logistics Availability Social Media 134