The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Without cloud-based rendering, this ambitious project would not have met its targeted delivery date!

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 56

Hardware Latency Virtualization Cloud 56

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error.

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

DECEMBER 20, 2017

Developments like cloud computing, the internet of things, artificial intelligence, and machine learning are proving that IT has (again) become a strategic business driver. Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Troy: We moved our service from internal servers to AWS. How are your users adopting and responding to your service?

Innovation 146

Innovation AWS Education Network 146

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers. Public sector.

AWS 124

AWS Cloud Games Serverless 124

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111

Dynatrace

AUGUST 11, 2022

Effective application development requires speed and specificity. Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. Dynatrace news. What is FaaS?

Development 244

Development Serverless Best Practices Lambda 244

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 52

Speed Java AWS Virtualization 52

Testsigma

MAY 19, 2021

DevOps and cloud-based computing have existed in our life for some time now. Today, we are here to talk about the successful amalgamation of DevOps and cloud-based technologies that is amazing in itself. Why Opt For Cloud-Based Solutions and DevOps? Cloud-based solutions are extremely fast when combined with DevOps.

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

All Things Distributed

OCTOBER 7, 2015

In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. QuickSight is a fast, cloud native, scalable, business intelligence service for the 1/10th the cost of old-guard BI solutions.

Cloud 137

Cloud Big Data AWS Analytics 137

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? We ended up setting it in the BaseAMI for all cloud services. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes.

Analytics 202

Analytics Monitoring Artificial Intelligence DevOps 202

Dynatrace

NOVEMBER 22, 2022

But as more organizations adopt cloud-native technologies and distribute workloads among multicloud environments, that goal seems harder to attain. In fact, a recent survey found that many cloud applications are vulnerable to outages , despite growing confidence in cloud platforms and services.

Infrastructure 177

Infrastructure Availability Systems Retail 177

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum can run on any Linux server, whether it is hosted in the cloud or on-premise, and can run in any environment. What Exactly is Greenplum? over Greenplum 5.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. Following the innovation of microservices, serverless computing is the next step in the evolution of how applications are built in the cloud. Azure Functions in a nutshell.

Serverless 232

Serverless Azure Monitoring Lambda 232

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. Cloud-based development and deployment One of the main advantages of cloud-based development and deployment is scalability.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. Following the innovation of microservices, serverless computing is the next step in the evolution of how applications are built in the cloud. Azure Functions in a nutshell.

Serverless 140

Serverless Azure Monitoring Lambda 140

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. This is an area where cloud providers already bear much of the burden, and will continue to bear it in the future.

Open Source 111

Open Source Artificial Intelligence Google Infrastructure 111

Smashing Magazine

SEPTEMBER 3, 2021

It can be hard to visualize the huge network of hardware that allows you to send a request for a page to a server and then receive a response back. The good news is that, as developers, we can do an awful lot about it. As a result of this, my view of the Internet for a long time was a little ephemeral, a sort of mirage. Taking Action.

Website 136

Website Energy Internet Internet 136

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. The key question we keep getting from our customers is: How can Dynatrace help me reduce risk, move faster and achieve a better business outcome for my cloud migration project?

Cloud 31

Cloud Traffic Database Network 31

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Percona

JULY 26, 2023

As with any database, developers and DBAs working with MongoDB should look at how to optimize the performance of their database, especially nowadays with cloud services, where each byte processed, transmitted, and stored costs money. If something happens to the primary node, the replica set will elect a secondary as the new primary.

Database 78

Database Servers Storage Strategy 78

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). The way the cloud is used helps with security: most instances at my employer have only been up for one or two days.

Virtualization 76

Virtualization AWS Engineering Hardware 76

All Things Distributed

NOVEMBER 15, 2016

QuickSight is a very fast, cloud-powered, business intelligence service for the 1/10th the cost of old-guard BI solutions. As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure.

Analytics 152

Analytics Availability Media Social Media 152

Smashing Magazine

JANUARY 11, 2021

You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Note : If you use Page Speed Insights or Page Speed Insights API (no, it isn’t deprecated!),

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Start Render time, Speed Index ). Treo Sites provides competitive analysis based on real-world data.

Performance 145

Performance Cache Network Metrics 145

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Migration to cloud. Cloud Platform. Google cloud.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 7, 2019

You need a business stakeholder buy-in, and to get it, you need to establish a case study on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Note : If you use Page Speed Insights (no, it isn’t deprecated), you can get CrUX performance data for specific pages instead of just the aggregates.

Performance 104

Performance Cache Metrics Network 104