The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226

Systems Media Cache Open Source 226

All Things Distributed

MARCH 27, 2019

At re:Invent 2018, AWS announced the AWS App Mesh public preview, a service mesh that allows you to easily monitor and control communications across applications. Today, I'm happy to announce that App Mesh is generally available for use by customers. New architectural patterns.

AWS 137

AWS Traffic Innovation Architecture 137

All Things Distributed

NOVEMBER 12, 2018

Today, I'm happy to announce that the AWS GovCloud (US-East) Region, our 19th global infrastructure Region, is now available for use by customers in the US. It is accessible only to vetted US entities and AWS account root users, who must confirm that they are US citizens or US permanent residents.

AWS 117

AWS Healthcare Cloud Government 117

High Scalability

APRIL 16, 2019

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability.

Availability 149

Availability Network Azure AWS 149

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. Generally speaking, cloud migration involves moving from on-premises infrastructure to cloud-based services.

Cloud 165

Cloud Traffic Best Practices Strategy 165

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Scalegrid

JANUARY 8, 2024

AI-driven cloud solutions like ScaleGrid offer a diverse range of database hosting options, robust infrastructure optimized for scalability and security, and enable significant cost reductions, supporting businesses in efficient growth and improved ROI.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

APRIL 11, 2018

Last year at re:Invent, we launched AWS Fargate , and today, I want to explore how Fargate fundamentally changes the landscape of container technology. Containers solve a fundamental code portability problem and enable new infrastructure patterns on the cloud. This is the vision behind AWS Fargate.

Cloud 148

Cloud AWS Innovation Traffic 148

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Dynatrace

NOVEMBER 22, 2022

For retail organizations, peak traffic can be a mixed blessing. While high-volume traffic often boosts sales, it can also compromise uptimes. The nirvana state of system uptime at peak loads is known as “five-nines availability.” But is five nines availability attainable? What is always-on infrastructure?

Infrastructure 182

Infrastructure Availability Systems Retail 182

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications.

Cloud 145

Cloud AWS Traffic Latency 145

Abhishek Tiwari

JULY 8, 2023

Monitoring, on the other hand, was conducted post-release to continuously observe and measure system performance, identify bottlenecks, and ensure availability. The term "synthetic" is used because it does not rely on traffic generated by real clients and end-users.

Monitoring 52

Monitoring Testing Artificial Intelligence Traffic 52

The Netflix TechBlog

JULY 30, 2019

Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Instead, we use a wrapper that pulls in the latest version of Conductor and adds Netflix infrastructure components and libraries before deployment. Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

All Things Distributed

NOVEMBER 12, 2012

Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. This new Asia Pacific (Sydney) Region has been highly requested by companies worldwide, and it provides low latency access to AWS services for those who target customers in Australia and New Zealand.

Cloud 117

Cloud AWS Ecommerce Latency 117

The Netflix TechBlog

OCTOBER 15, 2019

Data Pipeline using Delta In the following sections, we are going to describe the Delta-Connector that connects to a datastore and publishes CDC events to the Transport Layer, which is a real-time data transportation infrastructure routing CDC events to Kafka topics. High availability, via standby instances across AWS Availability Zones.

Transportation 192

Transportation Architecture Processing Storage 192

Adrian Cockcroft

APRIL 18, 2018

Monitoring systems are a critical part of any highly available system, as they are needed to detect failures and report whether users are impacted, then report whether the problem has gone away. When auto-scaling is used monitoring is also part of a critical feedback loop. There are some services like latency.at

Monitoring 40

Monitoring Systems Virtualization Metrics 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. Another adtech infrastructure problem is capacity. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. The simple answer is to just spin up more servers.

Performance 40

Performance Hardware Latency Infrastructure 40

VoltDB

JUNE 29, 2017

Most existing adtech infrastructure simply can not achieve the required latency. Another adtech infrastructure problem is capacity. This surge in impressions will strain or break existing infrastructure, which wasn’t architected to handle data at this scale. The simple answer is to just spin up more servers.

Performance 40

Performance Hardware Latency Infrastructure 40

All Things Distributed

APRIL 5, 2012

Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. Troy: We moved our service from internal servers to AWS.

Innovation 146

Innovation AWS Education Network 146

The Netflix TechBlog

JUNE 14, 2023

The control group’s traffic utilized the legacy Falcor stack, while the experiment population leveraged the new GraphQL client and was directed to the GraphQL Shim. This helped us successfully migrate 100% of the traffic on the mobile homepage canvas to GraphQL in 6 months. How does it work?

Traffic 353

Traffic Latency Cache Metrics 353

Dynatrace

SEPTEMBER 7, 2022

VPC Flow Logs is an Amazon service that enables IT pros to capture information about the IP traffic that traverses network interfaces in a virtual private cloud, or VPC. By default, each record captures a network internet protocol (IP), a destination, and the source of the traffic flow that occurs within your environment.

Traffic 215

Traffic AWS Network Cloud 215

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 122

Cloud Serverless AWS Storage 122

Dynatrace

MARCH 16, 2022

We added monitoring and analytics for log streams from Kubernetes and multicloud platforms like AWS, GCP, and Azure, as well as the most widely used open-source log data frameworks. The parameter Billed Duration is only available in logs , so it makes sense to extract it from your logs so that you can keep an eye on your cloud costs.

Metrics 214

Metrics Lambda Infrastructure Monitoring 214

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

Scalegrid

JANUARY 8, 2024

Both multi-cloud and hybrid cloud models come with their advantages, like increased flexibility and secure, scalable IT infrastructure but face challenges such as management complexity and integration issues. What is Multi-Cloud? In a multi-cloud setting, enterprises utilize multiple cloud vendors to fulfill various business functions.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. March 26, 2008 doesn't have any delicious desserts associated with it, but that's the day when we launched Availability Zones for Amazon EC2. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations.

AWS 132

AWS Latency Lambda Architecture 132

Dynatrace

JUNE 26, 2020

With today’s high expectations for the speed and availability of applications, you need a deep understanding of real user experiences to make the best business decisions. Dynatrace Synthetic Monitoring ensures that your application is available and performs well from anywhere in the world to meet your SLAs. Virginia (AWS) ?,

Monitoring 256

Monitoring Azure AWS Traffic 256

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. Network Availability: The expected continued growth of our ecosystem makes it difficult to understand our network bottlenecks and potential limits we may be reaching.

Network 150

Network Tuning AWS Big Data 150

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Dynatrace

MAY 17, 2023

For that, we focused on OpenTelemetry as the underlying technology and showed how you can use the available SDKs and libraries to instrument applications across different languages and platforms. Heading over to `Infrastructure` / `Hosts` in your dashboard, you should now have an entry for the host where you installed OneAgent.

Metrics 171

Metrics Monitoring Database Network 171

O'Reilly

DECEMBER 2, 2019

5G enthusiasts frequently say it’s an enabling technology for autonomous vehicles (AV), which will need high bandwidth to download maps and images, and perhaps even to communicate with each other: AV heaven is a world in which all vehicles are autonomous and can therefore collaboratively plan traffic.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. All rely heavily on utilizing allocated portions from existing pools made available through specific providers as part of their service offerings.

Cloud 130

Cloud Virtualization Storage Efficiency 130

IO River

NOVEMBER 2, 2023

The code is declarative, which means you specify what you want the final configuration to look like, and Terraform ensures the infrastructure matches that desired state.‍So, ‍Terraform is a revolution in the way we handle infrastructure. Background‍The idea of managing infrastructure through code wasn't initiated by HashiCorp.

Open Source 52

Open Source DevOps AWS Azure 52

Dynatrace

MAY 1, 2020

The investment continues—we’re anticipating an upcoming release of the AWS Graviton2 processor , which has already been announced to be significantly more powerful than its predecessor. Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java.

Java 133

Java Hardware Tuning Metrics 133