The Netflix TechBlog

OCTOBER 19, 2020

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Now let’s look at how we designed the tracing infrastructure that powers Edgar. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 140

Performance Latency Hardware Storage 140

Dynatrace

NOVEMBER 20, 2023

At the AWS re:Invent 2023 conference, generative AI is a centerpiece. In this AWS re:Invent 2023 guide, we explore the role of generative AI in the issues organizations face as they move to the cloud: IT automation, cloud migration and digital transformation, application security, and more. What is causal AI?

AWS 209

AWS Artificial Intelligence Analytics Cloud 209

All Things Distributed

DECEMBER 14, 2011

Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Several prominent South American customers have been using AWS since the early days. RAMA , a Brazilian financial services firm and AWS customer : â??The

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet.

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

FEBRUARY 23, 2011

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3. In a follow up to the last blog post I have removed the last two dependencies this blog had on running a server somewhere: comments are now served by Disqus and search is now handled by Bing. blog comments powered by Disqus. Countdown to What is Next in AWS.

AWS 78

AWS Storage Big Data Servers 78

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

MARCH 5, 2012

Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. Driving costs down for our customers is part of the DNA of Amazon and therefore also part of the DNA of AWS. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

Dynatrace

OCTOBER 7, 2021

Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. AWS serverless offerings. Reliability. Compute services.

Serverless 281

Serverless AWS Lambda Storage 281

All Things Distributed

JUNE 29, 2011

Driving Bandwidth Cost Down for AWS Customers. Any work we can do to improve over these dimensions generates long term benefits for AWS customers. Our solution architects work with customers to look for opportunities to exploit elasticity in AWS setups which can lead to significant savings in operational cost. Comments ().

AWS 104

AWS Retail Innovation Strategy 104

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. blog comments powered by Disqus.

AWS 75

AWS Database Storage Scalability 75

All Things Distributed

MARCH 24, 2011

Hacking with AWS at The Next Web Hackaton. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs.

AWS 93

AWS Internet Internet Storage 93

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. What does observability mean for Kubernetes?

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

HammerDB

APRIL 19, 2023

In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku. Comments ().

AWS 115

AWS Cloud Java Scalability 115

Dynatrace

SEPTEMBER 15, 2020

As an Amazon Web Services (AWS) Advanced Technology Partner, Dynatrace easily integrates with AWS to help you stay on top of the dynamics of your enterprise cloud environment?. We’re therefore excited to announce that Dynatrace has received the AWS Outposts Service Ready designation. What is AWS Outposts?

AWS 201

AWS Design Cloud Storage 201

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. But I really want a setup that allows me to thinker with the blog where ever I am (e.g. at 30,000 feet). Jekyll also is a static website generator.

Servers 126

Servers Social Media AWS Website 126

All Things Distributed

FEBRUARY 11, 2013

While I was returning from an exciting time in New Orleans watching the Super Bowl, AWS launched a very cool, brand new service: Amazon Elastic Transcoder. Amazon Elastic Transcoder is designed to be very easy to use, scalable and cost-effective video transcoding in the cloud. blog comments powered by Disqus. Contact Info.

AWS 102

AWS Media Scalability Storage 102

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. blog comments powered by Disqus. Comments ().

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Given the widespread use of caching in many of the applications in the AWS Cloud, a caching service had been high on the request list of our customers. blog comments powered by Disqus.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

JULY 19, 2012

AWS customers are bringing their most demanding workloads onto the cloud. Customers are also bringing workloads on AWS that require dedicated and high performance IO for which we are now introducing a new Amazon EC2 instance type, the High I/O Quadruple Extra Large (hi1.4xlarge), to meet their needs. blog comments powered by Disqus.

Cloud 129

Cloud Performance AWS Virtualization 129

Percona

DECEMBER 11, 2023

A quick configuration change may do the trick in improving the performance of your AWS RDS for MySQL instance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. Who can benefit from DLV? and later v13 versions, 14.7

AWS 95

AWS Benchmarking Performance Traffic 95

All Things Distributed

DECEMBER 18, 2012

After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Do not expect too many blog posts or twitter updates. Although there are still a few very exciting AWS news updates to happen this year. Although there are still a few very exciting AWS news updates to happen this year.

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

AUGUST 18, 2011

Many of our Big-Data customers already saw a big drop in their AWS bill last month when the cost of incoming bandwidth was dropped to $0.00. The posting on the AWS developer blog also has some more background. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

Big Data 111

Big Data Analytics AWS Cloud 111

All Things Distributed

MAY 24, 2011

Many AWS customers use Elastic Load Balancers (ELB) to front their Internet facing applications. More information can found on the Elastic Load Balancing and the Route 53 detail pages and on the two blog posts on the AWS developer blog. blog comments powered by Disqus. Driving Storage Costs Down for AWS Customers.

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

JANUARY 11, 2011

Theyre not even an AWS customer :-). blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. Contact Info. Werner Vogels.

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

SEPTEMBER 29, 2010

Like many folks who started down the path of using real-time micro-blogging services (read: twitter ) the convenience of those platforms has made that sharing happens there instead of on the blogs we (used to) keep. That was a mistake which I will try to correct in the coming months as Ill get back into blogging mode.

AWS 69

AWS Storage Big Data Scalability 69

All Things Distributed

FEBRUARY 27, 2011

While cleaning out the digital attic I ran into this drawing that Hugh MacLeod (aka "gapingvoid") made for me in reponse to a storm-in-a-teacup about blogging Amazon. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Storage Big Data Scalability 60

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. blog comments powered by Disqus.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

JULY 11, 2011

To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Contact Info.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Cloud Big Data 67

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. We have designed Route 53 to propagate updates very quickly and give the customer the tools to find out when all changes have been propagated.

Cloud 117

Cloud Internet Internet AWS 117

The Symphonia

JUNE 19, 2018

Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage? I was fortunate to be both presenting a 2-day workshop (on AWS Serverless Architectures and Continuous Deployment) as well as hosting a full-day Serverless track of talks. Unlike the temperature outside. John and I (Mike) have had a fun three months.

Serverless 40

Serverless AWS DevOps Open Source 40