The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. These design principles led us to client-side load-balancing, and the 2012 Christmas Eve outage solidified this decision even further.

Traffic 220

Traffic Latency Cloud C++ 220

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

FEBRUARY 4, 2014

AWS has built a reputation over the years for the breadth and depth of our services and the pace of our innovation with 280 features released in 2013. These are the people working behind the scenes helping customers fully leverage all of AWS’s capabilities when running their infrastructure on AWS.

AWS 134

AWS Energy Innovation Best Practices 134

All Things Distributed

NOVEMBER 12, 2012

By Werner Vogels on 12 November 2012 05:00 AM. Today, Amazon Web Services has greater worldwide coverage with the launch of a new AWS Region in Sydney, Australia. I have visited Australia at least twice every year for the past four years and I have seen first-hand evidence of the tremendous interest there is in the AWS service.

Cloud 118

Cloud AWS Ecommerce Latency 118

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. But since this article is about connecting an application running on the server with AWS S3, we don’t consider this solution. Leonardo Losoviz. 2018-11-08T12:30:30+01:00. 2019-04-29T18:34:58+00:00. Creating The Bucket.

AWS 44

AWS Servers Storage Cloud 44

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 130

Cloud Energy AWS Healthcare 130

All Things Distributed

MARCH 20, 2012

By Werner Vogels on 20 March 2012 09:00 PM. s AWS Elastic Beanstalk announcement of PHP and Git support reminded me of the post where I mentioned that we want to let a thousand platforms bloom on AWS. Some might ask why AWS would want a thousand platforms. One of the most important AWS principles is flexibility.

AWS 106

AWS Scalability Java Storage 106

All Things Distributed

FEBRUARY 22, 2012

By Werner Vogels on 22 February 2012 12:01 AM. Today AWS launched an exciting new service for developers: the Amazon Simple Workflow Service. Amazon SWF makes it very easy for developers to architect and implement these tasks, run them in the cloud or on premise and coordinate their flow. Expanding the Cloud â??

Cloud 130

Cloud AWS Java Scalability 130

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person!

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

SEPTEMBER 25, 2012

By Werner Vogels on 25 September 2012 06:00 PM. Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS).

Cloud 118

Cloud AWS Storage Database 118

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g.,

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

JULY 19, 2012

By Werner Vogels on 19 July 2012 12:00 AM. AWS customers are bringing their most demanding workloads onto the cloud. For more details on the new instance type see the EC2 detail page and the AWS developer blog. (As High Performance I/O Instances for Amazon EC2. Comments (). blog comments powered by Disqus.

Cloud 129

Cloud Performance AWS Virtualization 129

All Things Distributed

AUGUST 20, 2012

By Werner Vogels on 21 August 2012 12:01 AM. Using Amazon Glacier AWS customers no longer need to worry about how to plan and manage their archiving infrastructure, unlimited archival storage is available to them with a familiar pay-as-you-go model, and with storage priced as low as 1 cent per GB it is extremely cost-effective.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

AUGUST 16, 2012

By Werner Vogels on 16 August 2012 10:00 AM. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper.

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

APRIL 5, 2012

By Werner Vogels on 06 April 2012 06:00 AM. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. and took near zero development effort.

Innovation 149

Innovation AWS Education Network 149

Smashing Magazine

AUGUST 20, 2021

Yet, for all these technological developments, it’s interesting that many of us are still serving sites in the same way Tim did with the very first website — a web server serving static website files. However, unlike the early days of the web, static sites are no longer limited to developers working in a code editor.

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

NOVEMBER 8, 2012

By Werner Vogels on 08 November 2012 03:00 PM. For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. Similarly, AWS customers have been using SQS in interesting ways. All Things Distributed.

Efficiency 107

Efficiency Cloud Games Scalability 107

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. The destination may be a datastore or an external API. Supporting Relational Databases. All aboard the Databus!:

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

This motivated the development of DBLog , which offers log and dump processing under a generic framework. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. The destination may be a datastore or an external API. Supporting Relational Databases. All aboard the Databus!:

Database 212

Database Traffic Transportation Open Source 212

All Things Distributed

FEBRUARY 18, 2013

Expanding the Cloud - Introducing AWS OpsWorks, a Powerful Application Management Solution. Today Amazon Web Services launched AWS OpsWorks , a flexible application management solution with automation tools that enable you to model and control your applications and their supporting infrastructure. AWS OpsWorks Unique Features.

AWS 157

AWS Cloud Architecture Infrastructure 157

All Things Distributed

SEPTEMBER 12, 2012

By Werner Vogels on 12 September 2012 01:00 AM. Reserved Instances are an important pricing option for AWS customers to drive cost down. Customers buying on the marketplace often have a need for Reserved Instances, but at a period different from the 1 & 3 year terms that AWS offers. button in the AWS Management Console.

AWS 112

AWS Traffic Cloud Innovation 112

All Things Distributed

JUNE 21, 2012

By Werner Vogels on 21 June 2012 09:00 AM. Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. ve already passed our 2012 targets. Comments ().

Games 142

Games Scalability AWS Database 142

All Things Distributed

APRIL 18, 2012

Do You Want to Help Build the Next AWS Service? By Werner Vogels on 19 April 2012 02:00 AM. s become obvious to me is that there are innovative, inspiring developers in every corner of the planet from Australia to Iceland and from Israel to Peru. You can also simply email your resume to aws-recruiting@amazon.com.

AWS 93

AWS Scalability Innovation Architecture 93

All Things Distributed

JUNE 21, 2017

You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required. DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. Saving crucial milliseconds.

Speed 123

Speed Cache Latency AWS 123

All Things Distributed

MAY 13, 2012

By Werner Vogels on 14 May 2012 12:01 AM. Of course non-AWS origins are also permitted. Selecting the best AWS region for Origin Fetch. In addition, we have shown an optional configuration in the architecture diagram how developers can use Route 53â??s AWS Region for the origin fetch. All Things Distributed.

Cache 118

Cache Latency AWS Website 118

All Things Distributed

OCTOBER 2, 2017

Our straining database infrastructure on Oracle led us to evaluate if we could develop a purpose-built database that would support our business needs for the long term. As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com.

Internet 130

Internet Internet AWS Performance 130

All Things Distributed

DECEMBER 12, 2013

However, we also knew that building a distributed database that has unlimited scale and maintains predictably high performance while providing rich and flexible query capabilities, is one of the hardest problems in database development, and will take a lot of effort and invention from our team of distributed database engineers to solve.

Games 130

Games Scalability Database Retail 130

All Things Distributed

OCTOBER 8, 2014

Today, I’m thrilled to announce several major features that significantly enhance the development experience on DynamoDB. These improvements have been sought by many applications developers, and we are happy to be bringing them to you. In 2012, we launched Amazon DynamoDB, the successor to Amazon Dynamo.

Availability 145

Availability Performance Scalability AWS 145

All Things Distributed

JANUARY 18, 2012

By Werner Vogels on 18 January 2012 07:00 AM. s Dynamo technology , which was one of the first non-relational databases developed at Amazon. The Amazon.com ecommerce platform consists of hundreds of decoupled services developed and managed in a decentralized fashion. Amazon DynamoDB â?? Comments (). The growth of Amazonâ??s

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

FEBRUARY 15, 2013

As you may remember from our announcement at re: Invent in November 2012, Amazon Redshift is a fast and powerful, fully managed, petabyte-scale data warehouse service that delivers fast query performance at less than one tenth the cost of most traditional data warehouse systems. Amazon Redshift and Designing for Resilience. Comments ().

Design 112

Design AWS Storage Systems 112

All Things Distributed

APRIL 18, 2012

Introducing AWS Marketplace. By Werner Vogels on 19 April 2012 02:00 AM. Today Amazon Web Services launched AWS Marketplace , an online store that makes it easy for you to find, buy, and immediately start using software and services that run on the AWS Cloud. You can use AWS Marketplaceâ??s Expanding the Cloud â??

AWS 116

AWS Cloud Software Software 116

All Things Distributed

APRIL 11, 2012

By Werner Vogels on 12 April 2012 12:00 AM. s search technology to every developer. And like most AWS services, Amazon CloudSearch scales automatically as your data and traffic grow, making it an easy choice for applications small to large. Expanding the Cloud â?? Introducing Amazon CloudSearch. Comments (). Why Search?

Cloud 149

Cloud AWS Technology Technology 149

All Things Distributed

MAY 15, 2014

In 2012, the European Commission set up the European Cloud Partnership (ECP), an initiative that brings together technology leaders, cloud users, both private and public sector, and policy-makers to recommend how to establish a Digital Single Market with no walls for cloud computing in Europe.

Cloud 123

Cloud Innovation AWS Government 123