The Netflix TechBlog

OCTOBER 15, 2019

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. Delta Delta has been developed to address the limitations of existing solutions for data synchronization, and also allows to enrich data on the fly. In addition, we support Cassandra (multi-master).

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku. Comments ().

AWS 115

AWS Cloud Java Operating System 115

All Things Distributed

MARCH 24, 2011

Hacking with AWS at The Next Web Hackaton. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. To make it easy we have free AWS usage credits available onsite for who ever needs them. Countdown to What is Next in AWS.

AWS 93

AWS Internet Internet Storage 93

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Countdown to What is Next in AWS.

AWS 60

AWS Cloud Latency Storage 60

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Merging those numerous smaller files into a handful of larger files can make query processing faster and reduce storage space.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Given the widespread use of caching in many of the applications in the AWS Cloud, a caching service had been high on the request list of our customers. Driving Storage Costs Down for AWS Customers.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

MAY 24, 2011

I am excited that today both the Route 53 , the highly available and scalable DNS service, and the Elastic Load Balancing teams are releasing new functionality that has been frequently requested by their customers: Route 53 now GA : Route 53 is now Generally Available and will provide an availability SLA of 100%. Contact Info.

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

JULY 11, 2011

With this change, we will improve the granularity of pricing information you receive by introducing a Spot Instance price per Availability Zone rather than a Spot Instance price per Region. Customers whose bids exceed the Spot price gain access to the available Spot Instances and run as long as the bid exceeds the Spot Price.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Big Data Cloud 67

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

DECEMBER 3, 2009

Today a powerful new feature is available for our Amazon EC2 customers: the ability to boot their instances from Amazon EBS (Elastic Block Store). A wide variety of operating systems and software configurations is available for use. with new security patches installed), or add new user data. Countdown to What is Next in AWS.

AWS 60

AWS Storage Operating System Cloud 60

All Things Distributed

JULY 13, 2010

Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. Jeff Barr in his blog post on the AWS developer blog has additional details and there are some great testimonials of early Cluster Compute Instances customers in the press release.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

DECEMBER 13, 2016

In November 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in the United Kingdom. Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

All Things Distributed

DECEMBER 13, 2009

Spot Instances are an innovation that is made possible by the unparalleled economies of scale created by the tremendous growth of the AWS Infrastructure Services. Consistently we have lowered compute, storage and bandwidth prices based on such cost savings. Economies of scale. Different Purchasing Models.

Cloud 63

Cloud AWS Storage Innovation 63

Scalegrid

MARCH 14, 2024

Public Cloud Infrastructure Third-party providers run public cloud services, delivering a broad array of offerings like computing power, storage solutions, and network capabilities that enhance the functionality of a hybrid cloud architecture. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

The Netflix TechBlog

OCTOBER 27, 2020

Usually Data scientists and engineers write Extract-Transform-Load (ETL) jobs and pipelines using big data compute technologies, like Spark or Presto , to process this data and periodically compute key information for a member or a video. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

FEBRUARY 17, 2011

New AWS feature: Run your website from Amazon S3. Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. All of this can be done from the AWS console as well as with the AWS SDKs. Countdown to What is Next in AWS.

AWS 134

AWS Website Storage Servers 134

All Things Distributed

FEBRUARY 25, 2011

Simplifying IT - Create Your Application with AWS CloudFormation. With the launch of AWS CloudFormation today another important step has been taken in making it easier for customers to deploy applications to the cloud. Creating and managing these environments was a pain that AWS CloudFormation set out to relieve. Comments ().

AWS 121

AWS Cloud Scalability Storage 121

All Things Distributed

MAY 18, 2010

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage. Today a new storage option for Amazon S3 has been launched: Amazon S3 Reduced Redundancy Storage (RRS). This new storage option enables customers to reduce their costs by storing non-critical, reproducible data at lower levels of redundancy. Comments ().

Storage 71

Storage Cloud AWS Scalability 71

All Things Distributed

APRIL 27, 2011

The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. For example, our Simple Storage Service, Elastic Block Store, and SimpleDB all derive their basic architecture from unique Amazon technologies. Driving Storage Costs Down for AWS Customers.

Technology 151

Technology Technology AWS Storage 151

All Things Distributed

MARCH 28, 2011

As a big music fan with well over 100Gb in digital music I am particularly excited that I now have access to all my digital music anywhere I go. What used to be only available in physical formats now often has digital equivalents and this digitalization is driving great new innovations. Driving Storage Costs Down for AWS Customers.

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

DECEMBER 9, 2010

Amazon S3 has always been a scalable, durable and available data repository for almost any customer workload. This is especially true for customers managing HD video or data-intensive instruments such as genomic sequencers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 80

AWS Big Data Scalability Storage 80

All Things Distributed

NOVEMBER 15, 2010

This incredible power is available for anyone to use in the usual pay-as-you-go model, removing the investment barrier that has kept many organizations from adopting GPUs for their workloads even though they knew there would be significant performance benefit. The different stages were then load balanced across the available units.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

FEBRUARY 24, 2010

There are many factors that come into play when you need to meet stringent availability and performance requirements under ultra-scalable conditions. If you need to achieve high-availability and scalable performance, you will need to resort to data replication techniques. Data Consistency Models in the Amazon Services.

AWS 69

AWS Latency Database Scalability 69