All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. The ideal candidate will be someone who has built and ran large scale distributed systems and/or databases.

AWS 75

AWS Database Storage Scalability 75

Dynatrace

APRIL 11, 2023

Log4Shell required many organizations to take devices and applications offline to prevent malicious attackers from gaining access to IT systems and sensitive data. As a result, organizations need to be vigilant in identifying and addressing vulnerabilities to protect their systems and data.

Cloud 186

Cloud DevOps Open Source Retail 186

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Introducing the AWS South America (Sao Paulo) Region. Today, Amazon Web Services is expanding its worldwide coverage with the launch of a new AWS Region in Sao Paulo, Brazil. Additionally, it allows them to keep their data inside of Brazil.

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Register for AWS re: Invent. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. All Things Distributed. By Werner Vogels on 16 July 2012 09:00 AM. Comments (). See the site for more details.

AWS 83

AWS Big Data Media Storage 83

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. Driving Storage Costs Down for AWS Customers.

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. By Werner Vogels on 18 January 2011 04:00 PM.

AWS 115

AWS Cloud Java Operating System 115

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. For more details on AWS in Japan see [link].

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Bandwidth Cost Down for AWS Customers. Any work we can do to improve over these dimensions generates long term benefits for AWS customers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 104

AWS Retail Innovation Strategy 104

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Hacking with AWS at The Next Web Hackaton. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. Driving Storage Costs Down for AWS Customers.

AWS 93

AWS Internet Internet Storage 93

The Netflix TechBlog

OCTOBER 15, 2019

Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2]. By their nature, they can only rely on the lowest common denominator of participating systems. That system quickly grew very complex and became difficult to maintain.

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Systems that make extensive use of caching almost all report a significant reduction in the cost of their database tier.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. Comments (). and European Regions.

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). Driving Storage Costs Down for AWS Customers.

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s Data is retrieved by scheduling a job, which typically completes within 3 to 5 hours. All Things Distributed.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon S3 is much more than just storage; the network and distributed systems infrastructure to ensure that content can be served fast and at high rates without customers impacting each other, is amazing. Driving Storage Costs Down for AWS Customers.

Servers 126

Servers Social Media AWS Website 126

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Why are developers using RInK systems as part of their design? Fetching too much data in a single query (i.e.,

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. DROAM - Dreaming about Cheap Data Roaming. The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. Theyre not even an AWS customer :-). Driving Storage Costs Down for AWS Customers.

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

FEBRUARY 23, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Countdown to What is Next in AWS. All Things Distributed.

AWS 78

AWS Storage Big Data Servers 78

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Many AWS customers use Elastic Load Balancers (ELB) to front their Internet facing applications. More information can found on the Elastic Load Balancing and the Route 53 detail pages and on the two blog posts on the AWS developer blog. Comments ().

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

JULY 3, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Countdown to What is Next in AWS.

AWS 67

AWS Storage Big Data Cloud 67

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Not just for HPC but for mission critical enterprise systems such as OLTP. Dedicated High Performance Compute clusters require significant capital investments and their procurement often has longer lead times than many enterprise class server systems.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

FEBRUARY 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Countdown to What is Next in AWS. All Things Distributed.

AWS 60

AWS Storage Big Data Scalability 60

All Things Distributed

SEPTEMBER 29, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I did write for those occasions where I thought additional background on AWS service and feature launches was relevant, but beyond that not much materialized. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 69

AWS Storage Big Data Scalability 69

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. AWS Solutions Architect Matt Tavis will present on " Architecting for the Cloud ". Countdown to What is Next in AWS.

AWS 75

AWS Storage Cloud Best Practices 75

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Countdown to What is Next in AWS. All Things Distributed.

AWS 60

AWS Storage Cloud Big Data 60

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. All Things Distributed.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. A wide variety of operating systems and software configurations is available for use. with more memory or CPU), a different operating system (e.g., with new security patches installed), or add new user data. Countdown to What is Next in AWS.

AWS 60

AWS Storage Operating System Cloud 60

All Things Distributed

DECEMBER 13, 2009

Werner Vogels weblog on building scalable and robust distributed systems. Spot Instances are an innovation that is made possible by the unparalleled economies of scale created by the tremendous growth of the AWS Infrastructure Services. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

Cloud 63

Cloud AWS Storage Innovation 63

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

The Netflix TechBlog

MARCH 25, 2019

Finally, imagine yourself in the role of a data platform reliability engineer tasked with providing advanced lead time to data pipeline (ETL) owners by proactively identifying issues upstream to their ETL jobs. Let’s review a few of these principles: Ensure data integrity ?—?Accurately Enable seamless integration?—?

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

The Netflix TechBlog

OCTOBER 27, 2020

Usually Data scientists and engineers write Extract-Transform-Load (ETL) jobs and pipelines using big data compute technologies, like Spark or Presto , to process this data and periodically compute key information for a member or a video. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

All Things Distributed

FEBRUARY 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. New AWS feature: Run your website from Amazon S3. All of this can be done from the AWS console as well as with the AWS SDKs. More details about the website feature of Amazon S3 can be found here and in Jeff Barrs blog post on the AWS developer blog.

AWS 134

AWS Website Storage Servers 134

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Use cases We found several use cases where a system like AutoOptimize can bring tons of value. Transparency to end-users.

Storage 203

Storage Latency Efficiency Data Engineering 203