All Things Distributed

FEBRUARY 25, 2011

Simplifying IT - Create Your Application with AWS CloudFormation. With the launch of AWS CloudFormation today another important step has been taken in making it easier for customers to deploy applications to the cloud. Creating and managing these environments was a pain that AWS CloudFormation set out to relieve. Comments ().

AWS 121

AWS Cloud Scalability Storage 121

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet.

AWS 96

AWS Cloud Storage Internet 96

All Things Distributed

JUNE 29, 2011

Driving Bandwidth Cost Down for AWS Customers. Any work we can do to improve over these dimensions generates long term benefits for AWS customers. Our solution architects work with customers to look for opportunities to exploit elasticity in AWS setups which can lead to significant savings in operational cost. Comments ().

AWS 104

AWS Retail Innovation Strategy 104

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. In this blog, we use step and job interchangeably. With the high growth of workflows in the past few years?—?increasing

Java 202

Java Scalability Traffic Architecture 202

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. blog comments powered by Disqus.

AWS 75

AWS Database Storage Scalability 75

All Things Distributed

MARCH 24, 2011

Hacking with AWS at The Next Web Hackaton. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs. To make it easy we have free AWS usage credits available onsite for who ever needs them. There is one requirement; you have to be "hacking" using the AWS APIs.

AWS 93

AWS Internet Internet Storage 93

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. Auto-discovery : One of the challenges with BI is discovering and accessing the data. Enter Amazon QuickSight.

Analytics 152

Analytics Availability Media Social Media 152

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku. Comments ().

AWS 115

AWS Cloud Java Scalability 115

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. blog comments powered by Disqus. Comments ().

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

AUGUST 17, 2011

A good example is the comments section on this blog; a few lines of JavaScript and these pages have a dynamic nature with comments, trackbacks and social media discussion showing up as they happen. But I really want a setup that allows me to thinker with the blog where ever I am (e.g. at 30,000 feet). Which suits me just fine.

Servers 126

Servers Social Media AWS Website 126

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Given the widespread use of caching in many of the applications in the AWS Cloud, a caching service had been high on the request list of our customers. blog comments powered by Disqus.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

AUGUST 20, 2012

Using Amazon Glacier AWS customers no longer need to worry about how to plan and manage their archiving infrastructure, unlimited archival storage is available to them with a familiar pay-as-you-go model, and with storage priced as low as 1 cent per GB it is extremely cost-effective. designed for 11 ninesâ??) s largest organizations.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

APRIL 27, 2011

Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here. To our shareowners: Random forests, naïve Bayesian estimators, RESTful services, gossip protocols, eventual consistency, data sharding, anti-entropy, Byzantine quorum, erasure coding, vector clocks.

Technology 151

Technology Technology AWS Storage 151

All Things Distributed

MARCH 28, 2011

Amazon S3 is used by enterprises of all sizes and is designed to handle scaling extremely well; it stores hundreds of billions of objects and easily performs several hundreds of thousands of storage transaction a second. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

SEPTEMBER 29, 2010

Like many folks who started down the path of using real-time micro-blogging services (read: twitter ) the convenience of those platforms has made that sharing happens there instead of on the blogs we (used to) keep. That was a mistake which I will try to correct in the coming months as Ill get back into blogging mode.

AWS 69

AWS Storage Big Data Scalability 69

All Things Distributed

FEBRUARY 27, 2011

While cleaning out the digital attic I ran into this drawing that Hugh MacLeod (aka "gapingvoid") made for me in reponse to a storm-in-a-teacup about blogging Amazon. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Syndication.

AWS 60

AWS Storage Big Data Scalability 60

All Things Distributed

MAY 24, 2011

Many AWS customers use Elastic Load Balancers (ELB) to front their Internet facing applications. More information can found on the Elastic Load Balancing and the Route 53 detail pages and on the two blog posts on the AWS developer blog. blog comments powered by Disqus. Driving Storage Costs Down for AWS Customers.

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

JANUARY 11, 2011

Theyre not even an AWS customer :-). blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

DECEMBER 9, 2010

By supporting such large object sizes, Amazon S3 better enables a variety of interesting big data use cases. For more information on Multipart Upload and managing large objects in Amazon S3 , see Jeff Barrs blog posts on Amazon S3 Multipart Upload and Large Object Support as well as the Amazon S3 Developer Guide. Contact Info.

AWS 80

AWS Big Data Scalability Storage 80

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. blog comments powered by Disqus.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

JULY 11, 2011

To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Contact Info. Werner Vogels.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Big Data Cloud 67

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. We have designed Route 53 to propagate updates very quickly and give the customer the tools to find out when all changes have been propagated.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

SEPTEMBER 30, 2010

With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. AWS Solutions Architect Matt Tavis will present on " Architecting for the Cloud ". AWS Startup Event in Tel Aviv on October 12 with customers Porticor , SemantiNet , Live Definition. . | Comments ().

AWS 75

AWS Storage Cloud Best Practices 75

All Things Distributed

NOVEMBER 19, 2010

Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. There were blog posts by Jeff Barr The Cluster GPU Instance and James Hamilton HPC in the Cloud with GPGPUs , as well as my background posting: Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances. Contact Info.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

NOVEMBER 15, 2010

These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. Some good insight into the work that is needed to convert certain algorithms to run efficiently on GPUs is the UCB/NVIDIA " Designing Efficient Sorting Algorithms for Manycore GPUs " paper. Contact Info.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

MAY 18, 2010

The goal for operational excellence in Amazon S3 (and for all other AWS services) is that it should be "indistinguishable from perfect". The same goes for durability; core to the design of S3 is that we go to great lengths to never, ever lose a single bit. These techniques allow us to design our service for 99.999999999% durability.

Storage 71

Storage Cloud AWS Scalability 71

All Things Distributed

APRIL 23, 2010

blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Countdown to What is Next in AWS.

AWS 60

AWS Storage Cloud Big Data 60

All Things Distributed

APRIL 19, 2010

As Dan Rayburn wrote on his Business of Video blog, "Amazon will be in the drivers seat to own the market for small and medium sized content owners who need simple delivery at a great price.". blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Countdown to What is Next in AWS.

Media 60

Media AWS Storage Big Data 60

All Things Distributed

DECEMBER 3, 2009

For more details on the new boot features visit the Amazon EC2 detail page and the posting on the AWS developer blog. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 60

AWS Storage Operating System Cloud 60

All Things Distributed

FEBRUARY 24, 2010

These new features will make it easier to transition those applications to SimpleDB that are designed with traditional database tools in mind. Amazon S3 and Amazon SimpleDB are examples of AWS services that are designed using these high-availability principles using an eventual consistency model. Contact Info. Werner Vogels.

AWS 69

AWS Latency Database Scalability 69

All Things Distributed

DECEMBER 13, 2009

Spot Instances are an innovation that is made possible by the unparalleled economies of scale created by the tremendous growth of the AWS Infrastructure Services. Price History : Amazon EC2 provides a history of the Spot Price for each instance type in each Region via the AWS Management Console and the APIs. Economies of scale.

Cloud 63

Cloud AWS Storage Innovation 63