All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

All Things Distributed

SEPTEMBER 29, 2016

Today, I am very excited to announce our plans to open a new AWS Region in France! Over the past 10 years, we have seen tremendous growth at AWS. As a result, we have opened 35 Availability Zones (AZs), across 13 AWS Regions worldwide. French organizations were amongst the first to use AWS when we launched in 2006.

AWS 166

AWS IoT Internet Internet 166

Dynatrace

JUNE 29, 2022

A hybrid cloud, however, combines public infrastructure and services with on-premises resources or a private data center to create a flexible, interconnected IT environment. Hybrid environments provide more options for storing and analyzing ever-growing volumes of big data and for deploying digital services.

Infrastructure 190

Infrastructure Cloud Azure AWS 190

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. Network Availability: The expected continued growth of our ecosystem makes it difficult to understand our network bottlenecks and potential limits we may be reaching.

Network 150

Network Tuning AWS Big Data 150

All Things Distributed

NOVEMBER 30, 2016

We also have a great deal of machine learning technology that can benefit machine scientists and developers working outside Amazon. Last week, I wrote a blog about helping the machine learning scientist community select the right deep learning framework from among many we support on AWS such as MxNet, TensorFlow, Caffe, etc.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Today, I’m happy to announce that the Asia Pacific (Mumbai) Region is generally available for use by customers worldwide. Advanced problem solving that connects big data with machine learning.

AWS 90

AWS Cloud Healthcare Blockchain 90

All Things Distributed

APRIL 27, 2011

The Amazon.com 2010 Shareholder Letter Focusses on Technology. In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here.

Technology 151

Technology Technology AWS Storage 151

Scalegrid

MARCH 14, 2024

Integrating technology from private and public clouds and on-premises resources within one hybrid cloud platform creates an integrated IT infrastructure that leverages the strengths of each component. Businesses can tailor the global infrastructure available via ScaleGrid to satisfy their unique regional and functional needs.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

MAY 27, 2015

Over a year ago the AWS team opened a "pop-up loft" in San Francisco at 925 Market Street. The goal of opening the loft was to give developers an opportunity to get in-person support and education on AWS, to network, get some work done, or just hang out with peers. Usually $30 each, these labs are offered for free in the AWS loft.

AWS 95

AWS Education Big Data Games 95

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. Government and Big Data. All Things Distributed. Comments (). Cloud Readyâ??;

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. Big data challenges.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

FEBRUARY 25, 2011

Simplifying IT - Create Your Application with AWS CloudFormation. With the launch of AWS CloudFormation today another important step has been taken in making it easier for customers to deploy applications to the cloud. Creating and managing these environments was a pain that AWS CloudFormation set out to relieve. Comments ().

AWS 121

AWS Cloud Scalability Storage 121

The Netflix TechBlog

MARCH 25, 2019

Netflix Data Landscape Freedom & Responsibility (F&R) is the lynchpin of Netflix’s culture empowering teams to move fast to deliver on innovation and operate with freedom to satisfy their mission. As a result, a single consolidated and centralized source of truth does not exist that can be leveraged to derive data lineage truth.

Infrastructure 219

Infrastructure Big Data Transportation Architecture 219

The Netflix TechBlog

OCTOBER 27, 2020

Usually Data scientists and engineers write Extract-Transform-Load (ETL) jobs and pipelines using big data compute technologies, like Spark or Presto , to process this data and periodically compute key information for a member or a video. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 243

Latency Storage Big Data Tuning 243

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

FEBRUARY 17, 2011

New AWS feature: Run your website from Amazon S3. been running at a traditional hosting site for many years until this preferred simple solution became available: today marks that day and I couldnt be happier about it. All of this can be done from the AWS console as well as with the AWS SDKs. All Things Distributed.

AWS 134

AWS Website Storage Servers 134

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku. Comments ().

AWS 115

AWS Cloud Java Scalability 115

All Things Distributed

MARCH 24, 2011

Hacking with AWS at The Next Web Hackaton. Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. To make it easy we have free AWS usage credits available onsite for who ever needs them. There is one requirement; you have to be "hacking" using the AWS APIs.

AWS 93

AWS Internet Internet Storage 93

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). We have expanded the AWS footprint in the US and starting today a new AWS Region is available for use: US-West (Northern California). AWS is committed to making its services available at low cost. Countdown to What is Next in AWS.

AWS 60

AWS Cloud Latency Storage 60

The Netflix TechBlog

OCTOBER 15, 2019

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. Delta Delta has been developed to address the limitations of existing solutions for data synchronization, and also allows to enrich data on the fly. In addition, we support Cassandra (multi-master).

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Today Amazon Web Services has taken another important step in serving customers worldwide: the AWS Asia Pacific (Singapore) Region is now launched. The new Singapore Region offers customers in APAC lower-latency access to AWS services. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Given the widespread use of caching in many of the applications in the AWS Cloud, a caching service had been high on the request list of our customers. Driving Storage Costs Down for AWS Customers.

Cloud 117

Cloud Cache AWS Storage 117

Abhishek Tiwari

JULY 7, 2023

In the era of big data and complex data processing, data pipelines have emerged as a popular solution for managing and manipulating data. They provide a systematic approach to extract, transform, and load (ETL) data from various sources, enabling organizations to derive valuable insights.

Logistics 52

Logistics Transportation Scalability Data Engineering 52

All Things Distributed

AUGUST 20, 2012

From selecting the right technology, to maintaining multi-site facilities, to dealing with exponential and often unpredictable growth, to ensuring long-term digital integrity, digital archiving can be a major headache. Data is retrieved by scheduling a job, which typically completes within 3 to 5 hours. s largest organizations.

Storage 122

Storage Cloud AWS Media 122

Testsigma

MAY 14, 2021

Definitely, cloud testing will involve some new technology and the testers will need to learn them. Technology: We need to decide what technologies we will be using for cloud testing. Examples are DevOps, AWS, Big Data, Testing as Service, testing environments. All environments/ resources are available 24*7.

Cloud 67

Cloud Testing Testing Tools Internet 67

All Things Distributed

JULY 11, 2011

With this change, we will improve the granularity of pricing information you receive by introducing a Spot Instance price per Availability Zone rather than a Spot Instance price per Region. Customers whose bids exceed the Spot price gain access to the available Spot Instances and run as long as the bid exceeds the Spot Price.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

MAY 24, 2011

I am excited that today both the Route 53 , the highly available and scalable DNS service, and the Elastic Load Balancing teams are releasing new functionality that has been frequently requested by their customers: Route 53 now GA : Route 53 is now Generally Available and will provide an availability SLA of 100%. Contact Info.

Internet 114

Internet Internet AWS Scalability 114

All Things Distributed

MARCH 28, 2011

As a big music fan with well over 100Gb in digital music I am particularly excited that I now have access to all my digital music anywhere I go. What used to be only available in physical formats now often has digital equivalents and this digitalization is driving great new innovations. Driving Storage Costs Down for AWS Customers.

AWS 138

AWS Cloud Storage Internet 138

All Things Distributed

DECEMBER 9, 2010

Amazon S3 has always been a scalable, durable and available data repository for almost any customer workload. This is especially true for customers managing HD video or data-intensive instruments such as genomic sequencers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 80

AWS Big Data Scalability Storage 80

All Things Distributed

NOVEMBER 15, 2010

This incredible power is available for anyone to use in the usual pay-as-you-go model, removing the investment barrier that has kept many organizations from adopting GPUs for their workloads even though they knew there would be significant performance benefit. The different stages were then load balanced across the available units.

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Big Data Cloud 67

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

MAY 18, 2010

Under the covers Amazon S3 is a marvel of distributed systems technologies. The goal for operational excellence in Amazon S3 (and for all other AWS services) is that it should be "indistinguishable from perfect". We use several techniques to ensure the durability of the data our customers trust us with, and some of those (e.g.

Storage 71

Storage Cloud AWS Scalability 71

All Things Distributed

DECEMBER 3, 2009

Today a powerful new feature is available for our Amazon EC2 customers: the ability to boot their instances from Amazon EBS (Elastic Block Store). A wide variety of operating systems and software configurations is available for use. with new security patches installed), or add new user data. Countdown to What is Next in AWS.

AWS 60

AWS Storage Operating System Cloud 60

All Things Distributed

DECEMBER 13, 2009

Spot Instances are an innovation that is made possible by the unparalleled economies of scale created by the tremendous growth of the AWS Infrastructure Services. You are assured that your Reserved Instance will always be available in the Availability Zone in which you purchased it. Economies of scale.

Cloud 63

Cloud AWS Storage Innovation 63

All Things Distributed

FEBRUARY 24, 2010

There are many factors that come into play when you need to meet stringent availability and performance requirements under ultra-scalable conditions. If you need to achieve high-availability and scalable performance, you will need to resort to data replication techniques. Data Consistency Models in the Amazon Services.

AWS 69

AWS Latency Database Scalability 69