All Things Distributed

DECEMBER 8, 2016

Earlier this year, Amazon Web Services (AWS) announced it would launch a new AWS infrastructure region in Montreal, Quebec. Today, I'm happy to share that the Canada (Central) Region is available for use by customers worldwide. For more information about AWS efforts, see AWS & Sustainability.

AWS 155

AWS Cloud Lambda Innovation 155

All Things Distributed

OCTOBER 17, 2016

The Ohio Region is the fifth AWS region in the US. It brings the worldwide total of AWS Availability Zones (AZs) to 38, and the number of regions globally to 14. The pace of expansion at AWS is accelerating, and Ohio is our third region launch this year. Check out the Regional Products and Services page for the full list.

AWS 127

AWS Cloud Infrastructure Analytics 127

Dynatrace

DECEMBER 16, 2020

Access to source code repositories is limited on both the network and the user level. Source code management systems are only accessible from within the Dynatrace corporate network. Remote access to the Dynatrace corporate network requires multi-factor authentication (MFA). No manual, error-prone steps are involved.

Software 233

Software Software Development AWS 233

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. Snowflake is a data warehouse designed to overcome these limitations, and the fundamental mechanism by which it achieves this is the decoupling (disaggregation) of compute and storage. joins) during query processing. Disaggregation (or not).

Storage 112

Storage Engineering Cache Serverless 112

All Things Distributed

JUNE 7, 2017

Unlocking the value of data is a primary goal that AWS helps our customers to pursue. Some applications – medical equipment, industrial machinery, and building automation are just a few – can't rely exclusively on the cloud for control, and require some form of local storage and execution. Law of Economics. Law of the Land.

AWS 118

AWS IoT Lambda Storage 118

Dynatrace

MAY 6, 2021

Contact Dynatrace ONE if you wish to enable Cluster-side screenshot storage on pre-1.216 fresh-installed Clusters. Self-service update packages management is now available. You can safe your disk space and have more control over what’s available to your cluster . Now only valid versions are available to choose.

Operating System 230

Operating System AWS Metrics Storage 230

All Things Distributed

DECEMBER 18, 2017

Today, I'm happy to announce that the AWS EU (Paris) Region, our 18th technology infrastructure Region globally, is now generally available for use by customers worldwide. This is why tens of thousands of French customers already use AWS in Regions around the world.

AWS 112

AWS Artificial Intelligence Education Energy 112

All Things Distributed

DECEMBER 11, 2017

Today, I am happy to announce the general availability of AWS China (Ningxia) Region, operated by Ningxia Western Cloud Data Technology Co. To comply with China's legal and regulatory requirements, AWS has formed a strategic technology collaboration with NWCD to operate and provide services from the AWS China (Ningxia) Region.

AWS 67

AWS Cloud Energy Education 67

All Things Distributed

AUGUST 20, 2012

Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. Amazon Glacier integrates seamlessly with other AWS services such as Amazon S3 and the different AWS Database services.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Today, I’m happy to announce that the Asia Pacific (Mumbai) Region is generally available for use by customers worldwide. For more details, see the case studies at All AWS Customer Stories. In addition, Change Healthcare.

AWS 90

AWS Cloud Healthcare Blockchain 90

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Networking. Casey Rosenthal (traffic and chaos) Models of Availability. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Networking. Casey Rosenthal (traffic and chaos) Models of Availability. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix.

Tuning 52

Tuning AWS Best Practices Network 52

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 112

AWS Cloud Games Latency 112

The Netflix TechBlog

MAY 21, 2019

Choose the most promising subset of tests out of thousands of test cases available when running continuous integration against a device. We wanted the to tool be available as a standalone library as well as scalable API service. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. The Kubernetes experience.

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Adrian Cockcroft

APRIL 7, 2023

Sunset in Morocco — photo taken by Adrian We want to reduce carbon emissions of our compute and storage workloads, and one way of doing this is to choose a time and place where the “grid mix” of energy consumed is less carbon intensive. AWS calls this an Insufficient Capacity Exception (ICE) and works very hard to avoid it.

Energy 52

Energy AWS Azure Cloud 52

Scalegrid

JANUARY 8, 2024

Infrastructure Excellence ScaleGrid’s infrastructure is designed to facilitate hosting in your cloud account and provides cost-saving options with AWS or Azure Reserved Instances or GCP. This results in faster response times and reduced network traffic, enhancing the overall efficiency and effectiveness of cloud services.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

MARCH 5, 2012

Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. Driving costs down for our customers is part of the DNA of Amazon and therefore also part of the DNA of AWS. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. When providing some functionality for processing a file uploaded by the user, the file must be available to the process throughout the execution. Leonardo Losoviz. 2018-11-08T12:30:30+01:00. 2019-04-29T18:34:58+00:00.

AWS 44

AWS Servers Storage Cloud 44

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Additionally customers are not restricted to AWS services; they can mix-and-match services from other providers to best meet their needs. There are some excellent platforms running on AWS that do precisely this; Ruby on Rails developers have Heroku. Comments ().

AWS 115

AWS Cloud Java Operating System 115

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Choosing a cloud DBMS: architectures and tradeoffs Tan et al.,

Architecture 76

Architecture Cloud Storage Serverless 76

Dynatrace

JUNE 27, 2023

Logs complement out-of-the-box metrics and enable automated actions for responding to availability, security, and other service events. Many AWS services and third party solutions use AWS S3 for log storage. A Dynatrace S3 log forwarder has been available for some time to early adopters, with community support only.

AWS 198

AWS Cloud Lambda Analytics 198

The Netflix TechBlog

JULY 30, 2019

Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra External Payload Storage External payload storage was implemented to prevent the usage of Conductor as a data persistence system and to reduce the pressure on its backend datastore.

Lambda 189

Lambda Media Open Source Metrics 189

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors.

Innovation 146

Innovation AWS Education Network 146

Percona

DECEMBER 11, 2023

There are a wealth of options on how you can approach storage configuration in Percona Operator for PostgreSQL , and in this blog post, we review various storage strategies — from basics to more sophisticated use cases. For example, you can choose the public cloud storage type – gp3, io2, etc, or set file system.

Storage 108

Storage Strategy Cloud Azure 108

All Things Distributed

DECEMBER 5, 2010

I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments.

Cloud 117

Cloud Internet Internet AWS 117

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

O'Reilly

DECEMBER 2, 2019

The most obvious change 5G might bring about isn’t to cell phones but to local networks, whether at home or in the office. High-speed networks through 5G may represent the next generation of cord cutting. Those waits can be significant, even if you’re on a corporate network. Let’s get back to home networking.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

The Symphonia

JUNE 19, 2018

This summer also marks the 4-yearly event that is La Copa Mundial (we only get Telemundo in my apartment, not Fox Sports Network) but since the good old US of A are absent from the men’s World Cup this year, football fever is distinctly frigid. Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage?

Serverless 40

Serverless AWS DevOps Open Source 40

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Rendering on AWS provides the flexibility to control how quickly a project is completed. By: Peter Cioni (Netflix), Alex Schworer (Netflix), Mac Moore (Conductor Tech.),

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Adrian Cockcroft

APRIL 18, 2018

This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads. Monitoring systems are a critical part of any highly available system, as they are needed to detect failures and report whether users are impacted, then report whether the problem has gone away.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Dotcom-Montior

OCTOBER 6, 2021

Availability. One minute an SRE might be provisioning storage in AWS, the next minute an SRE might have to talk to customers or go write some Python code for a new project. Let us dig into this deeper to understand more about this role and how it functions within organizations. Performance. Monitoring. Incident Response.

Engineering 67

Engineering DevOps Monitoring Google 67

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. At Dynatrace, we’re constantly improving our AWS monitoring capabilities. Monitor and understand additional AWS services. Get up to 300 new AWS metrics out of the box.

AWS 136

AWS Metrics IoT Storage 136