All Things Distributed

OCTOBER 17, 2016

The Ohio Region is the fifth AWS region in the US. It brings the worldwide total of AWS Availability Zones (AZs) to 38, and the number of regions globally to 14. The pace of expansion at AWS is accelerating, and Ohio is our third region launch this year. We are also glad to offer low transfer rates between both US East Regions.

AWS 127

AWS Cloud Infrastructure Analytics 127

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems.

Architecture 76

Architecture Cloud Storage Serverless 76

InfoQ

DECEMBER 29, 2023

Zendesk reduced its data storage costs by over 80% by migrating from DynamoDB to a tiered storage solution using MySQL and S3. The company considered different storage technologies and decided to combine the relational database and the object store to strike a balance between querybility and scalability while keeping the costs down.

Storage 132

Storage Scalability Database Technology 132

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform.

Open Source 343

Open Source Java Operating System Programming 343

Dynatrace

OCTOBER 7, 2021

Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Scalability. Simplicity.

Serverless 280

Serverless AWS Lambda Storage 280

Dynatrace

NOVEMBER 20, 2023

At the AWS re:Invent 2023 conference, generative AI is a centerpiece. In this AWS re:Invent 2023 guide, we explore the role of generative AI in the issues organizations face as they move to the cloud: IT automation, cloud migration and digital transformation, application security, and more.

AWS 209

AWS Artificial Intelligence Analytics Cloud 209

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Register for AWS re: Invent. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. All Things Distributed. By Werner Vogels on 16 July 2012 09:00 AM. Comments (). See the site for more details.

AWS 85

AWS Big Data Media Storage 85

All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. This week it is an opening for senior leaders with AWS Database Services. Countdown to What is Next in AWS.

AWS 77

AWS Database Storage Scalability 77

The Netflix TechBlog

MAY 21, 2019

Solution We built a system called Lerner that consists of a set of microservices and a python library that allows scalable agent training and inference for test case scheduling. We wanted the to tool be available as a standalone library as well as scalable API service. which allows fast deployment times and rapid scalability.

Testing 163

Testing AWS Lambda Network 163

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Amazon RDS Provisioned IOPS is ideal for mission-critical online transaction processing (OLTP) workloads that require a high performance storage option with consistent IOPS, within a narrow band of tolerance. s architecture. Expanding the Cloud â??

Cloud 118

Cloud AWS Storage Database 118

Dynatrace

DECEMBER 5, 2023

Without observability, the benefits of ARM are lost Over the last decade and a half, a new wave of computer architecture has overtaken the world. ARM architecture, based on a processor type optimized for cloud and hyperscale computing, has become the most prevalent on the planet, with billions of ARM devices currently in use.

Efficiency 266

Efficiency Architecture Energy Monitoring 266

Dynatrace

JUNE 27, 2023

The increasing complexity of cloud service architectures requires a rock-solid understanding of the activity, health status, and security of cloud services. Many AWS services and third party solutions use AWS S3 for log storage. Another painful blocker is the need for more support for multiple S3 accounts and AWS regions.

AWS 198

AWS Cloud Lambda Analytics 198

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 130

Cloud Energy AWS Healthcare 130

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. All Things Distributed. The Back-to-Basics Readings of 2012.

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. All Things Distributed. Comments (). Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners.

Innovation 149

Innovation AWS Education Network 149

Scalegrid

MARCH 14, 2024

This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential. The architecture usually integrates several private, public, and on-premises infrastructures. A hybrid cloud strategy could be your answer.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better.

AWS 77

AWS Storage Cloud Best Practices 77

Scalegrid

JANUARY 8, 2024

Key Takeaways Multi-cloud involves using services from multiple cloud providers to gain flexibility and reduce vendor lock-in, while hybrid cloud combines private and public cloud resources to balance control and scalability. But what is the purpose behind this model?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud 119

Cloud AWS Automotive Latency 119

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS 68

AWS Cloud Benchmarking Storage 68

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. All Things Distributed. Comments (). Some fundamentals on Naming.

Cloud 117

Cloud Internet Internet AWS 117

High Scalability

APRIL 16, 2019

At ScaleGrid, we offer highly available hosting for MySQL on AWS and MySQL on Azure that is implemented based on the concepts explained in this blog series. This concludes our 3-part blog series on the MySQL High Availability (HA) framework using semisynchronous replication and the Corosync plus Pacemaker stack.

Availability 149

Availability Network Azure AWS 149

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Dynatrace

AUGUST 11, 2022

Before an organization moves to function as a service, it’s important to understand how it works, its benefits and challenges, its effect on scalability, and why cloud-native observability is essential for attaining peak performance. FaaS vs. monolithic architectures. But what is FaaS? What is FaaS? But how does FaaS fit in?

Development 250

Development Serverless Best Practices Lambda 250

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. He hasn’t changed. So many global friendships were made that continue to today.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Dynatrace

OCTOBER 6, 2023

Buckets are similar to folders, a physical storage location. Debug-level logs, which also generate high volumes and have a shorter lifespan or value period than other logs, could similarly benefit from dedicated storage. Suppose a single Grail environment is central storage for pre-production and production systems.

Artificial Intelligence 261

Artificial Intelligence Analytics Metrics Storage 261

ScaleOut Software

JANUARY 9, 2020

In addition, the platform provides fast, in-memory data storage so that the application can easily and quickly record both telemetry and analytics results for each store. This dramatically simplifies application code and automatically scales its use by letting the execution platform run this code simultaneously for all stores.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

In addition, the platform provides fast, in-memory data storage so that the application can easily and quickly record both telemetry and analytics results for each store. This dramatically simplifies application code and automatically scales its use by letting the execution platform run this code simultaneously for all stores.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

In addition, the platform provides fast, in-memory data storage so that the application easily can keep track of both telemetry and analytics results for each store. This dramatically simplifies application code and automatically scales its use by letting the execution platform run this code simultaneously for all stores.

Logistics 52

Logistics Retail Analytics Azure 52

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

High Scalability

JULY 20, 2018

That’s mapping applications to the specific architectural choices. The third wing of the architecture piece is the “domain specific system-on-chip.” And you already see that in machine learning, where there’s a really hot field in terms of deep neural nets and other implementations. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. The original Dynamo design was based on a core set of strong distributed systems principles resulting in an ultra-scalable and highly reliable database system.

Scalability 167

Scalability Database Ecommerce Latency 167

The Netflix TechBlog

DECEMBER 3, 2019

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. both for compute and storage. For more details, read this page about Metaflow’s integration with AWS.

Open Source 232

Open Source AWS Infrastructure Energy 232

The Netflix TechBlog

APRIL 26, 2022

Figure 1: Netflix ML Architecture Fact: A fact is data about our members or videos. The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. An example of video data is video metadata, like the length of a video.

Storage 187

Storage Design Scalability Latency 187