The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? It is advantageous in the cloud to shut down compute resources when they are not being used, but there is then a query latency cost.

Architecture 76

Architecture Cloud Storage Serverless 76

cdemi

FEBRUARY 20, 2017

Serverless is currently a hot topic in many modern architectural patterns. There will be many advances in the field over the coming years and it will be fascinating to see how they fit into our architectural toolkit. Whether you choose Azure Functions or AWS Lambda, you cannot easily switch to another. Amazon: AWS Lambda.

Serverless 64

Serverless Architecture Lambda Azure 64

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

All Things Distributed

SEPTEMBER 25, 2012

Expanding the Cloud â?? Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS). s architecture.

Cloud 117

Cloud AWS Storage Database 117

Scalegrid

MARCH 14, 2024

Mastering Hybrid Cloud Strategy Are you looking to leverage the best private and public cloud worlds to propel your business forward? A hybrid cloud strategy could be your answer. This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dotcom-Montior

NOVEMBER 11, 2020

those resources now belong to cloud providers, such as AWS Lambda, Google Cloud Platform, Microsoft Azure, and others. In serverless architecture, when applications are developed, they are typically composed of many different services. Other benefits to serverless architecture include the following: Cost.

Serverless 57

Serverless Monitoring Lambda Latency 57

The Symphonia

MAY 22, 2018

I started writing “ Serverless Architectures ” in May 2016. I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. and products like AWS Fargate have made this distinction murkier still. AWS API Gateway , and its associated tooling, has got much, much better.

Serverless 40

Serverless Architecture Lambda Azure 40

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. By Werner Vogels on 12 July 2010 05:00 PM. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. All Things Distributed. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

NOVEMBER 8, 2012

Improving the Cloud - More Efficient Queuing with SQS. For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. Similarly, AWS customers have been using SQS in interesting ways.

Efficiency 104

Efficiency Cloud Games Scalability 104

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Dynatrace

NOVEMBER 10, 2022

As companies accelerate digital transformation, cloud services such as AWS Lambda help companies to modernize their application architectures to quickly adapt to the needs of their customers while offloading the operational complexity to their cloud vendor. to better understand AWS Lambda behaviour such as cold starts.

Lambda 228

Lambda Serverless AWS Latency 228

ScaleOut Software

APRIL 6, 2021

With the ScaleOut Digital Twin Streaming Service , an Azure-hosted cloud service, ScaleOut Software introduced breakthrough capabilities for streaming analytics using the real-time digital twin concept. Scaleout StreamServer® DT was created to meet this need.

IoT 52

IoT Azure Analytics Healthcare 52

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. Uploading and downloading data always come with a penalty, namely latency. Supporting those workflows poses new challenges to our packaging service.

Cloud 237

Cloud Media Storage Cache 237

High Scalability

MARCH 1, 2019

It's HighScalability time: 10 years of AWS architecture increasing simplicity or increasing complexity? Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It was made possible by using a low latency of 0.1 seconds, the lower the latency, the more responsive the robot.

Internet 33

Internet Internet Scalability Blockchain 33

VoltDB

JUNE 1, 2017

Private Clouds made of commodity hardware are perceived as the logical solution to this problem. In this case, what’s needed from a private cloud is lots of lightweight copies of what a production environment looks like, with heavy sharing of physical hardware. Latency Optimizers” – need support for very large federated deployments.

Hardware 56

Hardware Latency Virtualization Cloud 56

All Things Distributed

NOVEMBER 19, 2010

Here are some the links I shared this week on twitter and facebook : Cloud Computing. There were blog posts by Jeff Barr The Cluster GPU Instance and James Hamilton HPC in the Cloud with GPGPUs , as well as my background posting: Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances.

AWS 67

AWS Cloud Benchmarking Storage 67

O'Reilly

DECEMBER 2, 2019

For applications like communication between AVs, latency–how long it takes to get a response–is more likely to be a bigger limitation than raw bandwidth, and is subject to limits imposed by physics. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions. Mike Loukides.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

VoltDB

JUNE 1, 2017

Private Clouds made of commodity hardware are perceived as the logical solution to this problem. In this case, what’s needed from a private cloud is lots of lightweight copies of what a production environment looks like, with heavy sharing of physical hardware. Latency Optimizers” – need support for very large federated deployments.

Hardware 40

Hardware Latency Virtualization Cloud 40

Dynatrace

JANUARY 26, 2021

VMware commercialized the idea of virtual machines, and cloud providers embraced the same concept with services like Amazon EC2, Google Compute, and Azure virtual machines. Serverless computing is a cloud-based, on-demand execution model where customers consume resources solely based on their application usage. Pay Per Use.

Serverless 241

Serverless Efficiency Lambda Azure 241

Dynatrace

APRIL 7, 2021

But your infrastructure teams don’t see any issue on their AWS or Azure monitoring tools, your platform team doesn’t see anything too concerning in Kubernetes logging, and your apps team says there are green lights across the board. Every component has its own siloed cloud monitoring tool, with its own set of data. The blame game.

Cloud 156

Cloud Monitoring Latency Games 156

Adrian Cockcroft

MAY 6, 2023

Then they tried to scale it to cope with high traffic and discovered that some of the state transitions in their step functions were too frequent, and they had some overly chatty calls between AWS lambda functions and S3. which provides this as a service and where the chief architect and CTO are both ex-Netflix colleagues of mine.

Serverless 145

Serverless Lambda Best Practices Traffic 145

Dynatrace

JANUARY 14, 2022

During a joint webinar , Henrik Rexed (Cloud Native Advocate, Dynatrace) joined us to talk about the Kubernetes challenges and how to leverage Dynatrace observability and Akamas AI-powered optimization to address them. The following figure shows the high-level architecture where any load testing solution (e.g. lower than 2%.).

Latency 197

Latency Tuning Efficiency AWS 197

All Things Distributed

MARCH 26, 2018

At AWS, we don't mark many anniversaries. A concept that has changed infrastructure architecture is now at the core of both AWS and customer reliability and operations. Powering the virtual instances and other resources that make up the AWS Cloud are real physical data centers with AWS servers in them.

AWS 132

AWS Latency Lambda Architecture 132

Dynatrace

MAY 27, 2021

We’re excited to announce Dynatrace has been named as a select launch partner for a newly launched Amazon Web Services (AWS) offering, Amazon ECS Anywhere. This new extension allows customers to deploy native Amazon ECS tasks in any target environment including traditional AWS managed infrastructure and now customer-managed infrastructure.

AWS 131

AWS IoT Virtualization Infrastructure 131

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a

Cache 224

Cache Latency Traffic Systems 224

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Observability relies on telemetry derived from instrumentation that comes from the endpoints and services in your multi-cloud computing environments.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. Data lakehouses deliver the query response with minimal latency.

Artificial Intelligence 202

Artificial Intelligence Storage Analytics Government 202

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. to the broader community.

Performance 211

Performance Latency Open Source Metrics 211

The Netflix TechBlog

FEBRUARY 18, 2022

Motivation With the rapid growth in Netflix member base and the increasing complexity of our systems, our architecture has evolved into an asynchronous one that enables both online and offline computation. Architecture As shown in the diagram above, the RENO service can be broken down into the following components.

Systems 334

Systems Traffic Architecture Mobile 334

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Efficiency 199

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 129

Cache Cloud Performance Retail 129