The Morning Paper

AUGUST 29, 2019

Choosing a cloud DBMS: architectures and tradeoffs Tan et al., If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems.

Architecture 76

Architecture Cloud Storage Serverless 76

All Things Distributed

AUGUST 22, 2011

Expanding the Cloud - Introducing Amazon ElastiCache. Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Systems that make extensive use of caching almost all report a significant reduction in the cost of their database tier. Comments ().

Cloud 116

Cloud Cache AWS Storage 116

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 140

Cloud AWS Traffic Latency 140

Brendan Gregg

APRIL 14, 2022

I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive [work culture]. I could help not only Netflix but all customers of the cloud. Netflix has been the best job of my career so far, and I'll miss my colleagues and the culture. offer letter logo (2014). flame graphs (2014). eBPF tools (2014-2019).

Java 145

Java Cloud Cache AWS 145

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03

Cache 105

Cache C++ AWS Latency 105

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. All Things Distributed. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud 117

Cloud Internet Internet AWS 117

Percona

DECEMBER 23, 2022

The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. The storage device has performance characteristics pretty similar to an AWS gp2 EBS volume of about 330 GB in size. The following figure illustrates the impacts.

Storage 55

Storage Cache C++ Virtualization 55

The Symphonia

JANUARY 21, 2019

Fast forward to today : CI/CD, and deployment automation in general, are key to how John and I work with clients at Symphonia : it doesn’t matter if you’re using all the fanciest new cloud technology if you’re still waiting weeks to put new functionality into production. What are the AWS Continuous Integration / Continuous Delivery tools?

AWS 40

AWS Open Source Lambda Serverless 40

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Without cloud-based rendering, this ambitious project would not have met its targeted delivery date!

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Dynatrace

OCTOBER 7, 2021

For many companies, the journey to modern cloud applications starts with serverless. Amazon Web Services (AWS), offers a wide range of serverless solutions. To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases.

Serverless 273

Serverless AWS Lambda Storage 273

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error.

Performance 54

Performance Benchmarking Cache Storage 54

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe.

Cache 224

Cache Latency Traffic Systems 224

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. I could help not only Netflix but all customers of the cloud.

Java 52

Java Cache Cloud AWS 52

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03

Cache 40

Cache C++ AWS Systems 40

All Things Distributed

AUGUST 17, 2011

My templates and blog posts are now located in DropBox and thus locally cached at each machine I use. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. Expanding the Cloud â?? Introducing the AWS South America (Sao Paulo) Region.

Servers 125

Servers Social Media AWS Website 125

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. It is worth pointing out that cloud processing is always subject to variable network conditions.

Cloud 237

Cloud Media Storage Cache 237

The Morning Paper

JUNE 16, 2019

In the prototype implementation, policies are expressed in a language similar to Google Cloud Firestore security rules. The amount of computation required on a base update can be reduced by sharing computation and cached data between universes. Expressing privacy policies.

Database 90

Database Cache Benchmarking Efficiency 90

The Netflix TechBlog

NOVEMBER 9, 2022

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). As GS2 relies on AWS EC2 Auto Scaling to target-track CPU utilization, we thought we just had to redeploy the service on the larger instance type and wait for the ASG (Auto Scaling Group) to settle on the CPU target. Thread 0’s cache in this example.

Hardware 363

Hardware Cache Performance Latency 363

The Netflix TechBlog

OCTOBER 18, 2019

In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached. Their training infrastructure relies on a hybrid cloud approach. Finally, Elliot ended by talking about some of the challenges in building this Bandit framework.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

The Netflix TechBlog

OCTOBER 18, 2019

In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached. Their training infrastructure relies on a hybrid cloud approach. Finally, Elliot ended by talking about some of the challenges in building this Bandit framework.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

The Symphonia

MAY 22, 2018

I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. and products like AWS Fargate have made this distinction murkier still. Because of course it did.

Serverless 40

Serverless Architecture Lambda Azure 40

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. AWS offers its customers a choice of different database services, each optimized for different workloads.

Cache 125

Cache Cloud Performance Retail 125

The Netflix TechBlog

MARCH 8, 2021

One of our first partners for the Netflix Workstations is NetFX , a cloud-based VFX platform that enables vendors, artists, and creators worldwide to collaborate on Netflix VFX content. Below is a broad technical overview of how to go from an AWS instance to a Netflix Workstation. Now that you know why, here is how we did it.

Entertainment 306

Entertainment Storage Hardware Open Source 306

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started As businesses grow and demand fluctuates, infrastructure needs to adapt.

Open Source 52

Open Source DevOps AWS Azure 52

High Scalability

FEBRUARY 19, 2019

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

Availability 204

Availability Open Source Cache Storage 204

Smashing Magazine

JULY 18, 2022

The “stale-while-revalidate” cache control strategy can reduce the TTFB issue by serving a cached version of the page until it’s updated. Once you understand that it’s all about caching renders and then getting the right cached render for each request, everything will click into place. And now we even pay for it!

Cache 117

Cache Website Energy Servers 117

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. As businesses grow and demand fluctuates, infrastructure needs to adapt.

Open Source 40

Open Source DevOps AWS Azure 40

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

All Things Distributed

JULY 14, 2015

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. An AWS Lambda function is a simpler option that you can use, as it only requires you to code the logic, set it, and forget it.

Database 167

Database Lambda AWS IoT 167

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. By applying massively parallel processing and high-performance caches, all this contextualized data can be interrogated at high speeds for ad-hoc analytics or AI-powered precise answers.

Artificial Intelligence 201

Artificial Intelligence Storage Analytics Government 201

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 117

Speed Cache Latency AWS 117

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That means multiple data indirections mean multiple cache misses. It would mean a great deal to me. They'll love you even more.

Internet 121

Internet Internet Scalability Automotive 121

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. It also supports storing the backups on filesystem and AWS S3 buckets. mongodb-27017.sock

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com.

Internet 125

Internet Internet AWS Performance 125