All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Cloud-hosted Kubernetes clusters are on par to overtake on-premises deployments in 2023.

Open Source 340

Open Source Java Operating System Programming 340

Scalegrid

APRIL 16, 2020

AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure. AWS , Azure , DigitalOcean. Are you a startup that has free AWS or Azure hosting credits you’d like to use for your database hosting? Do you want to deploy in an AWS VPC or Azure VNET?

Cloud 242

Cloud Azure AWS Database 242

CSS - Tricks

APRIL 28, 2022

While CloudFront’s edge caching does offer benefits, serving your app’s resources from these multiple locations is not without a cost of its own. We’ll be changing DNS records and, depending on your web app, you may have to add some cache headers in order to prevent certain assets from ever being cached. Setting up our DNS.

Cache 79

Cache AWS Servers Traffic 79

Speed Curve

FEBRUARY 5, 2024

Caching the base page/HTML is common, and it should have a positive impact on backend times. Key things to understand from your CDN Cache Hit/Cache Miss – Was the resource served from the edge, or did the request have to go to origin? This can include a lot of different service layers, not just serving from cache.

Servers 57

Servers Cache Retail Benchmarking 57

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 Reads usually have apps waiting on them; writes may not (write-back caching). Counting cache functions. 17 48011 [.].

Cache 105

Cache C++ AWS Latency 105

The Symphonia

JANUARY 21, 2019

Since we use so many AWS services in our work, it makes sense that we also consider AWS tools for CI/CD. What are the AWS Continuous Integration / Continuous Delivery tools? AWS have a bunch of different products in this area grouped into their “CodeSuite” developer tools : CodeCommit is their managed Git service.

AWS 40

AWS Open Source Lambda Serverless 40

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

All Things Distributed

MARCH 5, 2012

Driving Compute Cost Down for AWS Customers. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. Amazon ElastiCache customers will see their prices drop by up to 10%, depending on their cache node types. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

Smashing Magazine

AUGUST 3, 2023

It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further. Their primary role is to store (or “cache”) copies of web content — like HTML pages, JavaScript files, and multimedia content — and deliver it to users based on their geographic location.

Performance 74

Performance Cache Traffic Metrics 74

Percona

DECEMBER 23, 2022

The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. The storage device has performance characteristics pretty similar to an AWS gp2 EBS volume of about 330 GB in size. The following figure illustrates the impacts.

Storage 56

Storage Cache C++ Virtualization 56

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. Comments ().

Cloud 117

Cloud Cache AWS Storage 117

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. The cache is kept in sync with the current leader process. How do I know that my cache is up to date? of the data.

Cache 224

Cache Latency Traffic Systems 224

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform is a revolution in the way we handle infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

Dynatrace

OCTOBER 4, 2022

Data lakehouses take advantage of low-cost object stores like AWS S3 or Microsoft Azure Blob Storage to store and manage data cost-effectively. By applying massively parallel processing and high-performance caches, all this contextualized data can be interrogated at high speeds for ad-hoc analytics or AI-powered precise answers.

Artificial Intelligence 205

Artificial Intelligence Analytics Storage Government 205

Brendan Gregg

APRIL 14, 2022

The Netflix stack is more diverse than I was expecting, and is explained in detail in the [Netflix tech blog]: The production cloud is AWS EC2, Ubuntu Linux, Intel x86, mostly Java with some Node.js (and other languages), microservices, Cassandra (storage), EVCache (caching), Spinnaker (deployment), Titus (containers), Apache Spark (analytics), Atlas (..)

Java 145

Java Cloud Cache AWS 145

IO River

NOVEMBER 2, 2023

‍Think of a situation where you're asked to build a service in AWS that distributes static content to your users. Your first option is to use its native CDN - Amazon CloudFront, as it seamlessly integrates with all of your other AWS Services that you're using to build your service.‍For What is vendor lock-in?‍Think

Lambda 52

Lambda AWS Cache Website 52

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

The Morning Paper

MARCH 8, 2020

If all data was read from S3 every time, performance would suffer, so of course Snowflake has a caching layer – a distributed ephemeral storage service shared by all the nodes in a warehouse. The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. Elasticity.

Storage 112

Storage Engineering Cache Serverless 112

Percona

MARCH 27, 2023

This release adds the GCache encryption and Write-Set cache encryption feature in tech preview , along with improvements and bug fixes introduced by Oracle for MySQL 8.0.31. This release is focused on the Percona XtraDB Cluster-based deployment variation. Download Percona Distribution for MySQL (PXC-based variant) 8.0.31 was released.

Open Source 79

Open Source Servers Scalability Cache 79

CSS - Tricks

DECEMBER 21, 2021

New HTTP standards for caching on the modern web — Tim Perry gets into two brand new (proposed) caching headers: Cache-Status and Targetted Cache-Control. ” Feels like good stuff where web standards can come in and fix up a gnarly situation.

Performance 61

Performance Cache Media Games 61

Smashing Magazine

JULY 18, 2022

The “stale-while-revalidate” cache control strategy can reduce the TTFB issue by serving a cached version of the page until it’s updated. Once you understand that it’s all about caching renders and then getting the right cached render for each request, everything will click into place. And now we even pay for it!

Cache 114

Cache Website Energy Servers 114

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Query performance is measured from both warm and cold caches.

Architecture 76

Architecture Cloud Storage Serverless 76

CSS - Tricks

SEPTEMBER 2, 2021

HTTP Caching is a Superpower — Hugh Haworth covers how the Cache-Control header is an awfully potent ingredient in web performance. I mis-read the title at first and was waiting to read about HTML caching. I only do it now because Cloudflare handles it.

Performance 53

Performance Cache AWS Technology 53

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform is a revolution in the way we handle infrastructure. Hold that thought.

Open Source 40

Open Source DevOps AWS Azure 40

Adrian Cockcroft

JANUARY 20, 2023

Clouds using Ethernet that are multipath optimized using libfabric and features like EFA on AWS are going to be increasingly competitive, and Ethernet will replace other interconnects between racks. AWS has invested in optimizing Ethernet for HPC via the Elastic Fabric Adaptor (EFA) option, and the l ibfabric library. Comparing CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

IO River

NOVEMBER 2, 2023

Think of a situation where you're asked to build a service in AWS that distributes static content to your users. CloudFront makes a simple choice here as it offers direct integration with all these services to let you cache responses across its global edge locations. What is vendor lock-in?‍Think

Lambda 52

Lambda AWS Cache Website 52

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction. They are very expensive.

Internet 121

Internet Internet Scalability Automotive 121

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. Then, you need to set up a bucket and IAM role on AWS, which is outside the scope of this article, but you can see instructions for here. Client-Side Caching.

Media 69

Media Cache Storage AWS 69

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 Reads usually have apps waiting on them; writes may not (write-back caching). This is "cache busting." 17 48011 [.]

Cache 40

Cache C++ AWS Systems 40

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

HammerDB

APRIL 19, 2023

For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 By default, HammerDB is designed to take advantage of database system caching mechanisms such as buffer caches, query caches, or statement caches.

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

DECEMBER 18, 2012

After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. Jul 4 - Leases: An efficient fault-tolerant mechanism for distributed file cache consistency , Gray, Cary, and David Cheriton, Vol.

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

NOVEMBER 26, 2013

As I discussed in my re:Invent keynote earlier this month, I am now happy to announce the immediate availability of Amazon RDS Cross Region Read Replicas , which is another important enhancement for our customers using or planning to use multiple AWS Regions to deploy their applications. Cross Region Read Replicas are available for MySQL 5.6

Cloud 145

Cloud AWS Traffic Latency 145

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. There are two main types of DNS servers: authoritative servers and caching resolvers. Some fundamentals on Naming. No lock-in. Contact Info.

Cloud 117

Cloud Internet Internet AWS 117

CSS - Tricks

MAY 3, 2021

Linux; Android 6.0.1; Moto G (4)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.85 Mobile Safari/537.36 PTST/210419.211328", "accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9", image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",

Transportation 86

Transportation Cache Google Mobile 86