ACM Sigarch

MAY 31, 2023

There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. Berger (Microsoft) shared the state of memory systems in the public cloud and projected two use cases of CXL-based disaggregated memories in the cloud ( IEEE Micro and ASPLOS’23 ).

Latency 52

Latency Hardware Cache Architecture 52

Dynatrace

NOVEMBER 3, 2021

For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. Examples include a spike in memory utilization, a decrease in cache hit ratio, or an increase in CPU utilization. An automatic and intelligent approach to monitoring and observability.

Monitoring 216

Monitoring Metrics DevOps Scalability 216

Percona

MARCH 20, 2023

When deciding what to pick, there are many things to consider, like where the proxy needs to be, if it “just” needs to redirect the connections, or if more features need to be in, like caching and filtering, or if it needs to be integrated with some MySQL embedded automation. Given that, there never was a single straight answer.

Games 125

Games Latency Traffic Cache 125

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. Cloud Different cloud providers offer a range of instance types and sizes, each with varying amounts of CPU, memory, and storage. Setting oom_score_adj to -800.

Performance 129

Performance Hardware Tuning Storage 129

All Things Distributed

NOVEMBER 26, 2013

About 5 years ago, I introduced you to AWS Availability Zones, which are distinct locations within a Region that are engineered to be insulated from failures in other Availability Zones and provide inexpensive, low latency network connectivity to other Availability Zones in the same region.

Cloud 145

Cloud AWS Traffic Latency 145

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

Adrian Cockcroft

JANUARY 20, 2023

Custom HPC optimized CPUs and GPUs will become the mainstream in the next few years, with chiplets based on the ARM and RISC-V pattern libraries and tooling, with competition between cloud providers, startups and the large systems vendors. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud with DNS - Introducing Amazon Route 53. Often these namespaces are hierarchical in nature such that it becomes easier to manage them and to decentralize control, which makes the system more scalable. All Things Distributed.

Cloud 117

Cloud Internet Internet AWS 117

The Morning Paper

SEPTEMBER 10, 2019

When each of those use cases is powered by a dedicated back-end, investments in better performance, improved scalability and efficiency etc. That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. are divided. Reporting and dashboarding use cases (e.g.

Analytics 75

Analytics Latency Cache Google 75

Percona

JULY 17, 2023

DBAs and developers appreciate its combination of flexibility, scalability, and performance. Those problems (some with shared elements) include: High cost and complicated pricing structure : Many companies say MongoDB has an expensive and complicated pricing structure ( Cloud Zero, January 2023 ). Couchbase — No.

Open Source 79

Open Source Database Scalability Software 79

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe.

Cache 224

Cache Latency Traffic Systems 224

Percona

MAY 15, 2023

One example could be using an RDBMS for most of the Online transaction processing ( OLTP) data shared by country and having the products as distributed memory cache with a different technology. As well, very few cases are in need to have a full system/solution to provide scalability with sharding. Distributed transaction cross-shard.

Traffic 127

Traffic Scalability Database Servers 127

O'Reilly Software

JUNE 12, 2018

The advent of the cloud was a huge boon to the work we were doing, as the improved automation made us even more productive. How do you ensure this is done in a way that is sympathetic to your application’s latency and load conditions? But I kept hitting up against some fundamental issues. How do you do that effectively?

Database 72

Database Cache Architecture Latency 72

Brendan Gregg

JANUARY 17, 2018

It is used for capacity planning and scalability analysis. Short durations can be useful for understanding how well a WSS will fit into the CPU caches (L1/L2/L3, TLB L1/L2, etc). For large processes (> 100 Gbytes) this duration of higher latency can last over 1 second, during which this tool is consuming system CPU time.

Cache 71

Cache Latency C++ Programming 71

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. Hence, the node would still be available for other operations.

Best Practices 52

Best Practices Database Storage Servers 52

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

Brendan Gregg

JANUARY 16, 2018

It is used for capacity planning and scalability analysis. Short durations can be useful for understanding how well a WSS will fit into the CPU caches (L1/L2/L3, TLB L1/L2, etc). For large processes (> 100 Gbytes) this duration of higher latency can last over 1 second, during which this tool is consuming system CPU time.

Cache 40

Cache Latency C++ Programming 40

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. PRPL stands for Pushing critical resource, Rendering initial route, Pre-caching remaining routes and Lazy-loading remaining routes on demand. An application shell is the minimal HTML, CSS, and JavaScript powering a user interface.

Performance 103

Performance Cache Metrics Network 103

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That means multiple data indirections mean multiple cache misses. It would mean a great deal to me. They'll love you even more.

Internet 121

Internet Internet Scalability Automotive 121

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. Today, we are further expanding the choices available for designing and developing highly scalable and high performance apps.

Cache 129

Cache Cloud Performance Retail 129

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. All Things Distributed. Amazon DynamoDB â??

Scalability 167

Scalability Database Ecommerce Latency 167

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database.

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

JULY 14, 2015

Streams provide you with the underlying infrastructure to create new applications, such as continuously updated free-text search indexes, caches, or other creative extensions requiring up-to-date table changes. DynamoDB Streams enables your application to get real-time notifications of your tables’ item-level changes.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. Adding caching when your app is already experiencing load is not easy.

Speed 121

Speed Cache Latency AWS 121

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

Abhishek Tiwari

NOVEMBER 3, 2018

Although some vendors have added support for APIs and cloud services most have not even bothered to adapt with changing technology landscape. In addition, traditional CMS solutions lack integration with modern software stack, cloud services, and software delivery pipelines. There is hardly any innovation from traditional CMS vendors.

Systems 63

Systems Cache Website Network 63

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. " Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing.

Internet 128

Internet Internet AWS Performance 128

Smashing Magazine

AUGUST 20, 2021

Throughout the web’s history, static websites have always been a popular option due to their simplicity, scalability, and security. In addition, they introduced a hosted version of MovableType in 2003 called TypePad to compete with other popular cloud platforms. With MovableType, you had everything you needed to manage your blog.

Ecommerce 139

Ecommerce Website Government Internet 139

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low.

Database 212

Database Traffic Transportation Open Source 212