ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. Figure 2: Latency characteristics of memory technologies (source: Maruf et al.,

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. energy consumption).

Energy 130

Energy Latency Performance Network 130

All Things Distributed

NOVEMBER 26, 2013

About 5 years ago, I introduced you to AWS Availability Zones, which are distinct locations within a Region that are engineered to be insulated from failures in other Availability Zones and provide inexpensive, low latency network connectivity to other Availability Zones in the same region.

Cloud 145

Cloud AWS Traffic Latency 145

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

The Symphonia

MAY 22, 2018

I started writing “ Serverless Architectures ” in May 2016. I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. I thought a few folks might be interested.

Serverless 40

Serverless Architecture Lambda Azure 40

The Netflix TechBlog

NOVEMBER 3, 2022

by Tomasz Bak and Fabio Kung Introduction Titus is the Netflix cloud container runtime that runs and manages containers at scale. The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a

Cache 224

Cache Latency Traffic Systems 224

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. cachestat File system cache statistics line charts. runqlat CPU scheduler latency heat map. The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed.

Latency 145

Latency Cache Energy Systems 145

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. While registrars manage the namespace in the DNS naming architecture, DNS servers are used to provide the mapping between names and the addresses used to identify an access point. There are two main types of DNS servers: authoritative servers and caching resolvers.

Cloud 117

Cloud Internet Internet AWS 117

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load.

Cache 130

Cache Storage Scalability Architecture 130

The Netflix TechBlog

SEPTEMBER 24, 2021

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. Uploading and downloading data always come with a penalty, namely latency. Supporting those workflows poses new challenges to our packaging service.

Cloud 237

Cloud Media Storage Cache 237

O'Reilly Software

JUNE 12, 2018

In fact, before we even had the word microservices in our lexicon, back when it was just good old-fashioned service-oriented architecture, we were talking about data: how to access it, where it lives, who “owns” it. The advent of the cloud was a huge boon to the work we were doing, as the improved automation made us even more productive.

Database 72

Database Cache Architecture Latency 72

Dynatrace

MAY 13, 2022

Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. You can also quickly scale out the capacity of your existing on-premises or cloud self-hosted Apache Cassandra clusters. Seeing the value.

Azure 231

Azure Latency Metrics Infrastructure 231

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. cachestat File system cache statistics line charts 7. runqlat CPU scheduler latency heat map 10. The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed.

Open Source 40

Open Source Latency Cache Energy 40

Scalegrid

FEBRUARY 8, 2024

Distributed Storage Architecture Distributed storage systems are designed with a core framework that includes the main system controller, a data repository for the system, and a database. Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

OCTOBER 26, 2020

Helios: hyperscale indexing for the cloud & edge , Potharaju et al., Helios also serves as a reference architecture for how Microsoft envisions its next generation of distributed big-data processing systems being built. Why do we need a new reference architecture? PVLDB’20. Emphasis mine ). Emphasis mine ).

Cloud 104

Cloud Big Data Latency Architecture 104

All Things Distributed

SEPTEMBER 3, 2013

Today, we added two important choices for customers running high performance apps in the cloud: support for Redis in Amazon ElastiCache and a new high memory database instance (db.cr1.8xlarge) for Amazon RDS. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 129

Cache Cloud Performance Retail 129

Adrian Cockcroft

JANUARY 20, 2023

Here’s some predictions I’m making: Jack Dongarra’s efforts to highlight the low efficiency of the HPCG benchmark as an issue will influence the next generation of supercomputer architectures to optimize for sparse matrix computations. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. Data lakehouses deliver the query response with minimal latency.

Artificial Intelligence 201

Artificial Intelligence Analytics Storage Government 201

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 51

Latency C++ Hardware Performance 51

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That’s mapping applications to the specific architectural choices. That means multiple data indirections mean multiple cache misses.

Internet 121

Internet Internet Scalability Automotive 121

Dynatrace

NOVEMBER 3, 2021

Organizations are depending more and more on distributed architectures to provide application services. For example, when monitoring a database, you’ll want to know about any latency when writing data to a disk or average query response time. Dynatrace news. This trend is prompting advances in both observability and monitoring.

Monitoring 213

Monitoring Metrics DevOps Scalability 213

Percona

MARCH 20, 2023

When designing an architecture, many components need to be considered before deciding on the best solution. In this context, features like filtering, firewalling, or caching are redundant and may consume resources that could be allocated to scaling. MySQL Router is the one that has the higher latency no matter what.

Games 122

Games Latency Traffic Cache 122

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

Percona

JULY 17, 2023

Those problems (some with shared elements) include: High cost and complicated pricing structure : Many companies say MongoDB has an expensive and complicated pricing structure ( Cloud Zero, January 2023 ). Redis can handle a high volume of operations per second, making it useful for running applications that require low latency.

Open Source 77

Open Source Database Scalability Software 77

ACM Sigarch

DECEMBER 6, 2018

Each of these categories opens up challenging problems in AI/visual algorithms, high-density computing, bandwidth/latency, distributed systems. To foster research in these categories, we provide an overview of each of these categories to understand the implications on workload analysis and HW/SW architecture research.

Wireless 54

Wireless IoT Analytics Architecture 54

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Cross-region Replication.

Database 167

Database Lambda AWS IoT 167

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! ASPLOS’19.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

SEPTEMBER 10, 2019

That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. to understand YouTube video performance) drive tens of thousands of canned (known in advance) queries per second, that need to be served with latency in the tens of milliseconds.

Analytics 75

Analytics Latency Cache Google 75

Abhishek Tiwari

NOVEMBER 3, 2018

Although some vendors have added support for APIs and cloud services most have not even bothered to adapt with changing technology landscape. In addition, traditional CMS solutions lack integration with modern software stack, cloud services, and software delivery pipelines. There is hardly any innovation from traditional CMS vendors.

Systems 63

Systems Cache Website Network 63

The Morning Paper

APRIL 14, 2019

Microarchitectural state of interest includes data and instruction caches, TLBs, branch predictors, instruction- and data-prefetcher state machines, and DRAM row buffers. “ Preventing side-channel attacks between VMs hosted on public cloud infrastructure. So these on-core caches must be flushed on a domain switch.

Hardware 44

Hardware Cache Latency Speed 44

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. With Amazon DynamoDB, developers scaling cloud-based applications can start small with just the capacity they need and then increase the request capacity of a given table as their app grows in popularity.

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

MAY 15, 2023

Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition. Best practices indicate that having ProxySQL closer to the application will be more efficient, especially if we decide to activate the caching feature.

Traffic 125

Traffic Scalability Database Servers 125

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. DBLog High Level Architecture. High Availability DBLog uses active-passive architecture. Proceedings of the Third ACM Symposium on Cloud Computing. Figure 3?—?DBLog

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. DBLog High Level Architecture. High Availability DBLog uses an active-passive architecture. Proceedings of the Third ACM Symposium on Cloud Computing. Figure 3?—?DBLog

Database 212

Database Traffic Transportation Open Source 212