The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., What is the end-to-end throughput and latency, and where are the bottlenecks? energy consumption). Future 5G Standalone Architecture (SA) deployments with a native 5G control plane will not have this problem.

Energy 130

Energy Latency Performance Network 130

Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications. This is equivalent to driving 123 gas-powered cars for a whole year.

Cache 203

Cache Azure Infrastructure Monitoring 203

Dynatrace

SEPTEMBER 13, 2023

Because Google offers its own Google Cloud Architecture Framework and Microsoft its Azure Well-Architected Framework , organizations that use a combination of these platforms triple the challenge of integrating their performance frameworks into a cohesive strategy. SRG validates the status of the resiliency SLOs for the experiment period.

AWS 245

AWS Efficiency Azure Cloud 245

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. A combination of these mechanisms may be necessary to tackle challenges arising from heterogeneous memory systems and NUMA architectures. even lowered the latency by introducing a multi-headed device that collapses switches and memory controllers.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

OCTOBER 11, 2020

Only space system architects don’t call it request-response, they call it a ‘ bent-pipe architecture.’. The CubeSat form-factor limits what can be packed into the device and how much power is available. Without higher-risk deployable solar arrays, a cubesat relies on surface-mounted solar panels to harvest energy.

Systems 125

Systems Latency Architecture Energy 125

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed. execsnoop New processes (via exec(2)) table. at the time.

Latency 145

Latency Cache Energy Systems 145

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50. The paper is silent on this issue.

Hardware 58

Hardware Latency Serverless Energy 58