Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. It was a great privilege.

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. When instances are placed in a cluster they have access to low latency, non-blocking 10 Gbps networking when communicating the other instances in the cluster.

Cloud 118

Cloud AWS Automotive Latency 118

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. We’re therefore proud to announce Premium High Availability for Dynatrace Managed to address exactly this need in a completely turnkey manner without any external load balancing or replication technologies. A similar analysis can be performed on your GRO.

Availability 247

Availability Hardware Latency Traffic 247

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The pipelines can be stateful and the engine’s middleware should provide a persistent storage to enable state checkpointing. Interoperability with Hadoop.

Big Data 154

Big Data Processing Lambda Database 154

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. New Hardware Configuration for Provisioned Compute Tier.

Azure 55

Azure Database Serverless Hardware 55

Dotcom-Montior

MAY 12, 2020

Website and web application technologies have grown tremendously over the years. Websites are now more than just the storage and retrieval of information to present content to users. Network latency. Hardware resources. Network Latency. Network latency can be affected due to. Hardware Resources.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. Vivino has brought AI technology to the world of wine and is all-in on AWS. We launched Edge Network locations in Denmark, Finland, Norway, and Sweden.

AWS 124

AWS Cloud Games Serverless 124

The Morning Paper

MARCH 17, 2020

higher latency and lower bandwidth)… We have found the actual behavior of Optane DIMMs to be more complicated and nuanced than the "slower, persistent DRAM" label would suggest. The read latency for Optane is 2x-3x higher than DRAM. Optane DIMMs are here! Optane memory is also more pattern-dependent than DRAM.

Scalability 59

Scalability Latency Cache Media 59

All Things Distributed

JANUARY 18, 2012

s Dynamo technology , which was one of the first non-relational databases developed at Amazon. Amazon DynamoDB offers low, predictable latencies at any scale. This was not our technology vendorsâ?? Dynamo might have been the best technology in the world at the time but it was still software you had to run yourself.

Scalability 167

Scalability Database Ecommerce Latency 167

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

All Things Distributed

NOVEMBER 15, 2010

For example, the most fundamental abstraction trade-off has always been latency versus throughput. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well. General Purpose GPU programming.

AWS 136

AWS Latency Programming Architecture 136

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Dynatrace

AUGUST 5, 2019

It covers these key areas: Technology & Dependency Analysis. Step 1: Get to Know your Technology & Service Stack. Before starting any migration project, you must have a good overview of all your hosts, processes, services and technologies. Which technologies are candidates to be moved? What’s in your stack?”.

Cloud 31

Cloud Traffic Database Network 31

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version.

Performance 124

Performance Network Cache Metrics 124

High Scalability

SEPTEMBER 14, 2018

72 : signals sensed from a distant galaxy using AI; 12M : reddit posts per month; 10 trillion : per day Google generated test inputs with 100s of servers for several months using OSS-Fuzz; 200% : growth in Cloud Native technologies used in production; $13 trillion : potential economic impact of AI by 2030; 1.8 They'll love you even more.

Internet 30

Internet Internet Scalability Education 30

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. And namespaces, used for Linux containers, are also a relevant technology. Hit Ctrl-C to end. ^C I also checked a task list from /sys/fs/cgroup, and saw it's in a docker cgroup.

Virtualization 76

Virtualization AWS Engineering Hardware 76

SQL Server According to Bob

JANUARY 11, 2020

​​ The storage ​​ space that is required ​​ for the sparse file is only that of the actual bytes written to the file and not the ​​ maximum ​​ file ​​ size.

Servers 40

Servers Cache Database Media 40

Alex Russell

OCTOBER 22, 2017

Most partners we work with are not aware of the real-world operating environment and make inappropriate technology choices as a result. It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Can they trust the TLs to recommend new technology or large re-investments?

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

JULY 14, 2021

Understanding how mobile OSes undermine browser choice requires a nuanced understanding of OS and browser technology. The power dynamics of these situations are starkly different, even though "web technology" is used to render content in each case. Hardware access APIs, notably: Geolocation. How bad is the situation?

Google 121

Google Mobile Engineering Internet 121

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). A good starting point is to choose a good default stack for your application.

Performance 104

Performance Cache Metrics Network 104