Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. In early January a related paper was published by Satoshi Matsuoka et. Luckily I think we are in general agreement on the main points.

Architecture 52

Architecture Latency Benchmarking AWS 52

Scalegrid

JANUARY 12, 2024

While managing cloud workloads offers numerous benefits, it also presents several challenges such as security risks, compliance issues, and resource optimization, which can be addressed effectively with tools like ScaleGrid, offering features like encryption, disaster recovery, and real-time resource optimization for diverse databases.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Smashing Magazine

AUGUST 3, 2023

Google’s Core Web Vitals is a set of performance metrics that site owners can use to evaluate performance and diagnose performance issues. You need to beware that slow server response times can significantly increase TTFB, often due to server overload, network issues, or un-optimized logic on the server side.

Performance 74

Performance Cache Traffic Metrics 74

All Things Distributed

JUNE 7, 2017

Unlocking the value of data is a primary goal that AWS helps our customers to pursue. Some applications may also rely on timely decisions: when maneuvering heavy machinery, an absolute minimum of latency is critical. Customers in physically remote environments, such as mining and agriculture, are more affected by these issues.

AWS 120

AWS IoT Lambda Storage 120

Scalegrid

JANUARY 8, 2024

Despite the potential challenges associated with scaling AI in cloud computing, strategies such as: Obtaining leadership endorsement Establishing ROI indicators Utilizing responsible AI algorithms Addressing data ownership issues can be employed to ensure successful integration.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values.

Database 167

Database AWS Games Latency 167

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. As we’ve said many times before, “There is no compression algorithm for experience.” Automation is key.

AWS 147

AWS Hardware Retail Virtualization 147

All Things Distributed

DECEMBER 12, 2018

In April 2017, Amazon Web Services announced that it would launch a new AWS infrastructure region Region in Sweden. Today, I'm happy to announce that the AWS Europe (Stockholm) Region, our 20th Region globally, is now generally available for use by customers.

AWS 124

AWS Cloud Games Serverless 124

All Things Distributed

JUNE 21, 2017

You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required. DynamoDB was the first service at AWS to use SSD storage. These high-throughput, low-latency requirements need caching, not as a consideration, but as a best practice.

Speed 123

Speed Cache Latency AWS 123

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

JUNE 23, 2019

I think it’s absolutely fine to use the local memory space or filesystem as a local cache of data that spans transactions so long as that doesn’t introduce stickiness, consistency or stale data issues. If you decompose data across multiple keys to avoid this, you then typically run into cross-key atomicity issues. Adya et al.

Cache 79

Cache Latency Google Lambda 79

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. But what does it take to migrate your existing applications to the cloud? With this overhead, it can take weeks to set up a basic project.

Cloud 169

Cloud Traffic Best Practices Strategy 169

Percona

APRIL 17, 2023

There is an issue with this, which causes the OS to swap even with memory available. The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. The CFQ works well for many general use cases but lacks latency guarantees. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

MAY 2, 2023

For organizations that rely on data to operate, database backups are critical for business continuity. With a robust backup and recovery plan in place, companies can restore their systems and data quickly and minimize downtime, which is essential to maintain customer trust and avoid business disruption. mongorestore --host=mongodb1.example.net

Best Practices 52

Best Practices Database Storage Servers 52

Smashing Magazine

JANUARY 11, 2021

Below you’ll find a (hopefully unbiased and objective) front-end performance checklist for 2021 — an updated overview of the issues you might need to consider to ensure that your response times are fast, user interaction is smooth and your sites don’t drain user’s bandwidth. Table Of Contents.

Performance 145

Performance Cache Media Metrics 145

The Netflix TechBlog

JUNE 14, 2023

By Jennifer Shin , Tejas Shikhare , Will Emmanuel In 2022, a major change was made to Netflix’s iOS and Android applications. We migrated Netflix’s mobile apps to GraphQL with zero downtime, which involved a total overhaul from the client to the API layer. Until recently, an internal API framework, Falcor , powered our mobile apps.

Traffic 353

Traffic Latency Cache Metrics 353

Sutter's Mill

JUNE 21, 2012

So in the Q&A, one commenter made the point that I should have mentioned reliability is an issue. One of the slides I omitted to shorten this version of the talk highlighted that there are actually two issues when you go from “Disjoint (tightly coupled)” to “Disjoint (loosely coupled)”: reliability and latency , and both are important.

Latency 40

Latency Transportation Hardware Education 40

Smashing Magazine

JANUARY 6, 2020

Below you’ll find a (hopefully unbiased and objective) front-end performance checklist for 2020 — an updated overview of the issues you might need to consider to ensure that your response times are fast, user interaction is smooth and your sites don’t drain user’s bandwidth. Table Of Contents. Getting Ready: Planning And Metrics.

Performance 145

Performance Cache Network Metrics 145

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

Collecting some critical metrics at one second intervals, with a total observability latency of ten seconds or less matches the human attention span much better. Staff should be familiar with recovery processes and the behavior of the system when it’s working hard to mitigate failures.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

JANUARY 7, 2019

Below you’ll find a (hopefully unbiased and objective) front-end performance checklist for 2019 — an updated overview of the issues you might need to consider to ensure that your response times are fast, user interaction is smooth and your sites don’t drain user’s bandwidth. Table Of Contents. Getting Ready: Planning And Metrics.

Performance 103

Performance Cache Metrics Network 103

Brendan Gregg

SEPTEMBER 5, 2017

There have been some issues on Linux, but overall it's been ok, especially given how hard we push ZFS. There are plenty of other bugs to fix, though, which you can see in the issue list on github. Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist.

Virtualization 76

Virtualization AWS Engineering Hardware 76

The Netflix TechBlog

NOVEMBER 3, 2022

The freshest data is served to all requests, and clients never observe read-your-write or monotonic-read consistency issues¹: Data consistency on the Titus API is highly desirable as it simplifies client implementation. We started seeing increased response latencies and leader servers running at dangerously high utilization.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

FEBRUARY 20, 2019

Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution? Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? Snoops: block IO, exec() Scheduler run queue latency In the below diagram we can see a demo for a wget job.

Performance 211

Performance Latency Open Source Metrics 211

The Netflix TechBlog

APRIL 26, 2022

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. We use Keystone as it is easy to use, reliable, scalable, and provides aggregation of facts from different cloud regions into a single AWS region.

Storage 187

Storage Design Scalability Latency 187

High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. This increases the cores and network bandwidth available to serve common requests. Related Articles.

Storage 199

Storage Performance AWS Efficiency 199

The Netflix TechBlog

FEBRUARY 18, 2022

This network connection heterogeneity made choosing a single delivery model difficult. Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies.

Systems 334

Systems Traffic Architecture Mobile 334

The Netflix TechBlog

FEBRUARY 9, 2021

The homepage needs to load in a reasonable amount of time, even in poor network conditions. Server-generated assets, since client-side generation would require the retrieval of many individual images, which would increase latency and time-to-render. We can leverage high performance VMs in AWS to generate the assets.

Engineering 165

Engineering Storage Latency Entertainment 165

High Scalability

FEBRUARY 19, 2021

Offering service from multiple availability zones within the same region is relatively simple: AWS enables this with very little effort. In practice, because from time to time individual elements will inevitably fail, this means you have to be able to continue in spite of those failures. This ensures reliability.

Engineering 215

Engineering Systems Scalability Availability 215

The Netflix TechBlog

MARCH 6, 2019

Netflix operates in multiple AWS regions. Based on these replay files, we’ve built tools that: Visualize a replay This has proven very useful for quickly gaining insight into data access patterns and why they might be causing performance issues. We use this to debug errors and performance issues in specific mounts.

Media 214

Media Storage Processing Cache 214