Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 51

Latency C++ Hardware Performance 51

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. What is Multi-CDN?A Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 52

Best Practices Strategy Traffic Virtualization 52

Dynatrace

MARCH 17, 2021

OneAgent gives you all the operational and business performance metrics you need, from the front end to the back end and everything in between—cloud instances, hosts, network health, processes, and services. You want to optimize your Citrix landscape with insights into user load and screen latency per server? extensions.

Metrics 167

Metrics Monitoring Network Technology 167

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The current system assumes an application specific regression model is available on the servers which can predict processing time given the current parameters of the job (e.g.

Mobile 104

Mobile Cloud Latency Games 104

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 90

Performance Network Mobile Speed 90

The Morning Paper

JANUARY 28, 2020

Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " " Running end-user compute inside the datastore is not without its challenges of course. " Running end-user compute inside the datastore is not without its challenges of course.

Serverless 99

Serverless Storage Latency Cloud 99

Smashing Magazine

AUGUST 10, 2023

There are ways around that, of course. The other issue is that the data I’m getting back is based on lab simulations where I can add throttling, determine the device that’s used, and the network connection, among other simulated conditions. On that note, it’s worth calling out that there are multiple flavors of network throttling.

Speed 81

Speed Monitoring Testing Network 81

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. What is Multi-CDN?A Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 40

Best Practices Strategy Traffic Virtualization 40

The Morning Paper

NOVEMBER 15, 2020

Options 1 and 2 are of course the ‘scale out’ options, whereas option 3 is ‘scale up’. An IDS/IPS monitors network flows and matches incoming packets (or more strictly, Protocol Data Units, PDUs) against a set of rules. This makes the whole system latency sensitive. The reassembler: processing fast and slow.

Servers 128

Servers Hardware Latency Design 128

Dotcom-Montior

MAY 12, 2020

They now allow users to interact more with the company in the form of online forms, shopping carts, Content Management Systems (CMS), online courses, etc. A request will be sent from the client-side and an HTTP check waits on the server port to get the message, process it, and then send back the response. Network or connection error.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

The Morning Paper

JUNE 23, 2019

Factor VI in the 12-factor app manifesto , “Execute the app as one or more stateless processes,” to be dropped and replaced with “Execute the app as one or more stateful processes.” session state that you want to survive an application process crash), and to keep the application server/services layer stateless.

Cache 79

Cache Latency Google Lambda 79

The Morning Paper

FEBRUARY 6, 2020

Oh, and there’s a scheduler too of course to keep all the plates spinning. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network.

Lambda 98

Lambda Serverless Cache Latency 98

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The top line shows the change in tail latency across a set of monolithic applications as operating frequency decreases. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. This work is latency critical, because volume IO is blocked until it is complete. NSDI’20.

Database 106

Database AWS Network Design 106

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Isolated parts of the database can serve read/write requests in case of network partition.

Database 213

Database Latency C++ Scalability 213

CSS Wizardry

OCTOBER 27, 2018

The short answers are, of course ‘all the time’ and ‘everyone’, but this mutual disownership is a common reason why performance often gets overlooked. Of course, it is impossible to fix (or even find) every performance issue during the development phase. Each have their own time, place, purpose, focus, and audience. Who: Engineers.

Performance Testing 172

Performance Testing Testing Performance Strategy 172

Smashing Magazine

AUGUST 15, 2023

Large preview ) While browsers are generally pretty fast, these steps still take time to load, typically in seconds, and even longer on slower, high-latency network connections. This allows the browser’s preload scanner to detect and download the image early in the process — something it cannot parse from a CSS file.

Media 73

Media Metrics Mobile Best Practices 73

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 86

Performance Latency Metrics Engineering 86

The Morning Paper

FEBRUARY 23, 2020

There are five different types of member in an AnyLog system, and any network node can join without restriction as any type of member. Publishers are the producers of the actual data to be served by the network. Coordinators have total freedom to decide how many tokens to charge a client to process a query… But what about…?

Blockchain 94

Blockchain Internet Internet IoT 94

All Things Distributed

OCTOBER 25, 2018

The new AWS Africa (Cape Town) Region will have three Availability Zones and provide lower latency to end users across Sub-Saharan Africa. That's where we built many pioneering networking technologies, our next-generation software for customer support, and the technology behind our compute service, Amazon EC2.

AWS 167

AWS Cloud Education Programming 167

CSS - Tricks

APRIL 1, 2021

Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. Using a network request inspector, I’m going to see if there’s anything we can remove via the Network panel in DevTools.

Cache 92

Cache Social Media Media Website 92

High Scalability

FEBRUARY 19, 2021

Treating failure as a matter of course. For example, if processing for a particular channel is taking place on a particular instance within the cluster, and that instance fails (forcing that channel role to move), mechanisms must be in place to ensure that things can continue. Fault tolerant designs treat failures as routine.

Engineering 215

Engineering Systems Scalability Availability 215

The Netflix TechBlog

JANUARY 24, 2022

Technically, “performance” metrics are those relating to the responsiveness or latency of the app, including start up time. Both of these metrics will fluctuate over the course of a test, so we post metric values at regular intervals throughout the test. so are power levels and network bandwidth. What do we mean by Performance?

Performance 199

Performance Metrics Performance Testing Testing 199

Dotcom-Montior

DECEMBER 8, 2021

We are kidding of course, but you know something is bad if happens that early in the morning. Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation. Incident Management Lifecyle: Process and Steps.

Social Media 90

Social Media Monitoring Latency DevOps 90

All Things Distributed

JUNE 21, 2017

DynamoDB delivers predictable performance and single digit millisecond latencies for reads and writes to your application, whether you're just getting started and want to perform hundreds of reads or writes per second in dev and test, or you're operating at scale in production performing millions of reads and writes per second.

Speed 121

Speed Cache Latency AWS 121

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. Micro-optimizations are great for keeping performance on track, but it’s critical to have clearly defined targets in mind — measurable goals that would influence any decisions made throughout the process. Establish a performance culture.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 103

Performance Cache Metrics Network 103

Alex Russell

OCTOBER 22, 2017

We constrain ourselves to a real-world baseline device + network configuration to measure progress. Budgets are scaled to a benchmark network & device. Answering it requires an understanding of how browsers process resources (which differs by type) and the concept of the critical path. ” A good question!

Performance 68

Performance Benchmarking Network Mobile 68

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. VPC Endpoints give you the ability to control whether network traffic between your application and DynamoDB traverses the public Internet or stays within your virtual private cloud.

Internet 128

Internet Internet AWS Performance 128

The Morning Paper

DECEMBER 8, 2019

Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible. Traditionally one of the major costs when moving data in and out of memory (be it to persistent media or over the network) is serialisation.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Of course analog signalling comes with a whole bunch of challenges of its own, which is one of the reasons we tend to convert to digital. So decision trees are essentially networks of threshold functions.

Energy 52

Energy Hardware Efficiency Architecture 52

The Morning Paper

JANUARY 12, 2020

Constrained MDPs (Markov Decision Processes) allow constraints to be specified over states and actions. Another approach is to add a safety layer to the network which prevents any safety violations. To deal with this we can use Partially Observable Markov Decision Processes (POMDPs). Kant would approve. Who would have thought!

Programming 43

Programming Systems Efficiency Network 43

Sutter's Mill

JUNE 21, 2012

One of the slides I omitted to shorten this version of the talk highlighted that there are actually two issues when you go from “Disjoint (tightly coupled)” to “Disjoint (loosely coupled)”: reliability and latency , and both are important. (I an elastic set of compute nodes, each of which pulls work items from the queue and processes them.

Latency 40

Latency Transportation Hardware Education 40

Alex Russell

JULY 14, 2021

Because they lean on the system-provided WebView component, they do not need to pay the expense of a heavier app download to support rendering HTML, running JavaScript, decoding images, or loading network resources. Fixing mobile won't be sufficient to unwind desktop's increasingly negative dark patterns, of course. Heaven forfend! ??.

Google 121

Google Mobile Engineering Internet 121

KeyCDN

SEPTEMBER 12, 2019

The file size of your images of course is very important, but SEO and social media also play an important part in helping your website perform and convert better. An easy way to compress images is with our image processing service that happens to also be fully integrated into our existing network.

Social Media 106

Social Media Media Google Website 106