Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 51

Latency C++ Hardware Performance 51

CSS Wizardry

AUGUST 13, 2019

To further exacerbate the problem, the 302 response has a Cache-Control: must-revalidate, private. header , meaning that we will always make an outgoing request for this resource regardless of whether or not we’re hitting the site from a cold or a warm cache. com , which introduces yet more latency for the connection setup.

Latency 203

Latency Cache Strategy Media 203

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

CSS - Tricks

APRIL 1, 2021

Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. I’m going to update my referenced URL to the new site to help decrease latency that adds drag to the initial page load. Text-based assets. KB to 11.2

Cache 92

Cache Social Media Media Network 92

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. Opting for synchronous replication within distributed storage brings about reinforced consistency and integrity of data, but also bears higher expenses than other forms of replicating data.

Storage 130

Storage Systems Big Data Azure 130

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction.

Internet 121

Internet Internet Scalability Automotive 121

Percona

MARCH 23, 2023

These guidelines work well for a wide range of applications, though the optimal settings, of course, depend on the workload. By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. have been released since then with some major changes.

Performance 124

Performance Hardware Tuning Storage 124

The Morning Paper

JUNE 23, 2019

Generally to cache data (including non-persistent data that never sees a backing store), to share non-persistent data across application services (e.g. ” Even re-reading that today, the letter of the law there is surprisingly strict to me: you can use the local memory space or filesystem as a brief single transaction cache, but no more.

Cache 79

Cache Latency Google Lambda 79

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. Adding caching when your app is already experiencing load is not easy.

Speed 121

Speed Cache Latency AWS 121

Scalegrid

JULY 29, 2020

Also, note the test here was actually perfectly crafted for Pgpool-II – since when N > 32, the number of clients and number of children processes were the same, and hence, each reconnection was guaranteed to find a cached process. Patterns of data access would play a role, as would the latencies involved based on your architecture.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

The Morning Paper

OCTOBER 26, 2020

It’s limited by the laws of physics in terms of end-to-end latency. We saw earlier that there is end-user pressure to replace batch systems with much lower latency online systems. We are observing significant demand from users in terms of avoiding batch telemetry pipelines altogether. Emphasis mine ). Emphasis mine ).

Cloud 104

Cloud Big Data Latency Architecture 104

All Things Distributed

MAY 13, 2012

With just one click you can enable content to be distributed to the customer with low latency and high-reliability. Of course non-AWS origins are also permitted. Query String based Caching: the ability to include query string parameters as part of the objects cache key. Persistent Connection to Origins.

Cache 117

Cache Latency AWS Website 117

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 52

Best Practices Strategy Traffic Virtualization 52

Percona

MAY 15, 2023

This, of course, is unless I can organize my products by country as well, which is a bit unusual nowadays but not impossible. One example could be using an RDBMS for most of the Online transaction processing ( OLTP) data shared by country and having the products as distributed memory cache with a different technology.

Traffic 123

Traffic Scalability Database Servers 123

Percona

JULY 17, 2023

Alternatives to MongoDB Enterprise There are plenty of alternatives, but we’re not going to cover them all here, of course. Redis can handle a high volume of operations per second, making it useful for running applications that require low latency. Such organizations might seek a more straightforward alternative.

Open Source 75

Open Source Database Scalability Software 75

The Morning Paper

DECEMBER 8, 2019

Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible. The beauty of persistent memory is that we can use memory layouts for persistent data (with some considerations for volatile caches etc. in front of that memory , as we saw last week).

Hardware 56

Hardware Programming Media Storage 56

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. Multi-CDN is the practice of employing a number of CDN providers simultaneously.

Best Practices 40

Best Practices Strategy Traffic Virtualization 40

The Morning Paper

JANUARY 23, 2020

1:18pm a key observation was made that an API call to populate the homepage sidebar saw a huge jump in latency. There’s much more colour around these in the full thesis report of course). Members of the team begin diagnosing the issue using the #sysops and #warroom internal IRC channels. " – wikipedia.

Internet 53

Internet Internet Cache Engineering 53

The Morning Paper

MAY 12, 2019

The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. Smaller microservices demonstrated much better instruction-cache locality than their monolithic counterparts. Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Smashing Magazine

AUGUST 20, 2021

Platforms such as Snipcart , CommerceLayer , headless Shopify , and Stripe enable you to manage products in a friendly UI while taking advantage of the benefits of Jamstack: Amazon’s famous study reported that for every 100ms in latency, they lose 1% of sales. Of course the template approach is cheaper.

Ecommerce 139

Ecommerce Website Government Internet 139

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Not as much as we'd like, of course, but the worldwide baseline has changed enormously. There are differences, of course, but not where it counts. The Moto G4 , for example.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 106

Performance Network Latency Servers 106

n0derunner

SEPTEMBER 17, 2018

In such a case we have a Bandwidth heavy workload profile (reporting) sharing with a Latency Sensitive workload (transactional). The key thing to observe is the impact on the latency sensitive (OLTP) workload. The “Data” disks are doing both reads (from DB cache misses) and writes committed transactions.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

Highly Scalable

SEPTEMBER 18, 2012

Historically, NoSQL paid a lot of attention to tradeoffs between consistency, fault-tolerance and performance to serve geographically distributed systems, low-latency or highly available applications. Read/Write latency. Read/Write requests are processes with a minimal latency. Data Placement. Read/Write scalability.

Database 213

Database Latency C++ Scalability 213

Alex Russell

APRIL 29, 2021

For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. An extension to Service Workers that enables browsers to present users with cached content when offline. Offscreen Canvas. Improves the smoothness of 3D and media applications by moving rendering work to a separate thread.

Media 145

Media Games Education Engineering 145

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases.

Internet 128

Internet Internet AWS Performance 128

SQL Performance

APRIL 8, 2019

The L3 cache size is 64MB. Of course, if I were buying an AMD-based server for on-premises SQL Server use right now, I would try to get the newer, frequency-optimized AMD EPYC 7371 processor. The L3 cache size is 64MB. They feature low latency, local NVMe storage that can directly leverage the 128 PCIe 3.0 Memory (GiB).

Azure 42

Azure Virtualization Storage Benchmarking 42

Smashing Magazine

SEPTEMBER 6, 2021

This approach was touted to be better for fine-grained caching because each subresource could be cached individually and the full bundle didn’t need to be redownloaded if one of them changed. Finally, not inlining resources has an added latency cost because the file needs to be requested. Large preview ).

Network 105

Network Servers Cache Traffic 105

Alex Russell

OCTOBER 22, 2017

It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 68

Performance Benchmarking Network Mobile 68

The Morning Paper

SEPTEMBER 12, 2019

A pipeline breaker occurs when the output of one operator must be materialized to disk or transferred over the network, as opposed to being directly communicated from operator to operator via CPU cache, or, in the worst case, via RAM. Once a library of UDFs have been built up of course, they could be reused across computations.

Network 44

Network Database Programming Hardware 44

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. This is why we have a distinction between HTTP (without TLS) and HTTPS (with TLS).

Transportation 145

Transportation Internet Internet Network 145

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

This might be very different for your company, of course, but that’s a close enough approximation of a majority of customers out there. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Thanks to Tim Kadlec, Henri Helvetica and Alex Russel for the pointers!

Performance 145

Performance Cache Network Metrics 145

KeyCDN

FEBRUARY 14, 2019

A CDN will pull the GIF files from your origin server and cache them. This results in a reduction in distance travelled and therefore latency, as well as reduces the load on your origin server. Of course, web optimization is always about weighing costs and benefits.

Speed 50

Speed Website Latency Cache 50

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Of course, your data might show that your customers are not on these devices, but perhaps they simply don’t show up in your analytics because your service is inaccessible to them due to slow performance.

Performance 104

Performance Cache Network Metrics 104