The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Seer is an online system that observes the behaviour of cloud applications (using the DeathStarBench microservices for the evaluation) and predicts when QoS violations may be about to occur. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

NOVEMBER 9, 2022

A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.”

Hardware 363

Hardware Cache Performance Latency 363

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. This integration enhances the flexibility of cloud services while bolstering their computational and storage functions.

Storage 130

Storage Systems Big Data Azure 130

The Symphonia

MAY 22, 2018

I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless.

Serverless 40

Serverless Architecture Lambda Azure 40

Percona

MARCH 20, 2023

When deciding what to pick, there are many things to consider, like where the proxy needs to be, if it “just” needs to redirect the connections, or if more features need to be in, like caching and filtering, or if it needs to be integrated with some MySQL embedded automation. Given that, there never was a single straight answer.

Games 122

Games Latency Traffic Cache 122

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. That means multiple data indirections mean multiple cache misses. It would mean a great deal to me. They'll love you even more.

Internet 121

Internet Internet Scalability Automotive 121

KeyCDN

FEBRUARY 4, 2021

ISPs do cache DNS however which means if your first provider goes down it will still try to query the first DNS server for a period of time before querying for the second one. Using a fast DNS hosting provider ensures there is less latency between the DNS lookup and TTFB. So DNS services definitely go down!

Cache 134

Cache Website Internet Internet 134

Percona

MAY 15, 2023

One example could be using an RDBMS for most of the Online transaction processing ( OLTP) data shared by country and having the products as distributed memory cache with a different technology. It will also allow us to redirect read/write traffic to the primary and read-only traffic to all secondaries.

Traffic 125

Traffic Scalability Database Servers 125

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. Writing events to any output.

Database 212

Database Traffic Transportation Open Source 212

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. Especially if going into or out of storage types that may throttle bandwidth/network traffic.

Best Practices 52

Best Practices Database Storage Servers 52

Abhishek Tiwari

NOVEMBER 3, 2018

Although some vendors have added support for APIs and cloud services most have not even bothered to adapt with changing technology landscape. In addition, traditional CMS solutions lack integration with modern software stack, cloud services, and software delivery pipelines. There is hardly any innovation from traditional CMS vendors.

Systems 63

Systems Cache Website Network 63

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. The requirements for a fully hosted cloud database service needed to be at an even higher bar than what we had set for our Amazon internal system. Auto Scaling is on by default for all new tables and indexes.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

JUNE 21, 2018

Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values. The purpose of DynamoDB is to provide consistent single-digit millisecond latency for any scale of workloads. Take Expedia, for example.

Database 167

Database AWS Games Latency 167

All Things Distributed

JANUARY 18, 2012

DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. s web-based applications often encounter database scaling challenges when faced with growth in users, traffic, and data. Amazon DynamoDB offers low, predictable latencies at any scale.

Scalability 167

Scalability Database Ecommerce Latency 167

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. A silver lining on this dark cloud is that mobile JavaScript payload growth paused in 2020. The Moto G4 , for example. Don't pay a lot for an Android-shaped muffler.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. You can create your own on Chrome UX Dashboard. Large preview ). Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Lighthouse , a performance auditing tool integrated into DevTools. Large preview ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

For Mac OS, we can use Network Link Conditioner , for Windows Windows Traffic Shaper , for Linux netem , and for FreeBSD dummynet. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Lighthouse , a performance auditing tool integrated into DevTools. Large preview ).

Performance 103

Performance Cache Metrics Network 103