article thumbnail

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support…

The Netflix TechBlog

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Latency 212
article thumbnail

How to use Server Timing to get backend transparency from your CDN

Speed Curve

Server-timing headers are a key tool in understanding what's happening within that black box of Time to First Byte (TTFB). Cue server-timing headers Historically, when looking at page speed, we've had the tendency to ignore TTFB when trying to optimize the user experience. I mean, why wouldn't we?

Servers 57
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

USENIX LISA2021 Computing Performance: On the Horizon

Brendan Gregg

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. Ford, et al., “TCP

article thumbnail

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

article thumbnail

Stuff The Internet Says On Scalability For December 21st, 2018

High Scalability

Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” ” And in most main­stream ap­pli­ca­tion­s, you should be able to get there with server­less. Because nobody knows how to make money. Support contracts aren’t enough.

Internet 137
article thumbnail

KeyCDN Launches New POPs in 2021

KeyCDN

With Tel Aviv being the technology capital of Israel, it's the ideal edge server location. The image below shows a significant drop in latency once we've launched the new point of presence in Israel. In fact, latency has been reduced by almost 50%! Performance report Brisbane - Australia Brisbane is our 4th POP in Australia.

Latency 110
article thumbnail

Stuff The Internet Says On Scalability For July 20th, 2018

High Scalability

It also works well to justify an acquisition of more servers to investors. During our testing using the storage optimized EC2 instances (I3.2xlarge) we noticed that we were able to perform over 200K IOPS of 1K byte items thus meeting our throughput goals with latency rarely exceeding 1 millisecond. They never question this belief.

Internet 121