The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The client MWW combines these estimates with an estimate of the input/output transmission time (latency) to find the worker with the minimum overall execution latency.

Mobile 104

Mobile Cloud Latency Games 104

The Morning Paper

NOVEMBER 15, 2020

With more nodes and more coordination comes more complexity, both in design and operation. This makes the whole system latency sensitive. One of the joys of this paper is that you don’t just get to see the final design, you also get insight into the forces and trade-offs that led to it. Back of the envelope.

Servers 128

Servers Hardware Latency Design 128

The Morning Paper

OCTOBER 11, 2020

Without higher-risk deployable solar arrays, a cubesat relies on surface-mounted solar panels to harvest energy. Orbital Edge Computing (OEC) is designed to do just that. Close-spaced constellation have much lower effective bandwidth, but also much lower latency. This results in peak available power of about 7.1W.

Systems 125

Systems Latency Architecture Energy 125

High Scalability

AUGUST 17, 2018

12 million requests / hour with sub-second latency, ~300GB of throughput / day. They'll love you even more. 2.24x10^32T : joules needed by the Death Star to obliterate Alderaan, which would liquify everyone in the Death Star; 13 of 25 : highest paying jobs are in tech; 70,000+ : paid Slack workspaces; 13 : hours ave american sits; $13.5

Internet 105

Internet Internet Scalability Games 105

The Morning Paper

JUNE 13, 2019

Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

John McCalpin

APRIL 2, 2020

The presentation discusses a family of simple performance models that I developed over the last 20 years — originally in support of processor and system design at SGI (1996-1999), IBM (1999-2005), and AMD (2006-2008), but more recently in support of system procurements at The Texas Advanced Computing Center (TACC) (2009-present).

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Alex Russell

APRIL 29, 2021

Apple's policy against browser engine choice adds years of delays beyond the (expected) delay of design iteration, specification authoring, and browser feature development. For heavily latency-sensitive use-cases like WebXR, this is a critical component in delivering a good experience. Offscreen Canvas.

Media 145

Media Games Education Engineering 145

John McCalpin

NOVEMBER 5, 2016

The art and science of microprocessor architecture is a never-ending struggling to balance complexity, verifiability, usability, expressiveness, compactness, ease of encoding/decoding, energy consumption, backwards compatibility, forwards compatibility, and other factors. This includes Haswell and newer cores.

Cache 40

Cache C++ Latency Hardware 40

Alex Russell

JUNE 20, 2020

Rendering text is important (think login screens), but there's no product without low-latency, adaptive codecs, networking, and camera/microphone access. You're usually better off tackling latency with aggressive performance budgeting. ??. They needed what early browsers could do, but much, much more as well.

Hardware 55

Hardware Games Java Media 55