The Morning Paper

OCTOBER 6, 2019

Prediction serving latency matters. Before you start building models, it’s worth spending time carefully constructing a definition of the problem you are trying to solve. Lesson 4: prediction serving latency matters. Even mathematically simple models have the potential of introducing relevant latency.

Latency 102

Latency Metrics Cache Design 102

The Netflix TechBlog

SEPTEMBER 3, 2021

Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. How can we achieve a similar functionality when designing our gRPC APIs? By default, gRPC uses protobuf as its IDL (interface definition language) and data serialization protocol.

Design 245

Design Java Efficiency Code 245

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. This type of traffic originates directly from the server, making it more challenging to handle due to latency and server load considerations; it’s hard but not impossible. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. This type of traffic originates directly from the server, making it more challenging to handle due to latency and server load considerations; it’s hard but not impossible. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52

Dynatrace

JULY 10, 2019

With insights from Dynatrace into network latency and utilization of your cloud resources, you can design your scaling mechanisms and save on costly CPU hours. Dynatrace provides out-of-the-box support for VMware, AWS, Azure, Pivotal Cloud Foundry, and Kubernetes.

Java 141

Java Best Practices Metrics Azure 141

Smashing Magazine

AUGUST 3, 2023

These pages serve as a pivotal tool in our digital marketing strategy, not only providing valuable information about our services but also designed to be easily discoverable through search engines. Core Web Vital metrics definitions. A cornerstone of our business model lies in the development of effective landing pages.

Performance 74

Performance Cache Traffic Metrics 74

The Netflix TechBlog

MARCH 4, 2024

In addition, even if a job’s memory configuration is initially well tuned, changes such as data size and job definition can cause performance to degrade. One downside of the iterative design of the optimizer is that any bottleneck can block completion and cause a timeout, which we initially observed in a non-trivial number of cases.

Tuning 210

Tuning Efficiency Big Data Engineering 210

ScaleOut Software

JULY 14, 2021

Azure Digital Twins for creating a graphical representation of the assets within an organization using the Digital Twin Definition Language, processing events, and visualizing entity graphs to display and query status. ScaleOut’s Digital Twin Streaming Service is designed to meet this need as an integral part of the Azure IoT ecosystem.

IoT 52

IoT Azure Analytics Serverless 52

Speed Curve

DECEMBER 4, 2023

Latency is traditionally worse on mobile Despite improved network conditions in some parts of the world, round trip time is still much worse for mobile than desktop. Mobile interactions are different, thus mobile design is different Are there common practices in mobile that could affect Interaction to Next Paint?

Mobile 54

Mobile Performance Metrics Google 54

Smashing Magazine

AUGUST 10, 2023

Certain tools are designed for certain metrics with certain assumptions that produce certain results. In contrast, tools like DebugBear and WebPageTest use more realistic throttling that accurately reflects network round trips on a higher-latency connection. Lighthouse results. Real usage data would be better, of course.

Speed 82

Speed Monitoring Testing Network 82

Percona

MAY 15, 2023

MySQL, as well as other RDBMS, are designed to work respecting the model and cannot scale in any way by fragmenting and distributing a schema, so what can be done to scale? Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition.

Traffic 124

Traffic Scalability Database Servers 124

Particular Software

JUNE 3, 2019

We now live in an age when it's possible to stream high definition TV, and yet we are not satisfied. From Udi Dahan's Advanced Distributed Systems Design Course , Day 1 Problem of scale The real problem with bandwidth is not one of absolute speed but one of scale. Today, we have DSL and cable modems; tomorrow, fiber may be widespread.

Latency 40

Latency Speed Network Strategy 40

The Morning Paper

SEPTEMBER 1, 2019

At the end of the day, you get the dual benefit of higher throughput and lower latency (as compared to coordination-based approaches) coupled with knowing that there isn’t some nasty invariant-violating concurrency bug waiting to bite you (so long as you specified your invariants and operation effects correctly of course!).

Database 42

Database Latency Games Design 42

Dotcom-Montior

DECEMBER 8, 2021

ITSM defines how teams design, create, and deliver their services. By ITIL definition, the service desk may take the form of incident resolution or service requests, but whatever the case, the primary goal of the service desk to provide quick and efficient service. It is much more than just IT support.

Social Media 90

Social Media Monitoring Latency DevOps 90

CSS - Tricks

APRIL 1, 2021

Redirects are often pretty light in terms of the latency that they add to a website, but they are an easy first thing to check, and they can generally be removed with little effort. I’m going to update my referenced URL to the new site to help decrease latency that adds drag to the initial page load.

Cache 92

Cache Social Media Media Website 92

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory.

Software 78

Software Software Google Hardware 78

Alex Russell

MARCH 6, 2021

Chip design choices and silicon economics are the defining feature of the still-growing Performance Inequality Gap. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. Don't pay a lot for an Android-shaped muffler. It's hard to escape thinking they're connected.

Performance 124

Performance Network Cache Metrics 124

CSS - Tricks

AUGUST 16, 2019

And I’ve seen this sentiment expressed time and time again, in the frameworks, on Twitter, in the design process, in the development process, and so much so that arguing about the importance of accessibility can get pretty exhausting. With that in mind, it’s not just bad software design and development if a website is slow.

Performance 50

Performance Website Speed Latency 50

The Morning Paper

NOVEMBER 17, 2019

For example, to reduce latency, serverless platforms try to reuse the same function instance to process multiple requests. So far it feels a bit like much ado about nothing to me, but the third consideration can definitely be more tricky to get right. a persistent store with transaction support).

Serverless 58

Serverless Lambda Programming Cache 58

Alex Russell

JANUARY 30, 2024

Engineering is the discipline of designing solutions under specific constraints. If you or your company are able to generate a credible worldwide latency estimate in the higher percentiles for next year's update, please get in touch. For topological reasons I expect next year's report to show similar progress in bandwidth but not RTTs.

Performance 90

Performance Network Mobile Speed 90

All Things Distributed

DECEMBER 5, 2010

Authoritative servers hold the definitive mappings. We have designed Route 53 to propagate updates very quickly and give the customer the tools to find out when all changes have been propagated. This achieves very low-latency for queries which is crucial for the overall performance of internet applications. Recent Entries.

Cloud 117

Cloud Internet Internet AWS 117

Alex Russell

JULY 14, 2021

I've got a long blog post brewing on this, but jumping to the end, an operable definition is: A browser is an application that can register with an OS to handle http and https navigations by default. The benefits to apps that adopt WebView-based IABs are numerous: WebViews are system components designed for use within other apps.

Google 121

Google Mobile Engineering Internet 121

The Netflix TechBlog

JANUARY 10, 2024

Since then, the video pipeline has undergone substantial improvements and broad expansions: Starting with Standard Dynamic Range (SDR) at Standard-Definitions , we expanded the encoding pipeline to 4K and High Dynamic Range (HDR) which enabled support for our premium offering. The requests from the studio side are generally latency-sensitive.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

DECEMBER 21, 2020

This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. Transparency to end-users.

Storage 203

Storage Latency Efficiency Data Engineering 203

John McCalpin

NOVEMBER 5, 2016

These cores have 2 functional units supporting Vector Fused Multiply-Add instructions, with 5-cycle latency on Haswell/Broadwell and 4-cycle latency on Skylake processors (ref: [link] ). With 2 FMA units that have 5-cycle latency, the code must implement at least 2*5=10 independent accumulators in order to avoid stalls.

Cache 40

Cache C++ Latency Hardware 40

The Netflix TechBlog

FEBRUARY 9, 2021

At the highest level, the definition of the Passport is as follows: message Passport { Header header = 1; UserInfo user_info = 2 ; DeviceInfo device_info = 3 ; Integrity user_integrity = 4 ; Integrity device_integrity = 5 ; } The Header element communicates the name of the service that created the Passport.

Architecture 221

Architecture Latency Servers Website 221

Alex Russell

OCTOBER 22, 2017

It simulates a link with a 400ms RTT and 400-600Kbps of throughput (plus latency variability and simulated packet loss). Simulated packet loss and variable latency, however, can make benchmarking extremely difficult and slow. Our baseline, then, should probably trade lower throughput/higher-latency for packet loss.

Performance 68

Performance Benchmarking Network Mobile 68

Percona

MAY 2, 2023

Percona Backup for MongoDB is an uncomplicated command-line tool by design that lends itself well to backing up larger data sets. Hence the speed to back up the data with mongodump is definitely very slow when compared to the other two options discussed.

Best Practices 52

Best Practices Database Storage Servers 52

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. It’s designed to capture delays that result from the main thread being busy, especially during page load.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Map design decisions against performance budget and the priorities defined early on.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Performance isn’t just a technical concern: it matters, and when baking it into the workflow, design decisions have to be informed by their performance implications. Without a strong alignment between dev/design and business/marketing teams, performance isn’t going to sustain long-term. Setting Realistic Goals.

Performance 104

Performance Cache Metrics Network 104

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To reduce latency, assets should be generated in an offline fashion and not in real time.

Engineering 165

Engineering Storage Latency Entertainment 165

The Netflix TechBlog

FEBRUARY 9, 2021

In particular, it’s our job to design and build the systems and protocols that enable customers from all over the world to sign up for Netflix with the plan features and incentives that best suit their needs. Plans & Offers Definitions Let’s define what a plan and an offer is at Netflix. The world is constantly changing.

Engineering 142

Engineering Scalability Architecture Innovation 142

O'Reilly Software

MARCH 7, 2018

Service-oriented architecture (SOA) was hyped in the mid-2000s as a modern take on distributed systems architecture, which through modular design would provide productivity through loose coupling between collaborative services—so-called "WebServices"—communicating through externally published APIs.

Transportation 72

Transportation Java Programming Architecture 72

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. Microsoft SQL Server I/O Design To fully understand SQL Server I/O design, it is important to understand the basics of database file I/O operations, transaction log I/O operations, and transactional consistency maintenance.

Servers 40

Servers Cache Media Hardware 40

All Things Distributed

JULY 14, 2015

A common design pattern is to capture transactional and operational data (such as logs) that require high throughput and performance in DynamoDB, and provide periodic updates to search clusters and data warehouses. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167