Remove AWS Remove Cache Remove Example Remove Latency
article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees.

Cache 224
article thumbnail

Implementing AWS well-architected pillars with automated workflows

Dynatrace

If you use AWS cloud services to build and run your applications, you may be familiar with the AWS Well-Architected framework. For example, optimizing resource utilization for greater scale and lower cost and driving insights to increase adoption of cloud-native serverless services.

AWS 243
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Seeing through hardware counters: a journey to threefold performance increase

The Netflix TechBlog

to a larger AWS instance size, from m5.4xl (16 vCPUs) to m5.12xl (48 vCPUs). A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. let’s call it GS2?—?to

Hardware 363
article thumbnail

Supporting Diverse ML Systems at Netflix

The Netflix TechBlog

Example use case: Content Knowledge Graph Our knowledge graph of the entertainment world encodes relationships between titles, actors and other attributes of a film or series, supporting all aspects of business at Netflix. In other cases, it is more convenient to share the results via a low-latency API.

Systems 226
article thumbnail

Migrating Netflix to GraphQL Safely

The Netflix TechBlog

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. For example, is it more correct for an array to be empty or null, or is it just noise?

Traffic 353
article thumbnail

Netflix Cloud Packaging in the Terabyte Era

The Netflix TechBlog

As an example, cloud-based post-production editing and collaboration pipelines demand a complex set of functionalities, including the generation and hosting of high quality proxy content. The following table gives us an example of file sizes for 4K ProRes 422 HQ proxies. For write operations, those challenges do not apply.

Cloud 237
article thumbnail

How to use Server Timing to get backend transparency from your CDN

Speed Curve

Caching the base page/HTML is common, and it should have a positive impact on backend times. Key things to understand from your CDN Cache Hit/Cache Miss – Was the resource served from the edge, or did the request have to go to origin? Latency – How much time does it take to deliver a packet from A to B.

Servers 57