Remove Blog Remove Presentation Remove Storage Remove Systems
article thumbnail

Optimizing data warehouse storage

The Netflix TechBlog

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203
article thumbnail

Improved Alerting with Atlas Streaming Eval

The Netflix TechBlog

Engineers want their alerting system to be realtime, reliable, and actionable. A few years ago, we were paged by our SRE team due to our Metrics Alerting System falling behind — critical application health alerts reached engineers 45 minutes late! The internals here are outside the scope of this blog post.

Storage 288
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Migrating Critical Traffic At Scale with No Downtime?—?Part 2

The Netflix TechBlog

This is where large-scale system migrations come into play. Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. Canaries and sticky canaries are valuable tools in the system migration process.

Traffic 279
article thumbnail

All of Netflix’s HDR video streaming is now dynamically optimized

The Netflix TechBlog

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. We present two sets. On the other hand, the optimized ladder presents a sharper increase in quality with increasing bitrate. The arrival of HDR-VMAF allowed us to create HDR streams with DO applied, i.e., HDR-DO encodes.

article thumbnail

What is log analytics? How a modern observability approach provides critical business insight

Dynatrace

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 203
article thumbnail

What is log analytics? How a modern observability approach provides critical business insight

Dynatrace

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 171
article thumbnail

Netflix Drive

The Netflix TechBlog

To support such use cases, access control at the user workspace and project workspace granularity is extremely important for presenting a globally consistent view of pertinent data to these artists. 2 , are the file system interface, the API interface, and the metadata and data stores. The major pieces, as shown in Fig.

Media 174