article thumbnail

Scalable Annotation Service?—?Marken

The Netflix TechBlog

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. All data should be also available for offline analytics in Hive/Iceberg. creators of promotional media (aka trailers, banner images) to improve their workflows.

article thumbnail

Supporting Diverse ML Systems at Netflix

The Netflix TechBlog

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Introducing SVT-AV1: a scalable open-source AV1 framework

The Netflix TechBlog

However, a more scalable approach would be to begin with a new foundation and begin a new building. The facilities are modern, spacious and scalable. Scalable Video Technology (SVT) is Intel’s open source framework that provides high-performance software video encoding libraries for developers of visual cloud technologies.

article thumbnail

Django Highlights: Wrangling Static Assets And Media Files (Part 4)

Smashing Magazine

Django Highlights: Wrangling Static Assets And Media Files (Part 4). Django Highlights: Wrangling Static Assets And Media Files (Part 4). But unfortunately, when dealing with static assets and media files, there are a lot of caveats to deal with. Media Files. Philip Kiely. 2020-06-25T12:30:00+00:00. configuration.

Media 70
article thumbnail

Data Reprocessing Pipeline in Asset Management Platform @Netflix

The Netflix TechBlog

By Meenakshi Jindal Overview At Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Assets Schema got evolved that required reindexing all assets data again in ElasticSearch to support search/stats queries on new fields.

Media 237
article thumbnail

Top 3 Kafka Streams Challenges

VoltDB

Fault tolerance: Kafka Streams is designed to be fault-tolerant and scalable. Overall, Kafka Streams simplifies the development of real-time stream processing applications by providing a lightweight and scalable library that integrates seamlessly with Apache Kafka. That’s huge.

Java 52
article thumbnail

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. As a database tailored towards enterprise workloads, this provides the ability needed to explore large data sets along with the high performance achieved by paralleling the analytics across your available segment hosts.

Big Data 321