article thumbnail

Scalable Annotation Service?—?Marken

The Netflix TechBlog

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. Temporal Objects Several applications have a requirement to store annotations for videos that have time in it. So the amount of data stored can be large.

article thumbnail

Designing Instagram

High Scalability

Design a photo-sharing platform similar to Instagram where users can upload their photos and share it with their followers. Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. High Level Design. Component Design. API Design.

Design 334
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Designing Netflix

High Scalability

Design a video streaming platform similar to Netflix where content creators can upload their video content and viewers are able to play video on different devices. We should also be able to store user statistics of the videos such as number of views, video watched duration, and so forth. Problem Statement.

Design 329
article thumbnail

Best practices for Fluent Bit 3.0

Dynatrace

Fluent Bit is a telemetry agent designed to receive data (logs, traces, and metrics), process or modify it, and export it to a destination. Fluent Bit was designed to help you adjust your data and add the proper context, which can be helpful in the observability backend. on this YouTube video created by Henrik: Fluent Bit 3.0

article thumbnail

Stuff The Internet Says On Scalability For October 5th, 2018

High Scalability

Because the device in question is a high-speed unit designed to process a high volume of ballots for an entire county, hacking just one of these machines could enable anattacker to flip the Electoral College and determine the outcome of a presidential election?. They'll love it and you'll be their hero forever. So many more quotes.

Internet 156
article thumbnail

Stuff The Internet Says On Scalability For October 19th, 2018

High Scalability

dweis : I'm an actual author of Protocol Buffers :) I think Sandy's analysis would benefit from considering why Protocol Buffers behave the way they do rather than outright attacking the design because it doesn't appear to make sense from a PL-centric perspective. Maybe it's flawed, but the design is absolutely on the right traack.

Internet 123
article thumbnail

Stuff The Internet Says On Scalability For June 15th, 2018

High Scalability

1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble? Dave Snowden ~ A key principle of complex design is shift a system to an adjacent possible. They'll love you even more.

Internet 113