Remove Analytics Remove Database Remove Media Remove Scalability
article thumbnail

Scalable Annotation Service?—?Marken

The Netflix TechBlog

Scalable Annotation Service — Marken by Varun Sekhri , Meenakshi Jindal Introduction At Netflix, we have hundreds of micro services each with its own data models or entities. All data should be also available for offline analytics in Hive/Iceberg. The databases we pick should be able to scale horizontally.

article thumbnail

Designing Instagram

High Scalability

User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. media search index, locations search index, and so forth) in future. We will use a graph database such as Neo4j to store the information. Sample Queries supported by Graph Database. Component Design.

Design 334
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Data Reprocessing Pipeline in Asset Management Platform @Netflix

The Netflix TechBlog

By Meenakshi Jindal Overview At Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Production assets operations are performed in parallel with older data reprocessing without any service downtime.

Media 237
article thumbnail

What Is PostgreSQL Used For?

Percona

PostgreSQL is open source relational database management software. It’s used for data management (shocker), application development, and data analytics. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

article thumbnail

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. What is an MPP Database?

Big Data 321
article thumbnail

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

Werner Vogels weblog on building scalable and robust distributed systems. If you have a largely static site you can rely on the enormous power of S3 to make serving your content highly scalable and storing it extremely durable. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

Servers 126
article thumbnail

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

Werner Vogels weblog on building scalable and robust distributed systems. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements.

AWS 115