article thumbnail

Designing Instagram

High Scalability

Design a photo-sharing platform similar to Instagram where users can upload their photos and share it with their followers. Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. High Level Design. Component Design. API Design.

Design 334
article thumbnail

Extend business observability: Extract business events from online databases (Part 2)

Dynatrace

In part 2, we’ll show you how to retrieve business data from a database, analyze that data using dashboards and ad hoc queries, and then use a Davis analyzer to predict metric behavior and detect behavioral anomalies. Similar to the tutorial extension, we created an extension that performs queries against databases.

Database 272
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Scalable Annotation Service?—?Marken

The Netflix TechBlog

An example for storing both time and space based data would be an ML algorithm that can identify characters in a frame and wants to store the following for a video In a particular frame (time) In some area in image (space) A character name (annotation data) Pic 1 : Editors requesting changes by drawing shapes like the blue circle shown above.

article thumbnail

Data Reprocessing Pipeline in Asset Management Platform @Netflix

The Netflix TechBlog

Production Use Cases Real-Time APIs (backed by the Cassandra database) for asset metadata access don’t fit analytics use cases by data science or machine learning teams. This feature support required a significant update in the data table design (which includes new tables and updating existing table columns).

Media 237
article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

The Netflix video processing pipeline went live with the launch of our streaming service in 2007. To that end, the Video and Image Encoding team in Encoding Technologies (ET) has spent the last few years rebuilding the video processing pipeline on our next-generation microservice-based computing platform Cosmos.

article thumbnail

Modern applications at AWS

All Things Distributed

The giant, monolithic "bookstore" application and giant database that we used to power Amazon.com limited our speed and agility.

AWS 164
article thumbnail

ChatGPT vs. MySQL DBA Challenge

Percona

At the same time that I see database engineers relying on the tool, sites such as StackOverflow are banning ChatGPT. ChatGPT: The innodb_redo_log_capacity parameter specifies the maximum size of the InnoDB redo log buffer, which is used to store changes made to the database before they are written to disk. What could it be?