article thumbnail

Designing Instagram

High Scalability

Generating machine learning based personalized recommendations to discover new people, photos, videos, and stories relevant one’s interest. We will use a graph database such as Neo4j to store the information. Additionally, we can use columnar databases like Cassandra to store information like user feeds, activities, and counters.

Design 334
article thumbnail

Fallacy #4: The network is secure

Particular Software

In one such organization I've heard of, there existed two separate networks. To get data from a different network, you needed to browse in a separate room, as workstations did not have access to the Internet. Design secure systems: See what Udi has to say in Day 1 of his Advanced Distributed Systems Design video course.

Network 40
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

The Netflix video processing pipeline went live with the launch of our streaming service in 2007. To that end, the Video and Image Encoding team in Encoding Technologies (ET) has spent the last few years rebuilding the video processing pipeline on our next-generation microservice-based computing platform Cosmos.

article thumbnail

ChatGPT vs. MySQL DBA Challenge

Percona

At the same time that I see database engineers relying on the tool, sites such as StackOverflow are banning ChatGPT. ChatGPT: The innodb_redo_log_capacity parameter specifies the maximum size of the InnoDB redo log buffer, which is used to store changes made to the database before they are written to disk. What could it be?

article thumbnail

Stuff The Internet Says On Scalability For October 5th, 2018

High Scalability

They'll love it and you'll be their hero forever. They'll love it and you'll be their hero forever.

Internet 156
article thumbnail

Trends and Topics for 2022

Adrian Cockcroft

As well as the video, there’s a long podcast where I discuss them with Mik Kersten. For example AWS launched an instance type with 800 Gbits/s of network bandwith in 2021. These are personal thoughts across a wide range of topics, I’m not speaking for my current or past employers in this post.

article thumbnail

Bandwidth or Latency: When to Optimise for Which

CSS Wizardry

When it comes to network performance, there are two main limiting factors that will slow you down: bandwidth and latency. If you’re streaming video, the difference between a 2Mb 1 connection and a 20Mb connection will surely be appreciated. a CDN) or mitigating network overhead (e.g. Bandwidth is defined as…. The Time Column.

Latency 133