Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge A future blog will continue my exploration into Citus by scaling out pgbench into other architectures.

Database 102

Database Benchmarking Latency C++ 102

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 126

Infrastructure Metrics Architecture Efficiency 126

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 100

Infrastructure Metrics Architecture Efficiency 100

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Netflix TechBlog

AUGUST 29, 2023

A brief history of IPC at Netflix Netflix was early to the cloud, particularly for large-scale companies: we began the migration in 2008, and by 2010, Netflix streaming was fully run on AWS. Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

OCTOBER 27, 2020

The processed data is typically stored as data warehouse tables in AWS S3. At Netflix, we also heavily embrace a microservice architecture that emphasizes separation of concerns. For how our machine learning recommendation systems leverage our key-value stores, please see more details on this presentation.

Latency 243

Latency Storage Big Data Tuning 243

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

NOVEMBER 29, 2017

As there are few individuals with this expertise, an easier process presents a significant opportunity for companies who want to accelerate their ML usage. After this, there is often a long process of training that includes tuning the knobs and levers, called hyperparameters, that control the different aspects of the training algorithm.

Tuning 96

Tuning AWS Scalability Infrastructure 96

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Go to step 1 if more chunks present. DBLog High Level Architecture. High Availability DBLog uses active-passive architecture. The destination may be a datastore or an external API. Supporting Relational Databases.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Go to step 1 if more chunks present. DBLog High Level Architecture. High Availability DBLog uses an active-passive architecture. The destination may be a datastore or an external API. Supporting Relational Databases.

Database 212

Database Traffic Transportation Open Source 212

All Things Distributed

DECEMBER 12, 2013

Since the table''s primary key attributes are always projected into an index, the UserId attribute is also present. With global secondary indexes in DynamoDB, you can now have many indexes and tune their capacity independently. The results are ordered by the range key, TopScore.

Games 130

Games Scalability Database Retail 130