Remove Network Remove Performance Remove Software Engineering Remove Storage
article thumbnail

Designing Instagram

High Scalability

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. After that, the various services (e.g.

Design 334
article thumbnail

Evolution of ML Fact Store

The Netflix TechBlog

The first version of our logger library optimized for storage by deduplicating facts and optimized for network i/o using different compression methods for each fact. Then we started hitting roadblocks while optimizing the query performance. Eventually, we decided to simplify the logger.

Storage 187
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

AWS observability: AWS monitoring best practices for resiliency

Dynatrace

With EC2, Amazon manages the basic compute, storage, networking infrastructure and virtualization layer, and leaves the rest for you to manage: OS, middleware, runtime environment, data, and applications. As a result, various application performance and security problems can go unnoticed absent sufficient monitoring. Amazon EC2.

article thumbnail

Netflix at AWS re:Invent 2019

The Netflix TechBlog

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100
article thumbnail

Netflix at AWS re:Invent 2019

The Netflix TechBlog

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100
article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

When a new leader is elected it loads all data from external storage. Collapse multiple keep-alive requests in Titus Job Coordinator, sending a response to the latest one which has the arrival timestamp less than that of the timestamp of the last event sent over the network.

Cache 224
article thumbnail

Using SQL Server’s SNITrace to Troubleshoot Networking Issues

SQL Server According to Bob

Using SQL Server’s SNITrace to Troubleshoot Networking Issues In the process of tracking down a few TCP 10054 issues (highlighted here: ​​ [link] ) I ​​ also ​​ used ​​ the ​​ SNITrace ​​ (SNI Trace) ​​ capabilities.

Network 40