All Things Distributed

JUNE 20, 2017

9GAG is a Hong Kong-based company responsible for 9gag.com , one of the top traffic websites in the world. Then too, Internet service providers can shut down their services any time they feel threatened by the DDoS attacks.

AWS 146

AWS Logistics Cloud Social Media 146

Highly Scalable

MAY 1, 2012

Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets often requires powerful distributed data stores like Hadoop and heavy data processing with techniques like MapReduce.

Analytics 191

Analytics Traffic Big Data Efficiency 191

The Netflix TechBlog

MAY 26, 2020

VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC. At Netflix we publish the Flow Log data to Amazon S3. It is easier to tune a large Spark job for a consistent volume of data. These events represent a specific cut of data from the table.

Network 150

Network Tuning AWS Big Data 150

The Netflix TechBlog

APRIL 29, 2019

Content is placed on the network of servers in the Open Connect CDN as close to the end user as possible, improving the streaming experience for our customers and reducing costs for both Netflix and our Internet Service Provider (ISP) partners. Internally, we also built an event-driven platform that is fully written in Python.

Open Source 279

Open Source Network Infrastructure Big Data 279

Smashing Magazine

JULY 29, 2019

Last time, I navigated the web for a day using Internet Explorer 8. Many of us are lucky enough to be on mobile plans which allow several gigabytes of data transfer per month. I downloaded TripMode ; an application for Mac which gives you control over which apps on your Mac can access the internet. I enabled Chrome.

Cache 96

Cache Google Mobile Network 96