article thumbnail

Hyper Scale VPC Flow Logs enrichment to provide Network Insight

The Netflix TechBlog

VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC. At Netflix we publish the Flow Log data to Amazon S3. These characteristics allow for an on-call response time that is relaxed and more in line with traditional big data analytical pipelines.

Network 150
article thumbnail

Python at Netflix

The Netflix TechBlog

Content is placed on the network of servers in the Open Connect CDN as close to the end user as possible, improving the streaming experience for our customers and reducing costs for both Netflix and our Internet Service Provider (ISP) partners. We are proud to say that our team’s tools are built primarily in Python.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Välkommen till Stockholm – An AWS Region is coming to the Nordics

All Things Distributed

Icelandic low-cost airline carrier WOW air is using AWS for its Internet-facing IT infrastructure, including its booking engine, development platforms, and web servers. The airline has also been able to scale quickly to cope with spikes in seasonal traffic, cutting application latency and improving the overall customer experience.

AWS 116
article thumbnail

Expanding the Cloud – An AWS Region is coming to Hong Kong

All Things Distributed

9GAG is a Hong Kong-based company responsible for 9gag.com , one of the top traffic websites in the world. Then too, Internet service providers can shut down their services any time they feel threatened by the DDoS attacks.

AWS 146
article thumbnail

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. For an internet road warrior they are a complete nightmare. After many investigations I settled for T-Mobile which has an international Blackberry supplement that is $20/month for all BB mail traffic.

Wireless 107
article thumbnail

Probabilistic Data Structures for Web Analytics and Data Mining

Highly Scalable

Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets often requires powerful distributed data stores like Hadoop and heavy data processing with techniques like MapReduce.

Analytics 191
article thumbnail

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them. Introducing a new Internet protocol is not a simple feat.

Internet 114