The Netflix TechBlog

MAY 26, 2020

VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC. At Netflix we publish the Flow Log data to Amazon S3. These characteristics allow for an on-call response time that is relaxed and more in line with traditional big data analytical pipelines.

Network 150

Network Tuning AWS Big Data 150

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

Dynatrace

FEBRUARY 16, 2023

As teams try to gain insight into this data deluge, they have to balance the need for speed, data fidelity, and scale with capacity constraints and cost. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 191

Analytics Innovation Metrics Database 191

ScaleOut Software

JULY 19, 2021

And it can maintain contextual information about every data source (like the medical history of a device wearer or the maintenance history of a refrigeration system) and keep it immediately at hand to enhance the analysis.

IoT 78

IoT Analytics Big Data Architecture 78

The Netflix TechBlog

JULY 26, 2021

However, it is paramount that we validate the complete set of identifiers such as a list of movie ids across producers and consumers for higher overall confidence in the data transport layer of choice. Data Consumption Our studio partners rely on data to make informed decisions and to collaborate during all the phases related to production.

Big Data 253

Big Data Government Analytics Processing 253

InfoQ

JULY 3, 2023

LinkedIn introduced Couchbase as a centralized caching tier for scaling member profile reads to handle increasing traffic that has outgrown their existing database cluster. The new solution achieved over 99% hit rate, helped reduce tail latencies by more than 60% and costs by 10% annually. By Rafal Gancarz

Cache 83

Cache Latency Traffic Database 83

The Netflix TechBlog

APRIL 29, 2019

Demand Engineering Demand Engineering is responsible for Regional Failovers , Traffic Distribution, Capacity Operations and Fleet Efficiency of the Netflix cloud. Orchestration The Big Data Orchestration team is responsible for providing all of the services and tooling to schedule and execute ETL and Adhoc pipelines.

Open Source 279

Open Source Network Infrastructure Big Data 279

Scalegrid

MARCH 28, 2024

For vertical scaling, Memcached allows augmenting existing servers with additional CPU cores and memory, thereby enhancing the capacity of the caching pool to manage higher traffic volumes and larger data loads. Advanced Redis Features Showdown Big data center concept, cloud database, server power station of the future.

Cache 130

Cache Storage Scalability Architecture 130

All Things Distributed

DECEMBER 12, 2018

Vivino also uses Auto Scaling to deal with the large seasonal fluctuations in traffic. During the winter holiday season, the use of the app increases by up to 300% and AWS allows them to seamlessly scale up to cope with the increase in traffic. Telenor Connexion. Telenor Connexion is all-in on AWS.

AWS 124

AWS Cloud Games Serverless 124

Tech News Gather

OCTOBER 7, 2023

A call tracking app allows you to monitor traffic and identify peak call times. With this data, you can implement intelligent call routing systems that ensure calls are directed to the right department or agent, reducing wait times and improving the overall customer experience.

Strategy 52

Strategy Big Data Scalability Games 52

O'Reilly

SEPTEMBER 19, 2023

Each time, the underlying implementation changed a bit while still staying true to the larger phenomenon of “Analyzing Data for Fun and Profit.” ” They weren’t quite sure what this “data” substance was, but they’d convinced themselves that they had tons of it that they could monetize.

Hardware 97

Hardware Storage Big Data Blockchain 97

All Things Distributed

APRIL 4, 2017

The airline has also been able to scale quickly to cope with spikes in seasonal traffic, cutting application latency and improving the overall customer experience. flights, allowing the airline to expand twelvefold to cope with the spike in traffic that it experienced at the time.

AWS 116

AWS Airlines Latency Games 116

All Things Distributed

NOVEMBER 15, 2016

The cost and complexity to implement, scale, and use BI makes it difficult for most companies to make data analysis ubiquitous across their organizations. QuickSight is a cloud-powered BI service built from the ground up to address the big data challenges around speed, complexity, and cost. Enter Amazon QuickSight.

Analytics 152

Analytics Availability Media Social Media 152

Highly Scalable

MAY 1, 2012

Let us start with a simple example that illustrates capabilities of probabilistic data structures: Let us have a data set that is simply a heap of ten million random integer values and we know that it contains not more than one million distinct values (there are many duplicates). what is the cardinality of the data set)?

Analytics 191

Analytics Traffic Big Data Efficiency 191

All Things Distributed

JUNE 20, 2017

9GAG is a Hong Kong-based company responsible for 9gag.com , one of the top traffic websites in the world. Some of the most successful startups in the world—including 8 Securities, 9GAG, and GoAnimate—are already using AWS to deliver highly reliable, scalable, and secure applications to customers.

AWS 146

AWS Logistics Cloud Social Media 146

All Things Distributed

NOVEMBER 12, 2012

Many young businesses as well as established enterprises are already using AWS, many of them targeting customers globally.

Cloud 117

Cloud AWS Ecommerce Latency 117

All Things Distributed

JANUARY 11, 2011

After many investigations I settled for T-Mobile which has an international Blackberry supplement that is $20/month for all BB mail traffic. For a while this was great but as this doesnt include web and application internet traffic I started to see a rise in my roaming costs which T-Mobile charges at $15/MB. Their starting rates is â?¬27.50

Wireless 107

Wireless AWS Internet Internet 107

All Things Distributed

AUGUST 16, 2011

ITAR is the International Traffic in Arms Regulatory framework which stipulates for example that data must be stored in an environment where physical and logical access is restricted to US Persons. Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics.

AWS 111

AWS Government Big Data Cloud 111

The Netflix TechBlog

OCTOBER 15, 2019

No need to acquire locks on tables, which is essential to ensure that the write traffic on the database is never blocked by our service. Dumps can be taken in chunks, so that there is no need to repeat from scratch in case of failure. High availability, via standby instances across AWS Availability Zones.

Transportation 192

Transportation Architecture Processing Storage 192

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. Shell''s IT shop has to figure out how to drive costs down, effectively manage the giant files and make it profitable for the company to deploy these sensors.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

MAY 24, 2011

Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them. Driving down the cost of Big-Data analytics.

Internet 114

Internet Internet AWS Scalability 114

Smashing Magazine

JULY 29, 2019

In Amazon’s case, there is room to make some big data savings on the desktop site and we shouldn’t get complacent just because the screen size suggests I’m not on a mobile device. It accounts for 1.42% of global traffic as of June 2019, according to caniuse.com. I had hoped to try out Opera Mini as part of this experiment.

Cache 96

Cache Google Mobile Network 96