article thumbnail

Databook: Turning Big Data into Knowledge with Metadata at Uber

Uber Engineering

From driver and rider locations and destinations, to restaurant orders and payment transactions, every interaction on Uber’s transportation platform is driven by data.

Big Data 110
article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

At much less than 1% of CPU and memory on the instance, this highly performant sidecar provides flow data at scale for network insight. Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices.

Network 325
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Kubernetes in the wild report 2023

Dynatrace

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Kubernetes infrastructure models differ between cloud and on-premises. Kubernetes moved to the cloud in 2022.

article thumbnail

Delta: A Data Synchronization and Enrichment Platform

The Netflix TechBlog

Data Pipeline using Delta In the following sections, we are going to describe the Delta-Connector that connects to a datastore and publishes CDC events to the Transport Layer, which is a real-time data transportation infrastructure routing CDC events to Kafka topics.

article thumbnail

Expanding the Cloud: Introducing the AWS Asia Pacific (Mumbai) Region

All Things Distributed

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Market innovators and change agents need a comprehensive infrastructure platform that can reliably scale on-demand. Advanced problem solving that connects big data with machine learning.

AWS 90
article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

article thumbnail

Dutch Enterprises and The Cloud

All Things Distributed

Shell leverages AWS for big data analytics to help achieve these goals. By offloading the task of managing infrastructure to AWS Essent is able to spend more time on innovating on behalf of their customers to help them in their energy usage.

Cloud 130