article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. This was the most important question we considered when building our infrastructure because data sampling policy dictates the amount of traces that are recorded, transported, and stored.

article thumbnail

Dynatrace adds support for AWS Transit Gateway with VPC Flow Logs

Dynatrace

This new service enhances the user visibility of network details with direct delivery of Flow Logs for Transit Gateway to your desired endpoint via Amazon Simple Storage Service (S3) bucket or Amazon CloudWatch Logs. VPC Flow Logs is a feature that gives you the capability to capture more robust IP traffic data that traverses your VPCs.

AWS 222
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Delta: A Data Synchronization and Enrichment Platform

The Netflix TechBlog

Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. No need to acquire locks on tables, which is essential to ensure that the write traffic on the database is never blocked by our service. High availability, via standby instances across AWS Availability Zones.

article thumbnail

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

Uber is committed to delivering safer and more reliable transportation across our global markets.

Big Data 109
article thumbnail

Evolution of Netflix Conductor:

The Netflix TechBlog

External Payload Storage External payload storage was implemented to prevent the usage of Conductor as a data persistence system and to reduce the pressure on its backend datastore. This addition also provides the option to use the Elasticsearch RestClient instead of the Transport Client which was enforced in the previous version.

Lambda 189
article thumbnail

Observations on the Importance of Cloud-based Analytics

All Things Distributed

This allows local councils to keep certain streets well lit, to accommodate high foot traffic, bring on lighting during adverse weather, when ambient light dims to a dangerous level, or even turn lighting down, for example in an industrial estate, where there are no people. Video is analyzed to help stores understand traffic patterns.

Analytics 136
article thumbnail

Dutch Enterprises and The Cloud

All Things Distributed

Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands.

Cloud 130