article thumbnail

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

Uber is committed to delivering safer and more reliable transportation across our global markets.

Big Data 109
article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our trace data collection agent transports traces to Mantis job cluster via the Mantis Publish library.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Towards a Reliable Device Management Platform

The Netflix TechBlog

MQTT is an OASIS standard messaging protocol for the Internet of Things (IoT) and was designed as a highly lightweight yet reliable publish/subscribe messaging transport that is ideal for connecting remote devices with a small code footprint and minimal network bandwidth. million elements. this is configurable through enable.auto.commit.

Latency 213
article thumbnail

Expanding the Cloud – The Second AWS GovCloud (US) Region, AWS GovCloud (US-East)

All Things Distributed

The AWS GovCloud (US-East) Region is located in the eastern part of the United States, providing customers with a second isolated Region in which to run mission-critical workloads with lower latency and high availability.

AWS 117
article thumbnail

Plan Your Multi Cloud Strategy

Scalegrid

They can also bolster uptime and limit latency issues or potential downtimes. Adopting open-source standards and tools like Kubernetes lays the groundwork for creating adaptable and transportable solutions that promote application deployment and management in various cloud environments.

Strategy 130
article thumbnail

Understanding gRPC Concepts, Use Cases, and Best Practices

DZone

Big data is generated and transported using various mediums in single requests. With the increase in the size of data, we have activities like serializing, deserializing, and transportation costs added to it. Though we are not worried about computing resources, the latency becomes an overhead.

article thumbnail

Unlocking Enterprise systems using voice

All Things Distributed

The availability of large scale voice training data, the advances made in software with processing engines such as Caffe, MXNet and Tensorflow, and the rise of massively parallel compute engines with low-latency memory access, such as the Amazon EC2 P3 instances have made voice processing at scale a reality.

Systems 110