DZone

MARCH 14, 2023

When it comes to selecting an optimized file format for Apache Spark applications, there are several options to consider, including Parquet, ORC, and Avro. If you are dealing with large datasets and require fast query processing times , Parquet is a better choice than ORC or Avro.

Storage 130

Storage Performance Processing 130

The Netflix TechBlog

APRIL 12, 2022

Data Mesh streams are schematized with Avro. Writing an Avro schema for such a document is time consuming and error prone to do by hand. yaml configuration Avro schema & Elasticsearch index template generation The approach for both schema and index template generation was very similar.

Engineering 263

Engineering Architecture Java Infrastructure 263

The Netflix TechBlog

AUGUST 1, 2022

We’re using Avro as a shared format for all our schemas, as it’s simple, powerful, and widely adopted by the community. We have also implemented the features to track the data lineage so that our users can have a better picture of the overall data usage.

Processing 272

Processing Transportation Entertainment Tuning 272

InfoQ

JULY 3, 2023

LinkedIn introduced Couchbase as a centralized caching tier for scaling member profile reads to handle increasing traffic that has outgrown their existing database cluster. The new solution achieved over 99% hit rate, helped reduce tail latencies by more than 60% and costs by 10% annually. By Rafal Gancarz

Cache 82

Cache Latency Traffic Database 82

Uber Engineering

FEBRUARY 16, 2018

In distributed systems, retries are inevitable. From network errors to replication issues and even outages in downstream dependencies, services operating at a massive scale must be prepared to encounter, identify, and handle failure as gracefully as possible.

Network 109

Network Engineering Systems Processing 109