article thumbnail

2021 Data/AI Salary Survey

O'Reilly

The results are biased by the survey’s recipients (subscribers to O’Reilly’s Data & AI Newsletter ). Our audience is particularly strong in the software (20% of respondents), computer hardware (4%), and computer security (2%) industries—over 25% of the total. Google Cloud is an obvious omission from this story.

Azure 145
article thumbnail

Friends don't let friends build data pipelines

Abhishek Tiwari

Unfortunately, building data pipelines remains a daunting, time-consuming, and costly activity. Not everyone is operating at Netflix or Spotify scale data engineering function. Often companies underestimate the necessary effort and cost involved to build and maintain data pipelines.

Latency 63
article thumbnail

5 data integration trends that will define the future of ETL in 2018

Abhishek Tiwari

Because supported big data frameworks and applications can utilize the same internal memory format, they can avoid data serialization and deserialization to convert data between various formats. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache.