Remove Artificial Intelligence Remove Cache Remove Data Engineering Remove Speed
article thumbnail

5 data integration trends that will define the future of ETL in 2018

Abhishek Tiwari

Apache Arrow's in-memory columnar layout is specifically optimized for data locality for better performance on modern hardware like CPUs and GPUs. In contrast, Alluxio a middleware for data access - think Alluxio storage layer as fast cache. It generally improves performance by placing frequently accessed data in memory.