article thumbnail

How Amazon is solving big-data challenges with data lakes

All Things Distributed

At Amazon's scale, a miscalculated metric, like cost per unit, or delayed data can have a huge impact (think millions of dollars). The team is constantly looking for ways to get more accurate data, faster. That's why, in 2019, they had an idea: Build a data lake that can support one of the largest logistics networks on the planet.

Big Data 209
article thumbnail

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. This allows quick answers to questions such as: “Show me the percentage shortfall in ventilators by state.”.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. This allows quick answers to questions such as: “Show me the percentage shortfall in ventilators by state.”.

article thumbnail

Rethinking the 'production' of data

All Things Distributed

For example, Kärcher, the maker of cleaning technologies, manages its entire fleet through the cloud solution "Kärcher Fleet" This transmits data from the company's cleaning devices e.g. about the status of maintenance and loading, when the machines are used, and where the machines are located.

article thumbnail

Data Pipelines: The Hammer for Every Nail

Abhishek Tiwari

In the era of big data and complex data processing, data pipelines have emerged as a popular solution for managing and manipulating data. They provide a systematic approach to extract, transform, and load (ETL) data from various sources, enabling organizations to derive valuable insights.

article thumbnail

Expanding the Cloud: Introducing Amazon QuickSight

All Things Distributed

In such a data intensive environment, making key business decisions such as running marketing and sales campaigns, logistic planning, financial analysis and ad targeting require deriving insights from these data. However, the data infrastructure to collect, store and process data is geared toward developers (e.g.,

Cloud 138