Analytics, Azure and Big Data - Technology Performance Pulse

Introduction to Azure Data Lake Storage Gen2

DZone

FEBRUARY 1, 2023

Built on Azure Blob Storage, Azure Data Lake Storage Gen2 is a suite of features for big data analytics. Azure Data Lake Storage Gen1 and Azure Blob Storage's capabilities are combined in Data Lake Storage Gen2.

Azure

Azure Storage Big Data Analytics

No need to compromise visibility in public clouds with the new Azure services supported by Dynatrace

Dynatrace

JULY 6, 2020

As adoption rates for Microsoft Azure continue to skyrocket, Dynatrace is developing a deeper integration with the platform to provide even more value to organizations that run their businesses on Azure or use it as a part of their multi-cloud strategy. Azure Batch. Azure DB for MariaDB. Azure DB for MySQL.

Azure

Azure Cloud Big Data Virtualization

Experiences with approximating queries in Microsoft’s production big-data clusters

The Morning Paper

SEPTEMBER 8, 2019

Experiences with approximating queries in Microsoft’s production big-data clusters Kandula et al., I’ve been excited about the potential for approximate query processing in analytic clusters for some time, and this paper describes its use at scale in production. VLDB’19. Approximate query support.

Big Data

Big Data Analytics Latency Azure

What is container orchestration?

Dynatrace

MARCH 24, 2023

Part of its popularity owes to its availability as a managed service through the major cloud providers, such as Amazon Elastic Kubernetes Service , Google Kubernetes Engine , and Microsoft Azure Kubernetes Service. Likewise, Kubernetes is both an enterprise platform and managed services with Red Hat OpenShift.

Infrastructure

Infrastructure Open Source Operating System Cloud

Using Real-Time Digital Twins for Aggregate Analytics

ScaleOut Software

JUNE 15, 2020

When analyzing telemetry from a large population of data sources, such as a fleet of rental cars or IoT devices in “smart cities” deployments, it’s difficult if not impossible for conventional streaming analytics platforms to track the behavior of each individual data source and derive actionable information in real time.

Analytics

Analytics IoT Lambda Big Data

Using Real-Time Digital Twins for Aggregate Analytics

ScaleOut Software

JUNE 15, 2020

When analyzing telemetry from a large population of data sources, such as a fleet of rental cars or IoT devices in “smart cities” deployments, it’s difficult if not impossible for conventional streaming analytics platforms to track the behavior of each individual data source and derive actionable information in real time.

Analytics

Analytics IoT Lambda Big Data

Microsoft Azure Event Hubs

DZone

FEBRUARY 23, 2023

Introduction With big data streaming platform and event ingestion service Azure Event Hubs , millions of events can be received and processed in a single second. Any real-time analytics provider or batching/storage adaptor can transform and store data supplied to an event hub.

Azure

Azure Big Data Analytics Storage

The Need for Real-Time Device Tracking

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT

IoT Analytics Big Data Architecture

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes. What Exactly is Greenplum? At a glance – TLDR.

Big Data

Big Data Database Artificial Intelligence Open Source

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

These systems enable vast amounts of data to be spread over multiple nodes, allowing for simultaneous access and boosting processing efficiency. Amazon S3 and Microsoft Azure Blob Storage leverage distributed storage solutions. These distributed storage services also play a pivotal role in big data and analytics operations.

Storage

Storage Systems Big Data Azure

Microsoft Engineering loves SQLBits

SQL Server According to Bob

FEBRUARY 15, 2018

Microsoft engineering is actually sending quite a few folks over the Atlantic to come talk about SQL Server 2017, SQL Server on Linux, GDPR, Performance, Security, Azure Data Lake, Azure SQL Database, Azure SQL Data Warehouse, and Azure CosmosDB. SELECT * FROM Azure Cosmos DB – Andrew Liu.

Engineering

Engineering Azure Best Practices Servers

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

Within seconds, the software performs aggregate analysis of this data for all real-time digital twins. By avoiding the need to create or connect to complex databases and ship data to offline analytics systems, it can provide timely answers quickly and easily.

Logistics

Logistics Analytics Scalability Cloud

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

Within seconds, the software performs aggregate analysis of this data for all real-time digital twins. By avoiding the need to create or connect to complex databases and ship data to offline analytics systems, it can provide timely answers quickly and easily.

Logistics

Logistics Analytics Scalability Cloud

What is a data lakehouse? Combining data lakes and warehouses for the best of both worlds

Dynatrace

OCTOBER 4, 2022

Generally, the storage technology categorizes data into landing, raw, and curated zones depending on its consumption readiness. The result is a framework that offers a single source of truth and enables companies to make the most of advanced analytics capabilities simultaneously. Support diverse analytics workloads.

Artificial Intelligence

Artificial Intelligence Storage Analytics Government

Mastering Hybrid Cloud Strategy

Scalegrid

MARCH 14, 2024

Workloads from web content, big data analytics, and artificial intelligence stand out as particularly well-suited for hybrid cloud infrastructure owing to their fluctuating computational needs and scalability demands.

Strategy

Strategy Cloud Artificial Intelligence Infrastructure

Even more amazing papers at VLDB 2019 (that I didn’t have space to cover yet)

The Morning Paper

SEPTEMBER 19, 2019

Microsoft have a paper describing their new recovery mechanism in Azure SQL Database , the key feature being that it can recovery in constant time. Hyper Dimension Shuffle describes how Microsoft improved the cost of data shuffling, one of the most costly operations, in their petabyte-scale internal big data analytics platform, SCOPE.

Blockchain

Blockchain Hardware Google Analytics

Technology Performance Pulse

Introduction to Azure Data Lake Storage Gen2

No need to compromise visibility in public clouds with the new Azure services supported by Dynatrace

Trending Sources

Experiences with approximating queries in Microsoft’s production big-data clusters

What is container orchestration?

Using Real-Time Digital Twins for Aggregate Analytics

Using Real-Time Digital Twins for Aggregate Analytics

Microsoft Azure Event Hubs

The Need for Real-Time Device Tracking

What is Greenplum Database? Intro to the Big Data Database

What is a Distributed Storage System

Microsoft Engineering loves SQLBits

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

What is a data lakehouse? Combining data lakes and warehouses for the best of both worlds

Mastering Hybrid Cloud Strategy

Even more amazing papers at VLDB 2019 (that I didn’t have space to cover yet)

Stay Connected