Thu.Jul 13, 2023

article thumbnail

Medallion Architecture: Efficient Batch and Stream Processing Data Pipelines With Azure Databricks and Delta Lake

DZone

In today's data-driven world, organizations need efficient and scalable data pipelines to process and analyze large volumes of data. Medallion Architecture provides a framework for organizing data processing workflows into different zones, enabling optimized batch and stream processing. This article explores the concepts of Medallion Architecture and demonstrates how to implement batch and stream processing pipelines using Azure Databricks and Delta Lake.

Azure 246
article thumbnail

Tech Transforms podcast: A reporter’s take on AI, data privacy, ChatGPT, and TikTok

Dynatrace

Nihal Krishan’s work as a technology reporter at FedScoop places him at the nexus of politics, policymaking, and technology. As a result, he has access to a variety of insights and opinions on new and emerging technologies. In a special two-episode podcast, Krishan shares his thoughts on artificial intelligence (AI), specifically around two wildly popular, yet extremely contentious apps: ChatGPT and TikTok.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Application Monitoring Using CloudWatch Synthetics

DZone

In this article, I will explain how CloudWatch synthetics are used to monitor your application using AWS synthetics canaries and why it is needed. Imagine you have already invested significant resources in building a robust application infrastructure on Amazon Web Services (AWS). However, with the increasing complexity of your application and the ever-growing number of users, ensuring a seamless user experience has become a challenge.

article thumbnail

The Power of utf8mb4 in MySQL 8.0: Unleashing the Full Potential of Multilingual Data

Percona

In the world of modern web applications, it is increasingly important to support a diverse range of languages and character sets. With the rise of globalization, the need to store and process multilingual data has become essential. MySQL, one of the most popular relational database management systems, recognizes this need and has introduced utf8mb4 in its 8.0 version as a game-changer.

article thumbnail

Why APIs, Service Discovery, and Registry Are Crucial for Your Microservices Architecture

DZone

Microservices architecture is a software development approach that structures an application as a collection of small, independent services, each running in its own process and communicating with lightweight mechanisms, such as APIs. This approach has become increasingly popular due to its numerous benefits, including increased flexibility, scalability, and fault tolerance.

article thumbnail

Is Garbage Collection Consuming High CPU in My Application?

DZone

Automatic garbage collection is a prevalent feature in modern programming languages such as Golang, Node.js, Java,NET, and Python. While it offers convenience to developers by automatically removing unreferenced objects from memory, it can also result in excessive CPU consumption. As applications continuously create numerous objects, the garbage collector runs continuously in the background to reclaim these objects, consuming a significant number of CPU cycles.

Java 130