DZone

OCTOBER 9, 2024

detailed in this article ), it has gained significant traction in the software industry lately and organizations are building their applications following microservices architecture. Microservices architecture promotes the development of applications, as suites of small, independent, loosely coupled services.

Architecture 244

Architecture Strategy Scalability Software 244

The Polyglot Developer

OCTOBER 4, 2017

The post Write Guest Articles On The Polyglot Developer Blog appeared first on The Polyglot Developer. I wanted to let you know that I’m currently accepting original guest content, from talented developers like yourself, on a variety of awesome topics.

Development 49

Development 49

DZone

SEPTEMBER 9, 2024

This article explores the impact of different storage formats, specifically Parquet, Avro, and ORC on query performance and costs in big data environments on Google Cloud Platform (GCP). This article provides benchmarks, discusses cost implications, and offers recommendations on selecting the appropriate format based on specific use cases.

Big Data 265

Big Data Storage Analytics Benchmarking 265

DZone

SEPTEMBER 16, 2024

I’ll probably write a series of articles on different features of ClickHouse, and this article will be a general introduction with some interesting points that few people think about when using various databases.

Speed 236

Speed Database Systems 236

The Polyglot Developer

JANUARY 25, 2018

To find out more, check out the article titled, Write Guest Articles on The Polyglot Developer Blog. With that said, I’ve been receiving a lot of questions regarding Markdown, the format in which these blog articles are crafted.

Development 40

Development 40

DZone

OCTOBER 11, 2024

This article provides a brief introduction to how TCPCopy works, with the hope of assisting readers. Architecture The architecture of TCPCopy has undergone several upgrades, and this article introduces the latest 1.0 While many use TCPCopy for testing in their projects, they may not fully understand its underlying principles.

Traffic 169

Traffic Open Source Internet Internet 169

DZone

OCTOBER 1, 2024

Editor's Note: The following is an article written for and published in DZone's 2024 Trend Report, Kubernetes in the Enterprise: Once Decade-Defining, Now Forging a Future in the SDLC.

Software Engineering 263

Software Engineering DevOps Cloud Architecture 263

InfoQ

JUNE 9, 2021

The PDCA (plan-do-check-act) framework can be used to outline the performance, availability, and monitoring to enable teams to ensure performant and highly available applications. These include infrastructure design and setup, application architecture and design, coding, performance testing, and application monitoring. By Kulkarni Girish.

Availability 59

Availability Performance Systems Architecture 59

DZone

OCTOBER 11, 2024

This three-part article series will take you through the process of developing a network anomaly detection system using the Spring Boot framework in a robust manner. The series is organized as follows: Part 1: We’ll concentrate on the foundation and basic structure of our detection system, which has to be created.

Network 270

Network Systems Monitoring Technology 270

DZone

AUGUST 14, 2024

This article will serve as a guide in building high-performance ETL pipelines that are both efficient and scalable. When building ETL data pipelines using Azure Data Factory (ADF) to process huge amounts of data from different sources, you may often run into performance and design-related challenges.

Azure 292

Azure Cloud Scalability Efficiency 292

DZone

JULY 23, 2024

In my previous article, Managing Architectural Tech Debt , I talked about understanding and managing architectural technical debt. In this article, I want to dive deeper into one way to manage architectural technical debt (and technical debt as a whole) — architectural observability ( AO ).

Architecture 239

Architecture Performance 239

Dynatrace

JUNE 17, 2024

In an article published by The Register’s Tom Claburn, Dynatrace chief technology strategist Alois Reitbauer shares his insights on the transformative role Kubernetes played in initiating the cloud-native movement. Read the full article in The Register.

Open Source 244

Open Source Government Google Innovation 244

DZone

OCTOBER 2, 2024

In this article, we’ll dive deep into the concept of database sharding, a critical technique for scaling databases to handle large volumes of data and high levels of traffic. Here’s what you can expect to learn: What is Sharding?: We’ll start by defining what sharding is and why it’s essential for modern, high-performance databases.

Database 267

Database Systems Scalability Traffic 267

DZone

MARCH 21, 2024

This article is made especially for beginners to make the ideas and steps of adding NCache to your Java applications clear and easy to understand. It doesn't matter if you've been developing for years or if you're new to caching , this article will help you get a good start with NCache Java Edition.

Java 292

Java Cache Technology Technology 292

DZone

SEPTEMBER 25, 2023

It is the second of a series of articles that is built on top of that project, representing experiments with various statistical and machine learning models, data pipelines implemented using existing DAG tools, and storage services, both cloud-based and alternative on-premises solutions.

Storage 258

Storage AWS Architecture Cloud 258

DZone

AUGUST 21, 2024

In this article, I'll explain: Having worked with over 50 Snowflake customers across Europe and the Middle East, I've analyzed hundreds of Query Profiles and identified many issues including issues around performance and cost.

Performance 231

Performance 231

DZone

AUGUST 4, 2024

In this article, I will shed some light on what differentiates unit testing from other methods and will bring examples of when we can or cannot do without unit testing. We'll also touch upon automation testing , which plays an important role in ensuring code reliability and quality.

Testing 259

Testing Software Software Code 259

DZone

SEPTEMBER 2, 2024

This article is part of a series exploring a workshop guiding you through the open source project Fluent Bit, what it is, a basic installation, and setting up the first telemetry pipeline project. Are you ready to get started with cloud-native observability and telemetry pipelines?

Open Source 214

Open Source Cloud 214

DZone

JUNE 19, 2024

In this article, we will explore two pagination strategies, offset and cursor-based pagination, that are suited to different scenarios and requirements. Retrieval strategies play a crucial role in improving performance and scalability, especially when response times are critical. Pagination is a core technique used to manage data effectively.

Efficiency 297

Efficiency Strategy Scalability Technology 297

DZone

SEPTEMBER 11, 2024

This article explores an optimization technique for scenarios where frequent writes to a container occur in a multi-threaded environment. Efficient data synchronization is crucial in high-performance computing and multi-threaded applications.

Cache 189

Cache Efficiency Performance 189

DZone

JULY 31, 2024

This article sets out to explore some of the essential tools required by organizations in the domain of data engineering to efficiently improve data quality and triage/analyze data for effective business-centric machine learning analytics, reporting, and anomaly detection.

Data Engineering 254

Data Engineering FinTech Engineering Analytics 254

High Scalability

FEBRUARY 22, 2023

This is a guest article by NK. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work?

Virtualization 310

Virtualization Website Performance 310

DZone

AUGUST 1, 2024

Editor's Note: The following is an article written for and published in DZone's 2024 Trend Report, Database Systems: Modernization for Data-Driven Architectures. Time series data has become an essential part of data collection in various fields due to its ability to capture trends, patterns, and anomalies.

Database 229

Database Analytics Software Software 229

DZone

OCTOBER 7, 2024

This article explores the essential components of such infrastructure, focusing on the technical considerations for GPU-agnostic design, container optimization, and workload scheduling.

Infrastructure 161

Infrastructure Azure Hardware AWS 161

DZone

DECEMBER 16, 2023

In my previous article ‘ Data Validation to Improve Data Quality ’, I shared the importance of data quality and a checklist of validation rules to achieve it. In this article, we focus on the best practices to employ while building the data pipelines to ensure data quality.

Best Practices 266

Best Practices 266

DZone

JULY 5, 2024

This article explores leveraging various monitoring tools to identify, diagnose, and resolve issues in these essential development and collaboration platforms. Before we discuss the monitoring tools, let's clarify the importance of monitoring.

Best Practices 236

Best Practices Monitoring Software Software 236

DZone

JANUARY 17, 2024

This article delves into the importance of automation using the AWS Load Balancer controller and Ingress template. Automating AWS Load Balancers is essential for managing cloud infrastructure efficiently.

AWS 299

AWS Infrastructure Efficiency Cloud 299

DZone

FEBRUARY 16, 2023

If you missed any of the previous articles, head on back to the introduction for a quick update. After laying out the groundwork for this series in the initial article, I spent some time in the second article sharing who the observability players are.

Open Source 234

Open Source Cloud Monitoring Development 234

DZone

AUGUST 27, 2024

This article is part of a series exploring a workshop guiding you through the open source project Fluent Bit, what it is, a basic installation, and setting up the first telemetry pipeline project. Are you ready to get started with cloud-native observability with telemetry pipelines?

Open Source 177

Open Source Cloud 177

DZone

DECEMBER 12, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. In the previous article , I kicked off with an introduction to and installation of Perses and provided links to the actual online workshop content.

Cloud 230

Cloud 230

DZone

JANUARY 29, 2024

It was the first article in this series. In this article, you'll find the first pitfall discussion that's another common mistake organizations make. In the previous introduction , we looked at the problem facing everyone with cloud-native observability.

Cloud 227

Cloud DevOps Engineering 227

DZone

APRIL 27, 2023

This article describes how we can protect REST APIs using Role-based access control (RBAC) in the Quarkus Java framework. The Quarkus Java framework comes with native support for RBAC, which will be the initial focus of this article. Additionally, the article will cover building a custom solution to secure REST endpoints.

Java 254

Java Open Source Cloud Design 254

DZone

NOVEMBER 16, 2023

This article is intended for data scientists, AI researchers, machine learning engineers, and advanced practitioners in the field of artificial intelligence who have a solid grounding in machine learning concepts, natural language processing , and deep learning architectures.

Artificial Intelligence 251

Artificial Intelligence Architecture Network Engineering 251

DZone

JULY 23, 2024

In this article, we’ll take a closer look at the concept of it: what it entails, its benefits, general flow, and key concepts. This article is aimed at software architects, system developers, and project managers who might be contemplating or are already engaged in integrating Event Sourcing into their systems.

Systems 130

Systems Scalability Architecture Technology 130

DZone

DECEMBER 5, 2023

In the previous articles, you learned about the virtual threads in Java 21 in terms of history, benefits , and pitfalls. In addition, you probably got inspired by how Quarkus can help you avoid the pitfalls but also understood how Quarkus has been integrating the virtual threads to Java libraries as many as possible continuously.

Virtualization 208

Virtualization Java Performance Programming 208

DZone

JULY 13, 2024

Thanks to this tool, creating environments for integration tests has become simpler (see the article Isolation in Testing with Kafka ). Using Testcontainers has radically improved the process of working with test scenarios. Now we can easily launch containers with different versions of databases, message brokers, and other services.

Testing 141

Testing Database Processing Performance 141

DZone

MARCH 29, 2023

This article discusses the challenges and best practices of data migration when transferring on-premise data to the cloud. The article will also explore the role of data engineering in ensuring successful data transfer and integration and different approaches to data migration.

Best Practices 287

Best Practices Cloud Data Engineering Storage 287