DZone

NOVEMBER 16, 2023

This article is intended for data scientists, AI researchers, machine learning engineers, and advanced practitioners in the field of artificial intelligence who have a solid grounding in machine learning concepts, natural language processing , and deep learning architectures.

Artificial Intelligence 258

Artificial Intelligence Architecture Network Engineering 258

DZone

OCTOBER 16, 2023

When creating applications that store and analyze large amounts of data, such as time series, log data, or event-storing ones, developing a good and future-proof data model can be a difficult task. Choosing the right data types in PostgreSQL can significantly impact your database's performance and efficiency.

Best Practices 272

Best Practices Speed Database Efficiency 272

DZone

NOVEMBER 15, 2023

In this article, I want to share my knowledge and opinion about the data types that are often used as an identifier. These are measurements of search speed by key and data types for the key on the database side. Hello everyone! Today we will touch on two topics at once.

Database 286

Database Java Performance Speed 286

DZone

OCTOBER 23, 2023

In most financial firms, online transaction processing (OLTP) often relies on static or infrequently updated data, also called reference data. NoSQL databases emerge as ideal candidates to meet these requirements, and cloud platforms such as AWS offer managed and highly resilient data ecosystems.

AWS 266

AWS Performance Database Architecture 266

DZone

NOVEMBER 16, 2023

This is an article from DZone's 2023 Observability and Application Performance Trend Report. Telemetry, being a critical part of observability, refers to the continuous nature of data collection. Telemetry, being a critical part of observability, refers to the continuous nature of data collection.

Software 278

Software Software Systems Processing 278

DZone

SEPTEMBER 14, 2023

In today's data-driven world, efficient data processing plays a pivotal role in the success of any project. Apache Spark , a robust open-source data processing framework, has emerged as a game-changer in this domain.

Big Data 269

Big Data Processing Games Open Source 269

DZone

FEBRUARY 22, 2024

We create custom applications in Salesforce that are built on top of customer or transactional data from Salesforce data tables. This article will shed light on those techniques. So it is important to understand the current state of your data in the production environment.

Tuning 161

Tuning Efficiency Performance Development 161

DZone

JANUARY 24, 2024

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests conducted in December 2023, explores how to carry out performance testing, detailing hands-on methods you can apply yourself, and provides recent benchmark data for your reference. The benchmark tool we used can be found here.

Cloud 268

Cloud Benchmarking Testing Performance 268

DZone

DECEMBER 12, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a "getting started" workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 271

Cloud 271

DZone

MARCH 11, 2024

This article delves deep into the essence of Istio, illustrating its pivotal role in a Kubernetes (KIND) based environment, and guides you through a Helm-based installation process, ensuring a comprehensive understanding of Istio's capabilities and its impact on microservices architecture.

Open Source 252

Open Source Traffic Architecture Monitoring 252

DZone

JANUARY 6, 2024

In this article, we will delve deeper into the issues associated with meetings in software engineering and explore the available data. However, they often come with challenges that can significantly impact the efficiency and productivity of software development teams.

Software Engineering 284

Software Engineering Efficiency Engineering Software 284

DZone

MAY 21, 2023

As more organizations adopt Kubernetes, the need for proper security and management of sensitive data within these environments becomes paramount. One crucial aspect of ensuring a secure Kubernetes infrastructure is the effective management of secrets, such as API keys, passwords, and tokens.

Best Practices 323

Best Practices Infrastructure Efficiency 323

DZone

DECEMBER 18, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 251

Cloud 251

DZone

JULY 13, 2023

In today's data-driven world, organizations need efficient and scalable data pipelines to process and analyze large volumes of data. Medallion Architecture provides a framework for organizing data processing workflows into different zones, enabling optimized batch and stream processing.

Azure 246

Azure Architecture Efficiency Processing 246

DZone

NOVEMBER 25, 2023

In a detailed article, we've discussed how to align a NoSQL database with specific business needs. Factors like read and write speed, latency, and data distribution methods are essential. For instance, rapid read and write operations are crucial for applications requiring real-time data analytics.

Database 268

Database Latency Speed Metrics 268

DZone

JANUARY 18, 2024

Java Streams , introduced in Java 8, have revolutionized how we handle collections of data in Java. They offer a high-level, declarative approach to data processing, but one of their most intriguing features is lazy evaluation.

Java 208

Java Processing 208

DZone

DECEMBER 1, 2023

Previous Articles Previous articles on PgBench and CockoachDB: Using PgBench with CockroachDB Serverless Optimizing PgBench for CockroachDB Part 1 Optimizing PgBench for CockroachDB Part 2 Motivation For the longest time, CockroachDB only supported serializable isolation. In our next release after 23.1,

Serverless 273

Serverless Performance 273

High Scalability

FEBRUARY 22, 2023

This is a guest article by NK. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work?

Virtualization 310

Virtualization Website Performance 310

DZone

SEPTEMBER 25, 2023

This is an article from DZone's 2023 Database Systems Trend Report. At the heart of this digital transformation lies the critical role of cloud databases — the backbone of modern data management. At the heart of this digital transformation lies the critical role of cloud databases — the backbone of modern data management.

Education 256

Education Innovation Scalability Cloud 256

DZone

APRIL 11, 2023

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. This article will explore how these technologies can be used together to create an optimized data pipeline for data processing in the cloud.

Azure 246

Azure Analytics Storage Cloud 246

The Netflix TechBlog

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226

Systems Media Cache Open Source 226

DZone

MARCH 24, 2023

This article compares QuestDB with one of the most popular databases on the market, MongoDB. Time-series data has gained popularity in recent years. It is used in a wide variety of industries and use cases (if you are new to this space, read our article 'What is Time-Series Data' ).

Benchmarking 234

Benchmarking Database Processing Performance 234

DZone

FEBRUARY 17, 2023

Each data point in a system that produces data on an ongoing basis corresponds to an Event. Event Streams are described as a continuous flow of events or data points. Event Streams are sometimes referred to as Data Streams within the developer community since they consist of continuous data points.

Processing 273

Processing Systems Development 273

DZone

FEBRUARY 12, 2024

Optimizing complex MySQL queries is crucial when dealing with large datasets, such as fetching data from a database containing one million records or more. This article explores strategies to optimize complex MySQL queries for efficient data retrieval from large datasets, ensuring quick and reliable access to information.

Performance 161

Performance Database Strategy Efficiency 161

DZone

JUNE 20, 2023

Now, it is harder to configure communication between distributed services and secure the data in transit. In this article, we will briefly look at what Istio is and then see how to install Istio in Kubernetes in just 5 steps. However, microservices and multicloud applications have given rise to new challenges.

Cloud 352

Cloud Development 352

DZone

JANUARY 26, 2023

Real-time data processing with Apache Kafka became the de facto standard to correlate and prevent fraud continuously before it happens. Fraud detection becomes increasingly challenging in a digital world across all industries.

Games 322

Games Technology Technology Processing 322

DZone

SEPTEMBER 26, 2023

If your environment is like many others, it can often seem like your systems produce logs filled with a bunch of excess data. If you don’t have the right tools, it can feel like you’re stuck with a bunch of disparate, hard-to-parse data. Though it can feel like more trouble than it’s worth, sorting through logs is crucial.

Best Practices 249

Best Practices Analytics Infrastructure Network 249

DZone

FEBRUARY 27, 2024

Caching is a critical technique for optimizing application performance by temporarily storing frequently accessed data, allowing for faster retrieval during subsequent requests. Multi-layered caching involves using multiple levels of cache to store and retrieve data.

Cache 161

Cache Efficiency Architecture Design 161

DZone

DECEMBER 11, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop (linked below) to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 284

Cloud Architecture Monitoring Code 284

DZone

DECEMBER 21, 2023

These articles covered this fairly new open dashboard and visualization project targeting cloud-native environments. I used a getting started workshop to guide you through this series and to provide a hands-on experience for those new to visualizing observability data.

Cloud 169

Cloud 169

DZone

FEBRUARY 2, 2024

In the rapidly evolving landscape of the Internet of Things (IoT), edge computing has emerged as a critical paradigm to process data closer to the source—IoT devices. This proximity to data generation reduces latency, conserves bandwidth and enables real-time decision-making.

IoT 195

IoT Artificial Intelligence Latency Internet 195

Dynatrace

MARCH 29, 2024

Teams require innovative approaches to manage vast amounts of data and complex infrastructure as well as the need for real-time decisions. Some of these challenges involve basic tasks—such as data collection. Dynatrace Grail enables organizations to ingest data without predefining schema.

Artificial Intelligence 185

Artificial Intelligence DevOps Strategy Open Source 185

DZone

SEPTEMBER 25, 2023

It is the second of a series of articles that is built on top of that project, representing experiments with various statistical and machine learning models, data pipelines implemented using existing DAG tools, and storage services, both cloud-based and alternative on-premises solutions.

Storage 258

Storage AWS Architecture Cloud 258

DZone

APRIL 27, 2023

Securing access to REST API s is critical for preventing unauthorized actions and protecting sensitive data. This article describes how we can protect REST APIs using Role-based access control (RBAC) in the Quarkus Java framework. Additionally, the article will cover building a custom solution to secure REST endpoints.

Java 281

Java Open Source Cloud Design 281

DZone

DECEMBER 18, 2023

As distributed systems play a critical role in various domains such as cloud computing , Internet of Things ( IoT ), and data centers, optimizing energy consumption has significant implications for reducing operational costs and mitigating the environmental impact.

Energy 169

Energy Efficiency Systems IoT 169

DZone

FEBRUARY 12, 2024

IoT has ushered in an era of unprecedented connectivity and data collection. In this article, we will explore the strategies and tools for managing IoT edge devices at scale , focusing on device lifecycle and configuration management. However, managing a large number of these edge devices efficiently poses a significant challenge.

IoT 204

IoT Strategy Efficiency 204

DZone

JULY 13, 2023

In this article, I will explain how CloudWatch synthetics are used to monitor your application using AWS synthetics canaries and why it is needed. Along with this, customers also want to ensure sensitive data is detected and masked consistently across all their logs.

Monitoring 246

Monitoring AWS Infrastructure 246