Dynatrace

APRIL 5, 2024

When there isn’t enough traffic (requests/min) for an SLO Detection becomes sporadic, resulting in insufficient data points for establishing the sampling interval necessary for generating “Event duration.” This assumes that if there’s an absence of data, the Service Level Objective (SLO) must be assessed at 100%.

Efficiency 221

Efficiency Traffic Tuning Metrics 221

DZone

JANUARY 9, 2024

In the data-driven landscape of today, automation has become indispensable across industries, not just to maximize efficiency but, more importantly, to ensure quality. This holds true for the critical field of data engineering as well. Automated testing methodologies are now imperative to deliver speed, accuracy, and integrity.

Data Engineering 130

Data Engineering Efficiency Engineering Testing 130

DZone

JANUARY 6, 2024

However, they often come with challenges that can significantly impact the efficiency and productivity of software development teams. In this article, we will delve deeper into the issues associated with meetings in software engineering and explore the available data.

Software Engineering 284

Software Engineering Efficiency Engineering Software 284

Dynatrace

MAY 2, 2024

Across the globe, privacy laws grant individuals data subject rights, such as the right to access and delete personal data processed about them. Successful compliance with privacy rights requests involves tracking and verifying requests across the entire data ecosystem, including third-party services.

Tuning 221

Tuning Scalability Efficiency Processing 221

DZone

SEPTEMBER 14, 2023

In today's data-driven world, efficient data processing plays a pivotal role in the success of any project. Apache Spark , a robust open-source data processing framework, has emerged as a game-changer in this domain.

Big Data 269

Big Data Processing Games Open Source 269

Percona

APRIL 14, 2023

A shared characteristic in most (if not all) databases, be them traditional relational databases like Oracle, MySQL, and PostgreSQL or some kind of NoSQL-style database like MongoDB, is the use of a caching mechanism to keep (a copy of) part of the data in memory. So, how do you know if your hot data is in memory? MySQL does.

Cache 93

Cache Efficiency Database Monitoring 93

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. They now use modern observability to monitor expanding cloud environments in order to operate more efficiently, innovate faster and more securely, and to deliver consistently better business results. We’ll post news here as it happens!

Efficiency 272

Efficiency Performance Analytics DevOps 272

DZone

FEBRUARY 5, 2024

In today's cloud computing world, all types of logging data are extremely valuable. Logs can include a wide variety of data, including system events, transaction data, user activities, web browser logs, errors, and performance metrics. This innovative service is transforming the way organizations handle their log data.

Analytics 269

Analytics Innovation Strategy Efficiency 269

DZone

FEBRUARY 27, 2024

Caching is a critical technique for optimizing application performance by temporarily storing frequently accessed data, allowing for faster retrieval during subsequent requests. Multi-layered caching involves using multiple levels of cache to store and retrieve data.

Cache 161

Cache Efficiency Architecture Design 161

The Netflix TechBlog

DECEMBER 14, 2023

Engineers from across the company came together to share best practices on everything from Data Processing Patterns to Building Reliable Data Pipelines. The result was a series of talks which we are now sharing with the rest of the Data Engineering community!

Data Engineering 259

Data Engineering Engineering Software Engineering Best Practices 259

DZone

OCTOBER 16, 2023

When creating applications that store and analyze large amounts of data, such as time series, log data, or event-storing ones, developing a good and future-proof data model can be a difficult task. Choosing the right data types in PostgreSQL can significantly impact your database's performance and efficiency.

Best Practices 272

Best Practices Speed Database Efficiency 272

The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. the retry success probability) and compute cost efficiency (i.e., Multi-objective optimizations.

Tuning 210

Tuning Efficiency Big Data Engineering 210

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. We expect complete and accurate data at the end of each run.

Data Engineering 264

Data Engineering Engineering Processing Games 264

Dynatrace

OCTOBER 23, 2023

Hyper-V plays a vital role in ensuring the reliable operations of data centers that are based on Microsoft platforms. This leads to a more efficient and streamlined experience for users. Microsoft Hyper-V is a virtualization platform that manages virtual machines (VMs) on Windows-based systems.

Efficiency 210

Efficiency Virtualization Hardware Performance 210

DZone

APRIL 11, 2023

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. This article will explore how these technologies can be used together to create an optimized data pipeline for data processing in the cloud.

Azure 246

Azure Analytics Storage Cloud 246

DZone

NOVEMBER 7, 2023

In the labyrinth of data-driven architectures, the challenge of data integration—fusing data from disparate sources into a coherent, usable form — stands as one of the cornerstones. As businesses amass data at an unprecedented pace, the question of how to integrate this data effectively comes to the fore.

Processing 177

Processing Architecture Technology Technology 177

DZone

AUGUST 23, 2023

Monitoring Time-Series IoT Device Data Time-series data is crucial for IoT device monitoring and data visualization in industries such as agriculture, renewable energy, and meteorology. In this tutorial, we will guide you through the process of setting up a monitoring system for IoT device data.

IoT 241

IoT Energy Open Source Analytics 241

Dynatrace

MAY 3, 2024

Log data—the most verbose form of observability data, complementing other standardized signals like metrics and traces—is especially critical. As cloud complexity grows, it brings more volume, velocity, and variety of log data. When trying to address this challenge, your cloud architects will likely choose Amazon Data Firehose.

Cloud 214

Cloud Lambda AWS Analytics 214

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. AI-enabled chatbots can help service teams triage customer issues more efficiently. So how can organizations ensure data quality, reliability, and freshness for AI-driven answers and insights?

Performance 182

Performance DevOps Innovation Artificial Intelligence 182

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty In the inaugural blog post of this series, we introduced you to the state of our pipelines before Psyberg and the challenges with incremental processing that led us to create the Psyberg framework within Netflix’s Membership and Finance data engineering team.

Processing 226

Processing Data Engineering Efficiency Analytics 226

DZone

JANUARY 18, 2023

This release resulted from several months of hard work where we had to thoroughly review our data model and implement a very resource-efficient permissions calculation mechanism. A few weeks ago, we introduced a new Role-based Access Management (RBAC) feature in the GitGuardian Internal Monitoring platform.

Efficiency 152

Efficiency Engineering Database Monitoring 152

DZone

FEBRUARY 3, 2024

In the changing world of data centers and cloud computing, the desire for efficient, flexible, and scalable networking solutions has resulted in the broad use of Software-Defined Networking (SDN). Traditional networking models have a tightly integrated control plane and data plane within network devices.

Network 169

Network Systems Cloud Software 169

Dynatrace

JANUARY 4, 2024

While this approach can be effective if the model is trained with a large amount of data, even in the best-case scenarios, it amounts to an informed guess, rather than a certainty. But to be successful, data quality is critical. Teams need to ensure the data is accurate and correctly represents real-world scenarios. Consistency.

Government 197

Government Analytics Benchmarking Storage 197

DZone

AUGUST 18, 2023

We all know that data is being generated at an unprecedented rate. You may also know that this has led to an increase in the demand for efficient and secure data storage solutions that won’t break the bank. What Are Edge Data Platforms? These platforms offer several advantages over traditional cloud computing.

IoT 130

IoT Media Latency Storage 130

Dynatrace

NOVEMBER 6, 2023

Azure observability and Azure data analytics are critical requirements amid the deluge of data in Azure cloud computing environments. As digital transformation accelerates and more organizations are migrating workloads to Azure and other cloud environments, they need observability and data analytics capabilities that can keep pace.

Azure 176

Azure Analytics Artificial Intelligence Innovation 176

DZone

AUGUST 10, 2023

Many modern applications have a batch processing aspect to them and regularly run high-volume, repetitive data jobs. Here are the four tactics for cost-efficient and resilient batch processing:

Efficiency 130

Efficiency Processing Cloud Technology 130

Dynatrace

SEPTEMBER 5, 2023

Predictive AI uses machine learning, data analysis, statistical models, and AI methods to predict anomalies, identify patterns, and create forecasts. Through predictive analytics, SREs and DevOps engineers can accurately forecast resource needs based on historical data. Proactive resource allocation. Capacity planning.

Artificial Intelligence 260

Artificial Intelligence DevOps Analytics Engineering 260

Dynatrace

NOVEMBER 6, 2023

Recently, the Parliament of India released the Digital Personal Data Protection Act 2023 , which regulates the processing of digital personal data in India and recognizes the right of individuals to protect their data in India. Dynatrace is already supported in 17 local regions on three hyperscalers (AWS, Azure, and GCP).

AWS 235

AWS Azure Tuning Analytics 235

DZone

JANUARY 26, 2024

In the ever-changing realm of modern business practices, ensuring the successful execution of batch jobs is vital for activities like data processing, system upkeep, and the general workflow of the organization. A groundbreaking approach, as outlined in innovation – Patent US1036596B1 , has been introduced to address this challenge.

Systems 169

Systems Efficiency Innovation Processing 169

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. In our experience, optimizing for operational efficiency requires answering one key question: for which tables does the maintenance cost supersede utility?

Efficiency 103

Efficiency Engineering Design Storage 103

Scalegrid

JANUARY 19, 2024

When a MongoDB rollback happens, it can cause trouble to your data integrity and system consistency. Understanding how to address a rollback is critical for minimizing potential data loss and maintaining seamless operations. The consequences of rollbacks are significant and should not be underestimated.

Database 130

Database Network Servers Monitoring 130

DZone

MARCH 7, 2023

Apache Spark is a powerful open-source distributed computing framework that provides a variety of APIs to support big data processing. Broadcast variables can be used to efficiently distribute large read-only data structures, such as lookup tables, to worker nodes.

Big Data 161

Big Data Code Tuning Open Source 161

Dynatrace

SEPTEMBER 23, 2022

But IT teams need to embrace IT automation and new data storage models to benefit from modern clouds. As they enlist cloud models, organizations now confront increasing complexity and a data explosion. Data explosion hinders better data insight.

Cloud 174

Cloud Artificial Intelligence Innovation Analytics 174

High Scalability

JUNE 18, 2018

This is a guest post by Srushtika Neelakantam , Developer Advovate for Ably Realtime, a realtime data delivery platform. You can view the original article—H ow to implement consistent hashing efficiently —on Ably's blog. At the end, we’ll also have a look at a working example for the same. Hashing revisited.

Efficiency 172

Efficiency Programming Strategy Scalability 172

DZone

DECEMBER 27, 2023

Welcome to the first post in our exciting series on mastering offline data pipeline's best practices, focusing on the potent combination of Apache Airflow and data processing engines like Hive and Spark. Working together, they form the backbone of many modern data engineering solutions.

Best Practices 130

Best Practices Data Engineering Big Data Games 130

Dynatrace

SEPTEMBER 23, 2022

But IT teams need to embrace IT automation and new data storage models to benefit from modern clouds. As they enlist cloud models, organizations now confront increasing complexity and a data explosion. Data explosion hinders better data insight.

Cloud 147

Cloud Artificial Intelligence Innovation Analytics 147

Dynatrace

OCTOBER 14, 2022

Log data provides a unique source of truth for debugging applications, optimizing infrastructure, and investigating security incidents. This contextualization of log data enables AI-powered problem detection and root cause analysis at scale. Dynamic landscape and data handling requirements result in manual work.

Storage 223

Storage Government Network Infrastructure 223