DZone

JANUARY 26, 2024

Building a strong messaging system is critical in the world of distributed systems for seamless communication between multiple components. A messaging system serves as a backbone, allowing information transmission between different services or modules in a distributed architecture.

Scalability 258

Scalability Design Systems Architecture 258

DZone

FEBRUARY 5, 2024

In today's cloud computing world, all types of logging data are extremely valuable. Logs can include a wide variety of data, including system events, transaction data, user activities, web browser logs, errors, and performance metrics. This innovative service is transforming the way organizations handle their log data.

Analytics 269

Analytics Innovation Strategy Efficiency 269

Dynatrace

MAY 2, 2024

Across the globe, privacy laws grant individuals data subject rights, such as the right to access and delete personal data processed about them. Successful compliance with privacy rights requests involves tracking and verifying requests across the entire data ecosystem, including third-party services.

Tuning 132

Tuning Scalability Efficiency Processing 132

DZone

FEBRUARY 27, 2024

Caching is a critical technique for optimizing application performance by temporarily storing frequently accessed data, allowing for faster retrieval during subsequent requests. Multi-layered caching involves using multiple levels of cache to store and retrieve data.

Cache 161

Cache Efficiency Architecture Design 161

Dynatrace

OCTOBER 10, 2023

EdgeConnect provides a secure bridge for SaaS-heavy companies like Dynatrace, which hosts numerous systems and data behind VPNs. EdgeConnect facilitates seamless interaction, ensuring data security and operational efficiency. Figure 2: Editing the host pattern of an existing EdgeConnect configuration.

Systems 225

Systems Efficiency Internet Internet 225

The Netflix TechBlog

DECEMBER 14, 2023

Engineers from across the company came together to share best practices on everything from Data Processing Patterns to Building Reliable Data Pipelines. The result was a series of talks which we are now sharing with the rest of the Data Engineering community!

Data Engineering 259

Data Engineering Engineering Software Engineering Best Practices 259

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. They now use modern observability to monitor expanding cloud environments in order to operate more efficiently, innovate faster and more securely, and to deliver consistently better business results. We’ll post news here as it happens!

Efficiency 281

Efficiency Performance Analytics DevOps 281

Dynatrace

OCTOBER 23, 2023

Hyper-V plays a vital role in ensuring the reliable operations of data centers that are based on Microsoft platforms. Microsoft Hyper-V is a virtualization platform that manages virtual machines (VMs) on Windows-based systems. This leads to a more efficient and streamlined experience for users.

Efficiency 219

Efficiency Virtualization Hardware Performance 219

The Netflix TechBlog

NOVEMBER 14, 2023

By Abhinaya Shetty , Bharath Mummadisetty At Netflix, our Membership and Finance Data Engineering team harnesses diverse data related to plans, pricing, membership life cycle, and revenue to fuel analytics, power various dashboards, and make data-informed decisions. We expect complete and accurate data at the end of each run.

Data Engineering 264

Data Engineering Engineering Processing Games 264

The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. the retry success probability) and compute cost efficiency (i.e., Multi-objective optimizations.

Tuning 210

Tuning Efficiency Big Data Engineering 210

DZone

AUGUST 23, 2023

Monitoring Time-Series IoT Device Data Time-series data is crucial for IoT device monitoring and data visualization in industries such as agriculture, renewable energy, and meteorology. In this tutorial, we will guide you through the process of setting up a monitoring system for IoT device data.

IoT 241

IoT Energy Open Source Analytics 241

DZone

APRIL 11, 2023

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. This article will explore how these technologies can be used together to create an optimized data pipeline for data processing in the cloud.

Azure 246

Azure Analytics Storage Cloud 246

DZone

NOVEMBER 7, 2023

In the labyrinth of data-driven architectures, the challenge of data integration—fusing data from disparate sources into a coherent, usable form — stands as one of the cornerstones. As businesses amass data at an unprecedented pace, the question of how to integrate this data effectively comes to the fore.

Processing 177

Processing Architecture Technology Technology 177

DZone

JUNE 7, 2023

ERP systems are crucial in modern software development because they integrate various organizational departments and functions. They provide a centralized platform that promotes seamless communication and data exchange between software applications, reducing data silos.

Systems 169

Systems Software Software Development 169

Dynatrace

JANUARY 4, 2024

Traditional analytics and AI systems rely on statistical models to correlate events with possible causes. While this approach can be effective if the model is trained with a large amount of data, even in the best-case scenarios, it amounts to an informed guess, rather than a certainty. But to be successful, data quality is critical.

Government 205

Government Analytics Benchmarking Storage 205

Dynatrace

SEPTEMBER 5, 2023

Technology and operations teams work to ensure that applications and digital systems work seamlessly and securely. Predictive AI uses statistical algorithms and other advanced machine learning techniques to anticipate what might happen next in a system. What is predictive AI? Proactive resource allocation. Capacity planning.

Artificial Intelligence 266

Artificial Intelligence DevOps Analytics Engineering 266

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. AI-enabled chatbots can help service teams triage customer issues more efficiently. So how can organizations ensure data quality, reliability, and freshness for AI-driven answers and insights?

Performance 191

Performance DevOps Innovation Artificial Intelligence 191

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. In cloud-native environments, there can also be dozens of additional services and functions all generating data from user-driven events.

Systems 189

Systems Cloud Analytics DevOps 189

Scalegrid

JANUARY 19, 2024

When a MongoDB rollback happens, it can cause trouble to your data integrity and system consistency. Understanding how to address a rollback is critical for minimizing potential data loss and maintaining seamless operations. The consequences of rollbacks are significant and should not be underestimated.

Database 130

Database Network Servers Monitoring 130

The Netflix TechBlog

SEPTEMBER 29, 2022

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support for Non-Parallelizable Workloads by Kostas Christidis Introduction Timestone is a high-throughput, low-latency priority queueing system we built in-house to support the needs of Cosmos , our media encoding platform. Over the past 2.5

Latency 212

Latency Systems Media Serverless 212

Dynatrace

APRIL 13, 2023

The massive volumes of log data associated with a breach have made cybersecurity forensics a complicated, costly problem to solve. As organizations adopt more cloud-native technologies, observability data—telemetry from applications and infrastructure, including logs, metrics, and traces—and security data are converging.

Analytics 190

Analytics Java Infrastructure Cloud 190

Uber Engineering

JANUARY 16, 2023

Our Data Workflow Platform team introduces WorkflowGuard: a new service to govern executions, prioritize resources, and manage life cycle for repetitive data jobs. Check out how it improved workflow reliability and cost efficiency while bringing more observability to users.

Government 98

Government Systems Efficiency 98

High Scalability

JUNE 18, 2018

This is a guest post by Srushtika Neelakantam , Developer Advovate for Ably Realtime, a realtime data delivery platform. You can view the original article—H ow to implement consistent hashing efficiently —on Ably's blog. At the end, we’ll also have a look at a working example for the same. Hashing revisited.

Efficiency 172

Efficiency Programming Strategy Scalability 172

Dynatrace

APRIL 18, 2024

Rather, they must be bolstered by additional technological investments to ensure reliability, security, and efficiency. Observability of applications and infrastructure serves as a critical foundation for DevOps and platform engineering, offering a comprehensive view into system performance and behavior.

DevOps 184

DevOps Engineering Artificial Intelligence Infrastructure 184

Dynatrace

OCTOBER 14, 2022

Log data provides a unique source of truth for debugging applications, optimizing infrastructure, and investigating security incidents. This contextualization of log data enables AI-powered problem detection and root cause analysis at scale. Dynamic landscape and data handling requirements result in manual work.

Storage 232

Storage Government Network Infrastructure 232

The Netflix TechBlog

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer on the Product Data Science and Engineering team.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Dynatrace

APRIL 8, 2024

This blog explores how vertically integrated risk management solutions that use AI and automation enable unparalleled visibility, control, and efficiency for risk management in banking. If system failures occur, teams must resolve them quickly and resolutely. Risk in banking is broad and interconnected.

Analytics 206

Analytics Infrastructure Efficiency Technology 206

The Morning Paper

SEPTEMBER 15, 2019

Fine-grained, secure and efficient data provenance on blockchain systems Ruan et al., That’s hard to do in today’s blockchain systems for two reasons: Provenance can only be determined by querying and replaying all on-chain transactions, which is inefficient and an offline activity. VLDB’19.

Blockchain 55

Blockchain Efficiency Systems Storage 55

High Scalability

JUNE 15, 2020

This is a guest post by Eunice Do , Data Engineer at TripleLift , a technology company leading the next generation of programmatic advertising. What is the name of your system and where can we find out more about it? The system is the data pipeline at TripleLift. Why did you decide to build this system?

Processing 206

Processing Data Engineering Engineering Efficiency 206

Dynatrace

DECEMBER 21, 2023

Business processes are important because they improve the efficiency, consistency, and quality of the business outcome. Business process monitoring helps organizations: Increase efficiency by identifying and addressing bottlenecks or inefficiencies that may slow down a business process. Reduce costs.

Processing 218

Processing Monitoring Retail Analytics 218

DZone

FEBRUARY 2, 2024

In the rapidly evolving landscape of the Internet of Things (IoT), edge computing has emerged as a critical paradigm to process data closer to the source—IoT devices. This proximity to data generation reduces latency, conserves bandwidth and enables real-time decision-making.

IoT 195

IoT Artificial Intelligence Latency Internet 195

Dynatrace

DECEMBER 13, 2023

Last year, organizations prioritized efficiency and cost reduction while facing soaring inflation. Data indicates these technology trends have taken hold. 2: AI-generated code will create the need for digital immune systems. 4: Data observability will become mandatory. Technology prediction No. Technology prediction No.

Technology 208

Technology Technology Artificial Intelligence Analytics 208

DZone

FEBRUARY 12, 2024

Optimizing complex MySQL queries is crucial when dealing with large datasets, such as fetching data from a database containing one million records or more. Poorly optimized queries can lead to slow response times and increased load on the database server, negatively impacting user experience and system performance.

Performance 161

Performance Database Strategy Efficiency 161

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Using AI for Enhanced Cloud Operations The integration of AI in cloud computing is enhancing operational efficiency in several ways.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

MARCH 5, 2019

As a micro-service owner, a Netflix engineer is responsible for its innovation as well as its operation, which includes making sure the service is reliable, secure, efficient and performant. In the Reliability space, our data teams focus on two main approaches. Canaries ), detection and improved KPIs.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

DZone

MARCH 14, 2023

Site Reliability Engineering (SRE) is a systematic and data-driven approach to improving the reliability, scalability, and efficiency of systems. It combines principles of software engineering, operations, and quality assurance to ensure that systems meet performance goals and business objectives.

Engineering 246

Engineering Software Engineering Scalability Efficiency 246

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 252

AWS Efficiency Azure Cloud 252