Dynatrace

NOVEMBER 28, 2023

In the previous installment of this blog series , we explored how to set up Dynatrace as a build-stage orchestrator to effectively address the challenges faced by Site Reliability Engineers (SREs). The framework outlined above provides a comprehensive view of the deployment process and facilitates comparisons across different releases.

Traffic 262

Traffic Best Practices Strategy Engineering 262

Dynatrace

OCTOBER 4, 2022

This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This decoupling ensures the openness of data and storage formats, while also preserving data in context. Ingest and process with Grail. Retain data.

Artificial Intelligence 268

Artificial Intelligence Analytics Storage Architecture 268

Dynatrace

DECEMBER 5, 2023

Streamline privacy requirements with flexible retention periods Data retention is a critical aspect of data handling, and it’s not just about privacy compliance—it’s about having the flexibility to optimize data storage times in Grail for your Dynatrace use cases. Grail buckets function like folders in a file system.

Storage 167

Storage Healthcare Best Practices Speed 167

Dynatrace

OCTOBER 17, 2023

As a result, IT organizations are overwhelmed as they strive to balance cost control processes with ensuring that their respective organizations have access to all the data required for their various use cases. All data is readily accessible without storage tiers, such as costly solid-state drives (SSDs). Ingest and process.

Retail 237

Retail Storage Best Practices Architecture 237

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. AWS offers four serverless offerings for storage.

Serverless 281

Serverless AWS Lambda Storage 281

Dynatrace

MAY 23, 2024

For more details, see the blog post, Set up AI-powered observability for your Microsoft Azure cloud resources in just one click. For more details, please see the blog post Dynatrace and Microsoft Azure integrate to help accelerate your cloud transformation. The following figure shows the benefits of Azure Native Dynatrace Service.

Azure 225

Azure Cloud Metrics Innovation 225

Dynatrace

OCTOBER 6, 2023

Custom data buckets for faster queries, increased control, and custom retention periods The first layer in the Grail data model consists of buckets and tables (and views for entities, which is outside this blog post’s scope). Buckets are similar to folders, a physical storage location. There is a default bucket for each table.

Artificial Intelligence 262

Artificial Intelligence Analytics Metrics Storage 262

Dynatrace

NOVEMBER 20, 2023

Effectively automating IT processes is key to addressing the challenges of  complex cloud environments. Relying on manual processes results in outages, increased costs, and frustrated customers. These three types of AI used together enable more effective IT automation than a single form of AI on its own. What is causal AI?

AWS 209

AWS Artificial Intelligence Analytics Cloud 209

Dynatrace

OCTOBER 4, 2022

Teams have introduced workarounds to reduce storage costs. Additionally, efforts such as lowered data retention times, two-tiered storage systems, shaky index management, sampled data, and data pipelines reduce the overall amount of stored data. Stop worrying about log data ingest and storage — start creating value instead.

Analytics 235

Analytics Artificial Intelligence Storage Serverless 235

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. Cold storage and rehydration. Cold storage and rehydration. Data that organizations may need to access only once a quarter or year can reside in cold storage.

Analytics 215

Analytics Storage Retail Monitoring 215

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. In spite of reaching higher qualities than the fixed ladder, the HDR-DO ladder, on average, occupies only 58% of the storage space compared to fixed-bitrate ladder.

Open Source 252

Open Source Software Engineering Internet Internet 252

Uber Engineering

MARCH 12, 2017

With the evolution of storage formats like Apache Parquet and Apache ORC and query engines like Presto and Apache Impala , the Hadoop ecosystem has the potential to become a general-purpose, unified serving layer for workloads that can tolerate latencies … The post Hudi: Uber Engineering’s Incremental Processing Framework on Apache Hadoop appeared (..)

Processing 100

Processing Latency Storage Engineering 100

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. Cold storage and rehydration. Cold storage and rehydration. Data that organizations may need to access only once a quarter or year can reside in cold storage.

Analytics 182

Analytics Storage Retail Monitoring 182

Dynatrace

APRIL 8, 2024

This blog explores how vertically integrated risk management solutions that use AI and automation enable unparalleled visibility, control, and efficiency for risk management in banking. Optimize the IT infrastructure supporting risk management processes and controls for maximum performance and resilience.

Analytics 201

Analytics Infrastructure Efficiency Technology 201

The Netflix TechBlog

OCTOBER 19, 2020

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

FEBRUARY 2, 2022

This means you no longer have to procure new hardware, which can be a time-consuming and expensive process. No operational duties: Dynatrace operates the product for you with auto-discovery of your entire stack, end-to-end, including processes running inside containers.

Azure 321

Azure Availability Hardware Innovation 321

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. Log analytics, on the other hand, is the process of using the gathered logs to extract business or operational insight. Dynatrace news.

Systems 186

Systems Cloud Analytics DevOps 186

Dynatrace

FEBRUARY 10, 2023

From data lakehouse to an analytics platform Traditionally, to gain true business insight, organizations had to make tradeoffs between accessing quality, real-time data and factors such as data storage costs. IT pros need a data and analytics platform that doesn’t require sacrifices among speed, scale, and cost. What is a data lakehouse?

Efficiency 276

Efficiency Performance Analytics DevOps 276

Dynatrace

JANUARY 23, 2024

The following resources provide more information on how to get the most out of your AI investment, the importance of data quality for business success, and automating manual IT processes to prioritize innovation. Teams face siloed processes and toolsets, vast volumes of data, and redundant manual tasks. What is explainable AI?

Performance 186

Performance DevOps Innovation Artificial Intelligence 186

Scalegrid

JULY 17, 2020

JSON is faster to ingest vs. JSONB – however, if you do any further processing, JSONB will be faster. For the purposes of this blog, when we refer to JSON support in PostgreSQL, we will refer to JSONB going forward. A more detailed example of this is provided in this blog post – When To Avoid JSONB In A PostgreSQL Schema.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

SEPTEMBER 23, 2020

This blog post highlights a group of improvements that were released with OneAgent version 1.199. Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Storage and network transfer of files is a measurable cost. Customizable location of large runtime files.

Storage 148

Storage Latency Operating System Network 148

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Dynatrace

NOVEMBER 11, 2020

Readers of this blog surely appreciate the earlier enhancements we announced related to enterprise-scale life-cycle management of OneAgents via REST API , easier configurability of OneAgent settings , and the recent improvements to OneAgent security. Easier rollout thanks to log storage best practices.

Best Practices 197

Best Practices Storage Java Benchmarking 197

Scalegrid

NOVEMBER 29, 2023

This blog post will explore some of the major challenges in database management that businesses can expect, especially when transitioning from traditional database servers. A DBaaS automates several processes, such as using, erasing, and spinning up storage without interventions from IT staff. Your data will always be intact.

Healthcare 130

Healthcare Hardware Database Scalability 130

Dynatrace

AUGUST 26, 2020

In this blog post, I’d like to share with you three major improvements that we’ve implemented recently that enable you to achieve more at no additional cost, helping you to gain new insights with higher fidelity PurePaths, monitor more entities, and automate more. Optimal metric storage management strategy.

Performance 150

Performance Hardware Java Storage 150

Percona

OCTOBER 13, 2023

When MySQL generates a core file, the VS code simplifies the process of debugging. This blog will discuss how to debug the core file in VS code. Once the debug process starts, we can find the debug toolbar at the top center and threading information on the CALL STACK view. storage/innobase/./././mysql-8.0.34/storage/innobase/row/row0sel.cc':

Code 96

Code C++ Storage Programming 96

Uber Engineering

JANUARY 16, 2023

Uber’s Storage Platform team talks about the massive strategic undertaking to migrate their Distributed Databases from MySQL to MyRocks resulting in significant Storage usage reduction. The blog details the migration process and challenges faced.

Storage 84

Storage Database Processing 84

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. In this blog, we will discuss both data and network-level compression offered in MongoDB.

Storage 103

Storage Network Open Source Latency 103

Dynatrace

DECEMBER 18, 2023

This covers the infrastructure, processes, and the application stack, including tracing, profiling, and logs. But often, we use additional services and solutions within our environment for backups, storage, networking, and more. Our goal was to filter for metrics that deliver the data we need while minimizing storage costs.

Metrics 178

Metrics Engineering Energy Tuning 178

The Netflix TechBlog

MAY 4, 2023

This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal. This blog post will provide a detailed analysis of replay traffic testing, a versatile technique we have applied in the preliminary validation phase for multiple migration initiatives.

Traffic 339

Traffic Latency Tuning Systems 339

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. In this blog post, we will explore the realm of backups and conduct a comparative analysis of three backup types: Full, incremental, and differential backups. Looking for a MongoDB backup solution? What is an incremental backup?

Storage 66

Storage Strategy Network Efficiency 66

Percona

FEBRUARY 24, 2023

Usage reduction is a continuous process. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2. Figure 2: Amazon Elastic Block Storage Running relational or NoSQL databases is one of the use cases where EBS is recommended for.

Cloud 114

Cloud Serverless AWS Storage 114

The Netflix TechBlog

OCTOBER 28, 2021

Over the years, I followed the big data open-source community and Netflix tech blogs closely, and learned a lot about Netflix’s innovative engineering solutions and active contributions to the open-source ecosystem. CL provides an end-to-end solution for logging, processing, and analyzing user interactions on Netflix apps from all devices.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

The Netflix TechBlog

OCTOBER 15, 2019

Another thread or process is constantly polling events from the log table and writes them to one or multiple datastores, optionally removing events from the log table after acknowledged by all datastores. Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3].

Transportation 192

Transportation Architecture Processing Storage 192

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 123

Performance Hardware Tuning Storage 123

Percona

NOVEMBER 1, 2023

This blog was originally published in January 2021 and updated in November of 2023. In this blog, we will review all of the potential MySQL backup and restore strategies, the cornerstones of any application. Encryption Backups have sensitive data, so it’s highly recommended to encrypt, especially for offsite storage.

Best Practices 77

Best Practices Storage Strategy Database 77

Dynatrace

JUNE 16, 2020

Dynatrace OneAgent has been able to detect TIBCO EMS processes out-of-the-box for some time already. Synchronous storage size. Async storage size. Storage read size rate. Storage read count rate. Storage write size rate. Storage write count rate. Pending messages size. Memory usage. Memory pooled.

Storage 133

Storage Metrics Java Architecture 133