DZone

MAY 5, 2023

This blog post explores the benefits of combining both open-source frameworks, shows unique differentiators of Flink versus Kafka, and discusses when to use a Kafka-native streaming engine like Kafka Streams instead of Flink. The Tremendous Adoption of Apache Kafka and Apache Flink Apache Kafka became the de facto standard for data streaming.

Open Source 246

Open Source Storage Innovation Engineering 246

The Netflix TechBlog

APRIL 27, 2023

Atlas is an in-memory time-series database that ingests multiple billions of time-series per day and retains the last two weeks of data. To serve the increasing number of push down queries, the in-memory storage layer would need to scale up as well, and it became clear that this would push the already expensive storage costs far higher.

Storage 288

Storage Cache Metrics Database 288

Dynatrace

APRIL 19, 2023

In Part 1 of this blog post series , we introduced the concept of security policies in preparation for upcoming enhancements to the Dynatrace platform. ALLOW storage:system:read; The Storage All System Data Read policy grants access to Dynatrace internal data such as auditing events and query execution events. .*”;ALLOW

Storage 214

Storage Analytics Systems Architecture 214

Dynatrace

NOVEMBER 28, 2023

In the previous installment of this blog series , we explored how to set up Dynatrace as a build-stage orchestrator to effectively address the challenges faced by Site Reliability Engineers (SREs). Davis AI can leverage this data to enable predictive analysis. To illustrate this concept, consider the scenario below. What’s next?

Traffic 265

Traffic Best Practices Strategy Engineering 265

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 219

Analytics Storage Retail Monitoring 219

Percona

APRIL 20, 2023

Data-at-rest encryption is essential for compliance with regulations that require the protection of sensitive data. It is also critical for securing sensitive data and avoiding data breaches. PostgreSQL does not natively support Transparent Data Encryption (TDE). apiVersion: storage.k8s.io/v1

Storage 120

Storage AWS Cloud Database 120

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. A vital aspect of such development is subjective testing with HDR encodes in order to generate training data. The pandemic, however, posed unique challenges in conducting a conventional in-lab subjective test with HDR encodes.

Open Source 252

Open Source Software Engineering Internet Internet 252

Percona

MARCH 21, 2023

In this blog, I’ll discuss the use case for replication. We want to improve our ability to replicate your data and limit replication to row-based events securely, wherein we do not have control over the source(s). PRIVILEGE CHECKS USER is helpful in multi-source replication to carefully gather data from various sources.

Storage 86

Storage Open Source Database Engineering 86

Dynatrace

JULY 29, 2022

Log analytics is the process of viewing, interpreting, and querying log data so developers and IT teams can quickly detect and resolve application and system issues. At the same time, log analytics can present challenges as data volumes explode, particularly in traditional environments that lack end-to-end observability solutions.

Analytics 185

Analytics Storage Retail Monitoring 185

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Dynatrace

DECEMBER 18, 2023

This challenge has given rise to the discipline of observability engineering, which concentrates on the details of telemetry data to fine-tune observability use cases. To get a more granular look into telemetry data, many analysts rely on custom metrics using Prometheus.

Metrics 182

Metrics Engineering Energy Tuning 182

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. According to recent Dynatrace data, 59% of CIOs say the increasing complexity of their technology stack could soon overload their teams without a more automated approach to IT operations. Digital transformation shows no signs of slowing down.

Efficiency 280

Efficiency Performance Analytics DevOps 280

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Efficiency 99

Efficiency Engineering Design Storage 99

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. In cloud-native environments, there can also be dozens of additional services and functions all generating data from user-driven events.

Systems 189

Systems Cloud Analytics DevOps 189

Dynatrace

FEBRUARY 2, 2022

Security: Data is stored securely in the Dynatrace cloud (powered by Azure). Dynatrace captures all your data, including host and application metrics, basic-network metrics, real-user metrics, mobile metrics, cloud-infrastructure metrics, log metrics, and much more.

Azure 322

Azure Availability Hardware Innovation 322

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? With the launch of the AWS Storage Gateway our customers can now integrate their on-premises IT environment with AWSâ??s

Storage 115

Storage AWS Virtualization Cloud 115

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. By separating storage and compute, Neon replaces the PostgreSQL storage layer with data nodes, and compute nodes are distributed across a cluster of nodes. Compute nodes are stateless PostgreSQL nodes backed by the Neon storage engine.

Serverless 109

Serverless Storage Open Source Architecture 109

Dynatrace

APRIL 8, 2024

This blog explores how vertically integrated risk management solutions that use AI and automation enable unparalleled visibility, control, and efficiency for risk management in banking. Collect data automatically and pre-processed from a range of sources: application programming interfaces, integrations, agents, and OpenTelemetry.

Analytics 206

Analytics Infrastructure Efficiency Technology 206

Percona

JANUARY 5, 2023

Space constraint has been an endless and painstaking process for many of us, especially in systems that have a high number of transactions and data growth exceeding hundreds of GBs in a matter of days. MySQL won’t shrink tablespace and storage won’t be released to the file system. What is partitioning? 1 mysql mysql 9.0G

Traffic 60

Traffic Engineering Speed Storage 60

The Netflix TechBlog

OCTOBER 19, 2020

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. Stream Processing: to sample or not to sample trace data?

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

All Things Distributed

AUGUST 20, 2012

Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud â??

Storage 122

Storage Cloud AWS Media 122

Percona

MARCH 1, 2023

In this blog post, we will see how running databases on Kubernetes with Percona Operators can reduce your cloud bill when compared to using AWS RDS. We will not consider data transfer or backup costs in this article. year For ten instances, it will be $168,192 per year Default gp2 storage is $0.115 per GB-month, for 200 GB, it is $22.50/month

Cloud 132

Cloud Storage AWS Database 132

Percona

MARCH 13, 2023

There is a section in our Documentation ( Introduction to Serverless PostgreSQL ) and a short overview of the primary components: Page Server The storage server with the primary goal of storing all data pages and WAL records Safe Keeper A component to store WAL records in memory (to reduce latency). 5454 --listen-http=0.0.0.0:7676

Serverless 119

Serverless C++ Storage Latency 119

Scalegrid

NOVEMBER 29, 2023

The rise of Database-as-a-Service (DBaaS) is not just a trend but a strategic response to the growing complexities of data management. Data Center Dynamics highlights a significant uptick in DBaaS adoption, growing from 40% to 45% between 2019 and 2020. Your data will always be intact.

Healthcare 130

Healthcare Hardware Database Scalability 130

Dynatrace

OCTOBER 22, 2021

On the service details page, we have improved how the initial analysis timeframe is selected to make sure it always contains data. Use this function to get keys of user action and user session properties according to the property data type defined in the argument. Analyze log data – Log viewer. for improved resilience.

Metrics 218

Metrics Monitoring Storage Database 218

Percona

JULY 13, 2023

With the rise of globalization, the need to store and process multilingual data has become essential. In this blog post, we will explore utf8mb4 and its advantages in MySQL 8.0, The first two rows contain simple text data, while the third row contains an emoji. version as a game-changer. backed by practical examples.

Database 92

Database Games Open Source Engineering 92

Percona

OCTOBER 13, 2023

A common practice among DBAs and developers is to copy table data and.frm files from the data dictionary. In the case of InnoDB tablespaces, this information is incorporated into the tablespace itself, creating a fusion of metadata and data primarily to enhance performance. In MySQL 8.0, ibd files), general tablespace files (.ibd

Storage 92

Storage Database Engineering Open Source 92

Dynatrace

SEPTEMBER 8, 2023

In part 1 of this blog series , we explored the concept of business observability, its significance, and how real-time visibility aids in making informed decisions. Dynatrace users typically use extensions to pull technical monitoring data, such as device metrics, into Dynatrace. Don’t rename the file. Upload the ZIP file.

Database 274

Database Artificial Intelligence Metrics Monitoring 274

Dynatrace

JULY 29, 2021

The complexity of such deployments has accelerated with the adoption of emerging, open-source technologies that generate telemetry data, which is exploding in terms of volume, speed, and cardinality. All this data is then consumed by Dynatrace Davis® AI for more precise answers, thereby driving AIOps for cloud-native environments.

Analytics 246

Analytics Open Source Serverless Architecture 246

The Netflix TechBlog

MAY 4, 2023

This blog series will examine the tools, techniques, and strategies we have utilized to achieve this goal. It can happen on an edge API system servicing customer devices, between the edge and mid-tier services, or from mid-tiers to data stores.

Traffic 339

Traffic Latency Tuning Systems 339

Dynatrace

AUGUST 26, 2020

“ Dynatrace just makes observability easy—it works out-of-the-box, no silos of data, no DIY stitching together tools, no wasted time, and no wasted resources.” Optimal metric storage management strategy. Dynatrace Managed metric storage management is reliable and delivers high performance. Dynatrace news.

Performance 150

Performance Hardware Java Storage 150

Percona

MAY 29, 2023

With the ever-increasing reliance on data, system outages or data loss can be catastrophic, causing significant business disruptions and financial losses. pgBackrest on the Main site streams backups and Write Ahead Logs (WALs) to the object storage. Disaster recovery is not optional for businesses operating in the digital age.

Storage 120

Storage Cloud Network Traffic 120

Dynatrace

SEPTEMBER 29, 2021

It offers a flexible multidimensional data model that’s based on key-value pairs and a potent query language (PromQL). Prometheus components include client libraries for application code instrumentation, special-purpose exporters for popular services, and the optional Prometheus server for orchestrating service discovery and data storage.

Technology 215

Technology Technology Monitoring AWS 215

Scalegrid

JANUARY 20, 2020

Unlike cloning or replication, this allows you to maintain an active, point-in-time copy of your production data. In this blog post, we will cover the top three scenarios to leverage follower clusters for your application. In this blog post, we will cover the top three scenarios to leverage follower clusters for your application.

Analytics 185

Analytics Storage Database Systems 185

Percona

NOVEMBER 20, 2023

First, it prepares the database and ensures the data files can be safely copied. Then, it copies files to the storage. Something similar happens with the restore: prepare the cluster, copy files, and prepare data so the cluster can start in a consistent state. Giving the user full control over the data copy.

Storage 83

Storage Database Strategy Speed 83