Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

OCTOBER 17, 2023

Dynatrace has developed the purpose-built data lakehouse, Grail , eliminating the need for separate management of indexes and storage. All data is readily accessible without storage tiers, such as costly solid-state drives (SSDs). No storage tiers, no archiving or retrieval from archives, and no indexing or reindexing.

Retail 245

Retail Storage Best Practices Architecture 245

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). Grail is built for such analytics, not storage.

Artificial Intelligence 275

Artificial Intelligence Analytics Storage Architecture 275

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Reliability.

Serverless 289

Serverless AWS Lambda Storage 289

Dynatrace

OCTOBER 6, 2023

Grail: Enterprise-ready data lakehouse Grail, the Dynatrace causational data lakehouse, was explicitly designed for observability and security data, with artificial intelligence integrated into its foundation. Buckets are similar to folders, a physical storage location. There is a default bucket for each table.

Artificial Intelligence 268

Artificial Intelligence Analytics Metrics Storage 268

Dynatrace

JANUARY 23, 2024

AI-enabled chatbots can help service teams triage customer issues more efficiently. Deriving business value with AI, IT automation, and data reliability When it comes to increasing business efficiency, boosting productivity, and speeding innovation, artificial intelligence takes center stage. What is explainable AI? Enter causal AI.

Performance 195

Performance DevOps Innovation Artificial Intelligence 195

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. This separation aims to streamline transaction write logging, improving efficiency and consistency. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 97

AWS Benchmarking Performance Traffic 97

Scalegrid

NOVEMBER 29, 2023

As CTOs, database developers & experts, and DBAs seek more efficient, secure, and scalable cloud services solutions, DBaaS emerges as a compelling choice. This blog post will explore some of the major challenges in database management that businesses can expect, especially when transitioning from traditional database servers.

Healthcare 130

Healthcare Hardware Database Scalability 130

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. In this blog post, we will delve into the world of PostgreSQL performance tuning and establish some basic guidelines for setting database parameters to enhance the performance of your PostgreSQL database, based on the workload.

Tuning 52

Tuning Efficiency Database Performance 52

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. Bitrate versus quality comparison HDR-VMAF is designed to be format-agnostic — it measures the perceptual quality of HDR video signal regardless of its container format, for example, Dolby Vision or HDR10. The graphic below (Fig.

Open Source 252

Open Source Software Engineering Internet Internet 252

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 256

AWS Efficiency Azure Cloud 256

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. The motivation has not changed since then; the design has. Design evolution Axion fact store has four components?—?fact

Storage 187

Storage Design Scalability Latency 187

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. In this blog, we will discuss both data and network-level compression offered in MongoDB.

Storage 108

Storage Network Open Source Latency 108

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Dynatrace

SEPTEMBER 8, 2023

In part 1 of this blog series , we explored the concept of business observability, its significance, and how real-time visibility aids in making informed decisions. To achieve this, we’ll create a Grail bucket specifically designed to retain data for a duration of 10 years (3,657 days).

Database 277

Database Artificial Intelligence Metrics Monitoring 277

Dynatrace

MAY 26, 2021

This blog dives into what we learned by listening to experts in the field and the key takeaways we gathered from the talks. Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. OTel is designed to ensure flexibility and stability. We second that.

AWS 221

AWS Strategy Storage Metrics 221

Scalegrid

JANUARY 25, 2024

This blog post lists the important database metrics to monitor. Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. These essential data points heavily influence both stability and efficiency within the system.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. For example: Read/Write tickets WiredTiger uses tickets to control the number of read / write operations simultaneously processed by the storage engine. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. The efficiency achieved in processing and storage layers brought us big savings on computing and storage costs.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Note that most of the changes we’ve introduced so far and those that are detailed below are all designed to be invisible to you, taking place entirely automatically in the background.

Best Practices 206

Best Practices Storage Java Benchmarking 206

Percona

AUGUST 9, 2023

MySQL 8 brought a significant architectural transformation by replacing the traditional MyISAM-based system tables with the Transaction Data Dictionary (TDD), a more efficient and reliable approach. This information is stored in transactional storage, ensuring atomicity for schema changes.

Database 78

Database Storage Scalability Games 78

Scalegrid

JULY 17, 2020

JSONB supports indexing the JSON data, and is very efficient at parsing and querying the JSON data. For the purposes of this blog, when we refer to JSON support in PostgreSQL, we will refer to JSONB going forward. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns.

Storage 321

Storage Database Efficiency Processing 321

The Netflix TechBlog

OCTOBER 19, 2020

In our previous blog post we introduced Edgar, our troubleshooting tool for streaming sessions. Now let’s look at how we designed the tracing infrastructure that powers Edgar. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. This blog post will delve into the techniques leveraged at Netflix to introduce these changes to production.

Traffic 279

Traffic Metrics Systems Strategy 279

Dynatrace

MAY 26, 2021

This blog dives into what we learned by listening to experts in the field and the key takeaways we gathered from the talks. Trace-based sampling can help you save storage costs. This can help you save money in storage costs in the long run. OTel is designed to ensure flexibility and stability. We second that.

AWS 147

AWS Strategy Storage Metrics 147

ACM Sigarch

AUGUST 3, 2023

(Editor’s Note: This post was submitted as a rebuttal to Andrew Chien’s July 24 SIGARCH Blog Post ) The recent post “ Why Embodied Carbon is a poor Architecture Design metric, and Operational Carbon remains an important Problem ” by Prof. Unlike Prof. Chien’s argument: It costs only $1.4B Therefore, the $1.4B

Energy 98

Energy Architecture Hardware Metrics 98

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. In this blog, we will be focusing on how we utilize Elasticsearch for indexing and search the assets. Amsterdam is built on top of three storage layers. This is the layer we’d like to focus on in this blog. The first layer, Cassandra , is the source of truth for us.

Strategy 258

Strategy Cache Analytics Storage 258

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. The post Dynatrace adds support for VPC Flow Logs to Kinesis Data Firehose appeared first on Dynatrace blog. What is Amazon VPC Flow Logs to Kinesis Data Firehose, and why is it important?

Traffic 224

Traffic AWS Network Cloud 224

Percona

FEBRUARY 24, 2023

Making the use of resources efficiently and ensuring that this does not impact the budget available for cloud computing is not a one-time fix but a continuous cycle of picking properly sized resources and eliminating over-provisioning. Check this blog post for more information on how to use pglogical for upgrading your database instances.

Cloud 119

Cloud Serverless AWS Storage 119

Percona

AUGUST 29, 2023

In this blog post, we will explore the immense value of provisioning PostgreSQL clusters with Percona Operator by using bootstrap capabilities: Start the cluster with init SQL script Bootstrap the cluster from the existing cluster or backup Getting started You need to have the Percona Operator for PostgreSQL deployed.

Storage 94

Storage Database Media Open Source 94

Percona

JANUARY 19, 2023

16 years ago, our founder Peter Zaitsev covered this topic and some of the points described there are still valid, and we will cover more on this blog. In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. It can help us to save costs on storage and backup times.

Open Source 88

Open Source Storage Database Big Data 88

Dynatrace

SEPTEMBER 30, 2021

Not only will they get much more out of the tools they use daily, but they’ll also be able to deliver superior functionality, efficiency, and performance to your customers. In addition, 45% of them have gone on to implement efficiencies in their roles, and 43% reported they were able to do their job more quickly after getting certified.

AWS 218

AWS Best Practices Analytics Cloud 218

Percona

SEPTEMBER 25, 2023

pgBackRest is a highly efficient and versatile tool for managing PostgreSQL backups. In this blog post, we’ll explore a technique to help your backup strategy: running pgBackRest’s expire and backup processes in parallel while utilizing custom lock-file paths. Download Percona Distribution for PostgreSQL Today!

Database 94

Database Open Source Storage Servers 94

The Netflix TechBlog

JUNE 25, 2021

In this blog post, we are thrilled to share that we are open-sourcing one such tool: the Netflix Data Explorer. Browsing your accessible clusters in different environments and regions Schema Designer Writing CREATE TABLE statements can be an intimidating experience for new Cassandra users.

Metrics 152

Metrics Best Practices Strategy Design 152

The Netflix TechBlog

NOVEMBER 2, 2021

For example, when we design a new version of VMAF, we need to effectively roll it out throughout the entire Netflix catalog of movies and TV shows. This article explains how we designed microservices and workflows on top of the Cosmos platform to bolster such video quality innovations. We call this system Cosmos.

Media 171

Media Innovation Metrics Latency 171

Percona

SEPTEMBER 27, 2023

Vacuum efficiency will improve as data resides in smaller partitions, reducing the time required for table maintenance compared to dealing with large sets of data. I will provide a more detailed usage of pg_partman in upcoming blog posts. Query Performance will improve when dealing with partitioned data specifically.

Storage 100

Storage Open Source Database Efficiency 100