The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper describes the design decisions behind the Snowflake cloud-based data warehouse. have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. All rely heavily on utilizing allocated portions from existing pools made available through specific providers as part of their service offerings.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). Thus, it can scale massively.

Artificial Intelligence 272

Artificial Intelligence Analytics Storage Architecture 272

Dynatrace

JANUARY 31, 2024

Designed to reach beyond petabyte (PB) scale, OpenPipeline will—at its launch— quintuple the ingest throughput from 100 TB a day per tenant to 500 TB a day per tenant. OpenPipeline high-performance filtering and preprocessing provides full ingest and storage control for the Dynatrace platform. Commitment to privacy.

Analytics 198

Analytics Processing Transportation Storage 198

Percona

FEBRUARY 1, 2023

This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability. Therefore, TOAST is a storage technique used in PostgreSQL to handle large data objects such as images, videos, and audio files.

Storage 87

Storage Scalability Strategy Performance 87

Scalegrid

MARCH 8, 2024

Executing PITR requires restoring from the full backup and then applying binary log events in sequence up to the desired point in time, with advanced techniques and third-party tools available to optimize large dataset handling and automate the recovery process. Use the ‘–log-bin’ option to designate a base name for the binary log files.

Database 162

Database Strategy Servers Best Practices 162

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Reliability.

Serverless 286

Serverless AWS Lambda Storage 286

Dynatrace

OCTOBER 6, 2023

Grail: Enterprise-ready data lakehouse Grail, the Dynatrace causational data lakehouse, was explicitly designed for observability and security data, with artificial intelligence integrated into its foundation. Buckets are similar to folders, a physical storage location. There is a default bucket for each table.

Artificial Intelligence 266

Artificial Intelligence Analytics Metrics Storage 266

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 252

AWS Efficiency Azure Cloud 252

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Using AI for Enhanced Cloud Operations The integration of AI in cloud computing is enhancing operational efficiency in several ways.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Dynatrace

JUNE 6, 2023

Kubernetes enables efficient resource utilization by easily scaling applications and services based on demand. This key feature helps in maintaining availability and reduces the need for manual intervention. Therefore, they are built to be non-persistent by design. Automated scaling. Self-healing. Cluster stability.

Open Source 198

Open Source Storage Analytics Innovation 198

Scalegrid

JANUARY 8, 2019

In Part I , we introduced a High Availability (HA) framework for MySQL hosting and discussed various components and their functionality. Simply put, in a MySQL semisynchronous replication configuration, the master commits transactions to the storage engine only after receiving acknowledgement from at least one of the slaves.

Availability 113

Availability Tuning Speed Network 113

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. These facts are managed and made available by services like viewing history or video metadata services outside of Axion.

Storage 187

Storage Design Scalability Latency 187

Scalegrid

NOVEMBER 29, 2023

As CTOs, database developers & experts, and DBAs seek more efficient, secure, and scalable cloud services solutions, DBaaS emerges as a compelling choice. A DBaaS automates several processes, such as using, erasing, and spinning up storage without interventions from IT staff.

Healthcare 130

Healthcare Hardware Database Scalability 130

Percona

MAY 1, 2023

PostgreSQL performance optimization aims to improve the efficiency of a PostgreSQL database system by adjusting configurations and implementing best practices to identify and resolve bottlenecks, improve query speed, and maximize database throughput and responsiveness. What is PostgreSQL performance tuning?

Tuning 52

Tuning Efficiency Database Performance 52

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. With performance optimization at its core along with mitigating risks associated with relying solely on one cloud provider or taking advantage of cost efficiencies. What is Hybrid Cloud?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

NOVEMBER 20, 2023

The first goal is to demonstrate how generative AI can bring key business value and efficiency for organizations. While technologies have enabled new productivity and efficiencies, customer expectations have grown exponentially, cyberthreat risks continue to mount, and the pace of business has sped up.

AWS 214

AWS Artificial Intelligence Analytics Cloud 214

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. By default, MongoDB provides a snappy block compression method for storage and network communication.

Storage 105

Storage Network Open Source Latency 105

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. This separation aims to streamline transaction write logging, improving efficiency and consistency. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 94

AWS Benchmarking Performance Traffic 94

Dynatrace

SEPTEMBER 8, 2023

To achieve this, we’ll create a Grail bucket specifically designed to retain data for a duration of 10 years (3,657 days). In the above recording, we demonstrate an alert specifically designed to notify when there is a significant increase in pending transactions.

Database 274

Database Artificial Intelligence Metrics Monitoring 274

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. These essential data points heavily influence both stability and efficiency within the system. offers the Software Watchdog specifically designed for this purpose.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Scalegrid

MARCH 14, 2024

In practice, a hybrid cloud operates by melding resources and services from multiple computing environments, which necessitates effective coordination, orchestration, and integration to work efficiently. Tailoring resource allocation efficiently ensures faster application performance in alignment with organizational demands.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

NOVEMBER 29, 2023

HDR was launched at Netflix in 2016 and the number of titles available in HDR has been growing ever since. Bitrate versus quality comparison HDR-VMAF is designed to be format-agnostic — it measures the perceptual quality of HDR video signal regardless of its container format, for example, Dolby Vision or HDR10. The graphic below (Fig.

Open Source 252

Open Source Software Engineering Internet Internet 252

High Scalability

SEPTEMBER 8, 2018

Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. What's changed ?

Storage 199

Storage Performance AWS Efficiency 199

High Scalability

DECEMBER 16, 2022

Cloud computing is a model of computing that delivers computing services over the internet, including storage, data processing, and networking. It allows users to access and use shared computing resources, such as servers, storage, and applications, on demand and without the need to manage the underlying infrastructure. Can you expand?

Cloud 201

Cloud Serverless Internet Internet 201

Scalegrid

JULY 17, 2020

JSONB supports indexing the JSON data, and is very efficient at parsing and querying the JSON data. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. It is a decomposed binary format to store JSON.

Storage 321

Storage Database Efficiency Processing 321

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. Thanks to the migration to V2, we were able to improve data availability and usability for our consumers significantly.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Dynatrace

JUNE 7, 2023

Kubernetes also gives developers freedom of choice when selecting operating systems, container runtimes, storage engines, and other key elements for their Kubernetes environments. Like Kubernetes, it allocates resources efficiently and ensures high availability and fault tolerance.

Open Source 212

Open Source Social Media Infrastructure Operating System 212

Dynatrace

JANUARY 23, 2024

AI-enabled chatbots can help service teams triage customer issues more efficiently. Deriving business value with AI, IT automation, and data reliability When it comes to increasing business efficiency, boosting productivity, and speeding innovation, artificial intelligence takes center stage. What is explainable AI?

Performance 191

Performance DevOps Innovation Artificial Intelligence 191

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. It leverages Netflix Scheduler for scheduling the Bulldozer Jobs. Moving data with Bulldozer at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

Scalegrid

DECEMBER 28, 2023

How to Implement Pagination in MongoDB® Big datasets require efficient data retrieval and processing for effective management. Pagination is an important factor to consider in MongoDB as it allows for the efficient organization of big datasets. The next() method then progresses through this set for efficient retrieval.

Best Practices 130

Best Practices Efficiency Strategy Speed 130

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 116

Cloud Serverless AWS Storage 116

Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Note that most of the changes we’ve introduced so far and those that are detailed below are all designed to be invisible to you, taking place entirely automatically in the background.

Best Practices 202

Best Practices Storage Java Benchmarking 202

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. What is Amazon VPC Flow Logs to Kinesis Data Firehose, and why is it important? The Dynatrace platform can ingest and evaluate a large amount of data from different sources.

Traffic 221

Traffic AWS Network Cloud 221

KeyCDN

FEBRUARY 22, 2023

PWAs are designed to work offline, be fast, and provide a seamless user experience across different devices. Motion UI Motion UI is a design trend involving animation and other interactive elements to create a more dynamic and engaging user experience. They thus adapt to the user's browser, screen size, and device specifications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

The Netflix TechBlog

JUNE 25, 2021

Dynomite is a high-speed in-memory database, providing highly available cross datacenter replication while preserving Redis-like semantics. Browsing your accessible clusters in different environments and regions Schema Designer Writing CREATE TABLE statements can be an intimidating experience for new Cassandra users.

Metrics 152

Metrics Best Practices Strategy Design 152