Percona

MARCH 7, 2023

The goal is to simplify the provisioning and management of database capacity. One approach is to separate compute and storage to allow for independent scaling. By separating storage and compute, Neon replaces the PostgreSQL storage layer with data nodes, and compute nodes are distributed across a cluster of nodes.

Serverless 112

Serverless Storage Open Source Architecture 112

Dynatrace

DECEMBER 18, 2023

In this article, we take a closer look at Prometheus metrics and how we can ingest this data into Dynatrace. But often, we use additional services and solutions within our environment for backups, storage, networking, and more. As for the Collector, this will be the choice of tool for our implementation and this article.

Metrics 171

Metrics Engineering Energy Tuning 171

Scalegrid

JANUARY 19, 2024

This article dives straight into what triggers a rollback in MongoDB, the risks it carries, and concrete steps you can take to both prevent and recover from one. Data-bearing members face a higher risk of encountering issues caused by rollbacks, compared to others who utilize different storage methods.

Database 130

Database Network Servers Monitoring 130

Smashing Magazine

SEPTEMBER 28, 2022

Caching partially stores your data and is not used as permanent storage. Using the cache as permanent storage is an anti-pattern. Server caches help lower the latency between a Frontend and Backend; since key-value databases are faster than traditional relational SQL databases, it will significantly increase an API’s response time.

Cache 125

Cache Performance Servers Social Media 125

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Scalegrid

DECEMBER 6, 2023

The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs. Database as a Service (DBaaS) and managed databases offer distinct advantages along with certain challenges.

Database 130

Database Cloud Hardware Storage 130

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. I will be using the 50GB Stack Overflow 2013 database , but any large table with a low number of distinct values would do. The Stack Overflow 2013 database comes without nonclustered indexes to minimize download time. Test Environment. BountyAmount.

Servers 86

Servers Tuning Database Efficiency 86

SQL Performance

SEPTEMBER 16, 2021

To finish up my short series of articles on latches, this time I’m going to discuss a few other latches in SQL Server you might see occasionally but don’t merit a complete article by themselves. Data growth occurring and a scan really is the most efficient plan. The LOG_MANAGER Latch. The LOG_MANAGER Latch.

Servers 57

Servers Storage Efficiency Database 57

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. What is an MPP Database?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Scalegrid

MARCH 28, 2024

This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. Snapshots provide point-in-time captures of the dataset, which are efficient for recovery on startup.

Cache 130

Cache Storage Scalability Architecture 130

Scalegrid

MARCH 8, 2024

With MySQL point-in-time recovery , you can restore your database to the moment before the problem occurs. Preparation for PITR is crucial and involves enabling binary logging and creating a full database backup. It is important to begin with a thorough database backup to prepare for such situations.

Database 162

Database Strategy Servers Best Practices 162

SQL Performance

AUGUST 27, 2021

Continuing my series of articles on latches, this time I’m going to discuss the APPEND_ONLY_STORAGE_INSERT_POINT latch and show how it can be a major bottleneck for heavy update workloads where either form of snapshot isolation is being used. This timestamp is used to make sure a query processes the correct version of a record.

Database 56

Database Storage Availability Servers 56

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time.

Big Data 154

Big Data Processing Lambda Database 154

Scalegrid

JULY 17, 2020

What’s in this article? Why should a relational database even care about unstructured data? JSON database in 9.2 It is useful to validate incoming JSON and store in the database. JSONB supports indexing the JSON data, and is very efficient at parsing and querying the JSON data. Why Store JSON in PostgreSQL?

Storage 321

Storage Database Efficiency Processing 321

SQL Performance

JUNE 10, 2020

The relational model and the standard querying language that is based on it are supposed to deal only with the conceptual aspects of the data and leave the physical implementation details like storage, optimization, access and processing of the data to the database platform (the implementation ). Persistency.

C++ 109

C++ Database Servers Code 109

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. With performance optimization at its core along with mitigating risks associated with relying solely on one cloud provider or taking advantage of cost efficiencies. What is Hybrid Cloud?

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

SQL Performance

APRIL 17, 2020

Depending on the type of change and the configuration of the database, an ALTER COLUMN command will need to perform one of the following actions: Change metadata in system tables only. With careful planning, the other steps required can be made as efficient as possible, for example using minimally-logged or ONLINE operations.

Servers 63

Servers Database Testing Efficiency 63

Scalegrid

DECEMBER 28, 2023

Managing vast datasets effectively is an essential requirement for modern applications, and MongoDB , a leading NoSQL database, offers robust solutions for this requirement. How to Implement Pagination in MongoDB® Big datasets require efficient data retrieval and processing for effective management. limit(number).

Best Practices 130

Best Practices Efficiency Strategy Speed 130

SQL Performance

JUNE 10, 2020

The relational model and the standard querying language that is based on it are supposed to deal only with the conceptual aspects of the data and leave the physical implementation details like storage, optimization, access and processing of the data to the database platform (the implementation ). Persistency.

C++ 93

C++ Database Servers Code 93

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

MARCH 14, 2024

This article will explore hybrid cloud benefits and steps to craft a plan that aligns with your unique business challenges. In practice, a hybrid cloud operates by melding resources and services from multiple computing environments, which necessitates effective coordination, orchestration, and integration to work efficiently.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? What we should really compare is the MySQL and Aurora database engines provided by Amazon RDS. How do I choose which one to use?

AWS 52

AWS Database Serverless Storage 52

Percona

APRIL 24, 2023

I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them. This post is about PostgreSQL, but most of the problems also apply to other database systems. As the size of the active dataset increases, the cache becomes less and less efficient.

Tuning 127

Tuning Cache Storage Database 127

Smashing Magazine

NOVEMBER 2, 2021

Cost-Efficient And Effort-Saving Development. On the contrary, a native application of an e-commerce store can come at 30, 50, or even 100 MB and up, consuming internal device storage. These multiple “heads” are attached to the backend and database. Below are some main things to consider. Image credit: Apivita. Large preview ).

Code 74

Code Cache Retail Mobile 74

Highly Scalable

SEPTEMBER 18, 2012

These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases. Data Placement. System Coordination. Read/Write latency.

Database 213

Database Latency C++ Scalability 213

High Scalability

SEPTEMBER 8, 2018

New databases used to be announced seemingly every week. While database neogenesis has slowed down considerably, it has not gone necrotic. Anna is not only incredibly fast, it’s incredibly efficient and elastic too: an autoscaling, multi-tier, selectively-replicating cloud service. What's changed ?

Storage 199

Storage Performance AWS Efficiency 199

The Netflix TechBlog

OCTOBER 27, 2020

Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. What is Bulldozer Bulldozer is a self-serve data platform that moves data efficiently from data warehouse tables to key-value stores in batches. Figure 1 shows how we use Bulldozer to move data at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

Smashing Magazine

JANUARY 15, 2019

The Green Web Foundation maintains an ever-growing database of web hosts who are either wholly powered by renewable energy or are at least committed to being carbon neutral. An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. This level of distribution will seriously affect the efficiency of the operation, which will increase the response time significantly. This is it. The POC Why this POC?

Traffic 125

Traffic Scalability Database Servers 125

Percona

FEBRUARY 23, 2023

If you ever had to make a quick ad-hoc backup of your MongoDB databases, but there was not enough disk space on the local disk to do so, this blog post may provide some handy tips to save you from headaches. Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination.

AWS 122

AWS Storage Database Open Source 122

Percona

JULY 15, 2023

One very common problem when trying to optimize a database environment is index usage. In this article, I will first explain an overview of indexes in MySQL and cover the MySQL CREATE INDEX before diving into showing what functional indexes are and how they work. Need help managing complex database environments?

Virtualization 77

Virtualization Speed Database Efficiency 77

Highly Scalable

MARCH 1, 2012

NoSQL databases are often compared by various non-functional criteria, such as scalability, performance, and consistency. At the same time, NoSQL data modeling is not so well studied and lacks the systematic theory found in relational databases. Document databases advance the BigTable model offering two significant improvements.

Database 279

Database Ecommerce Efficiency Engineering 279

The Netflix TechBlog

JUNE 25, 2021

Dynomite is a high-speed in-memory database, providing highly available cross datacenter replication while preserving Redis-like semantics. Choosing how you want to decode blob data Query IDE Efficient point queries are available in the Explore mode, but you may have users that still require the flexibility of CQL.

Metrics 152

Metrics Best Practices Strategy Design 152

Percona

NOVEMBER 6, 2023

Percona Operators allow users to easily manage complex database systems in a Kubernetes environment. With Percona Operators , users can easily deploy, monitor, and manage databases orchestrated by Kubernetes, making it easier and more efficient to run databases at scale.

Metrics 71

Metrics Monitoring Database Cache 71

The Netflix TechBlog

NOVEMBER 2, 2021

This article explains how we designed microservices and workflows on top of the Cosmos platform to bolster such video quality innovations. For example, VQS relies on the Netflix Media Database (NMDB) to store and index the quality scores, while the Reloaded system uses a mix of non-queryable data models and files.

Media 171

Media Innovation Metrics Latency 171

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Particular Software

MAY 22, 2023

Here’s the shopping cart part of the entity relationship diagram we’ll print out and keep at our desk 2 like a holy article of software design scripture: We’ve also realized that a cart has some behavior associated with it as well, operations like AddToCart() , SaveForLater() , and Checkout(). It gets worse.

Systems 98

Systems Cache Strategy Database 98