Percona

APRIL 17, 2023

Since MongoDB usually works with a replica set, it is possible to increase this parameter to get better performance: # edit /etc/mongod.conf storage: journal: enabled: true commitIntervalMs: 300 WiredTiger cache For dedicated servers, it is possible to increase the WiredTiger(WT) cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

Scalegrid

JANUARY 12, 2024

While managing cloud workloads offers numerous benefits, it also presents several challenges such as security risks, compliance issues, and resource optimization, which can be addressed effectively with tools like ScaleGrid, offering features like encryption, disaster recovery, and real-time resource optimization for diverse databases.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. When this data block is read, it decompresses it in memory and presents it to the incoming request.

Storage 110

Storage Network Open Source Latency 110

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. These models both offer advantages, while also presenting their unique challenges.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

JUNE 9, 2023

Data scale and silos present challenges to DevOps maturity DevOps teams often run into problems trying to drive better data-driven decisions with observability and security data. When data storage strategies become problematic to DevOps maturity Data warehouse-based approaches add cost and time to analytics projects.

DevOps 183

DevOps Analytics Storage Metrics 183

Scalegrid

JULY 17, 2020

Note: If a particular key is always present in your document, it might make sense to store it as a first class column. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

Scalegrid

MARCH 14, 2024

Public Cloud Infrastructure Third-party providers run public cloud services, delivering a broad array of offerings like computing power, storage solutions, and network capabilities that enhance the functionality of a hybrid cloud architecture. We will examine each of these elements in more detail. It should offer user-friendly operation.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. Amazon Elastic Block Store (EBS) is your good-to-go option for disk space.

Cloud 120

Cloud Serverless AWS Storage 120

Strategic Tech

MAY 24, 2019

Over the past few years I have focused much of my learning and work choices around learning about the design of sociotechnical systems?—?how how to design software architectures and organise teams around them. As part of good design, we should consider the effects of changing all of these variables.

Design 45

Design Software Architecture Strategy Technology 45

Dynatrace

MAY 26, 2021

In the keynote by Christina Yakomin and Steve Prazenica from Vanguard, the presenters recounted their journey from a monolith with alert-based incident reporting and no positive health signals to an observable microservice architecture. Trace-based sampling can help you save storage costs. So, the design of OTel allows for flexibility.

AWS 212

AWS Strategy Storage Metrics 212

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

JANUARY 9, 2024

This presents enterprises with a wide range of options that cater specifically to their needs within this new framework created by multiple trusted cloud service providers. The Consequences of Cloud Security Failures Failure to properly secure the cloud can have devastating consequences for businesses.

Strategy 130

Strategy Cloud Best Practices Government 130

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. Log Viewer enables users to present log data in a filterable, easy-to-use table and to browse log data within a certain time frame using detected aspects of the log content.

Traffic 215

Traffic AWS Network Cloud 215

Percona

MARCH 28, 2023

The above diagram shows the information present in a checkpoint, while the below output shows how it looks when listed using the “wt” utility. $ Journal, on the one hand, is an append-only operation in a journal file, AKA transaction log file present on disk. These checkpoints are stored in WiredTiger.wt

Hardware 89

Hardware C++ Storage Cache 89

Percona

JULY 24, 2023

PBM) introduced a GA version of incremental physical backups , which can greatly impact both the recovery time and the cost of backup (considering storage and data transfer cost). Well, it is because we believe that open source philosophy is not only about the source but also about design and decision-making.

Availability 76

Availability Open Source Strategy Storage 76

Dynatrace

MAY 26, 2021

In the keynote by Christina Yakomin and Steve Prazenica from Vanguard, the presenters recounted their journey from a monolith with alert-based incident reporting and no positive health signals to an observable microservice architecture. Trace-based sampling can help you save storage costs. So, the design of OTel allows for flexibility.

AWS 147

AWS Strategy Storage Metrics 147

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Where a high availability design once worked well, it can no longer keep up with more complex requirements.

Availability 84

Availability Open Source Architecture Database 84

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Simple Storage Service (S3). Metrics for each service instance are presented in detailed charts—see the example for ECS below. Amazon Simple Notification Service (SNS).

AWS 136

AWS Metrics IoT Storage 136

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Amazon Simple Storage Service (S3). Metrics for each service instance are presented in detailed charts—see the example for ECS below. Amazon Simple Notification Service (SNS).

AWS 133

AWS Metrics IoT Storage 133

Scalegrid

DECEMBER 28, 2023

into manageable portions to avoid potential discrepancies related to the enormous amounts of data present. Also, thinking about write process speed & storage capacity must always come first before creating indexes as well.

Best Practices 130

Best Practices Efficiency Strategy Speed 130

Speed Curve

FEBRUARY 25, 2024

Heatmap of the most popular pages and their Web Vitals metrics I then typically switch to the RUM > Design dashboard and use the list of popular interaction elements to determine which ones I want to investigate further. Guest profiles also start with empty caches, empty cookie stores, empty browser storage, etc.

Analytics 91

Analytics Processing Google Mobile 91

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. offers the Software Watchdog specifically designed for this purpose. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

Percona

JUNE 4, 2023

While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation. Disadvantages: While MariaDB is a popular and widely-used RDBMS, it can present some disadvantages to users that may not be present in others.

Open Source 52

Open Source Servers Storage Scalability 52

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source 76

Open Source Database Storage Scalability 76

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

SEPTEMBER 27, 2023

Below, I present the steps and failures encountered when attempting to change the schema after creating the extension. Establishing a dedicated schema for an extension serves the purpose of storing its objects, including tables, functions, procedures, and more. Download Percona Distribution for PostgreSQL Today!

Storage 101

Storage Open Source Database Efficiency 101

Percona

MAY 15, 2023

In short, any data that is written must be consistent with the data present. This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. UUID(), ?, ?, NOW(), ?, ?, ?,?)

Traffic 124

Traffic Scalability Database Servers 124

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Some of them include: Redundant hardware: Both HA and DR use redundant hardware components, including servers and storage devices. It’s suitable for databases with moderate change rates.

Database 89

Database Hardware Open Source Strategy 89

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails. This flexibility can be crucial in designing a scalable architecture.

Availability 109

Availability Database Open Source Hardware 109

CSS Wizardry

MARCH 3, 2019

This means that, if the Cache-Control: max-age=60 header is still present, the cached file’s 60 seconds starts again. Tip: There are a number of directives that Clear-Site-Data will accept: "cookies" , "storage" , "executionContexts" , and "*" (which, naturally, means ‘all of the above’). 120 seconds overall cache time for one file.

Cache 264

Cache Latency Strategy Servers 264

Percona

OCTOBER 17, 2023

Not only that, the idea is to present you with changes flying under the radar, which, in my understanding, can influence your daily operation. Dynamic WiredTiger tickets As a brief recap, WiredTiger tickets in MongoDB serve as the concurrency control mechanism within the WiredTiger storage engine.

Metrics 103

Metrics C++ Storage Database 103

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. This is left as an exercise for the application developer at present. It’s a comparatively small gathering with a great mix of people, and fabulous discussions.

Hardware 56

Hardware Programming Media Storage 56

Adrian Cockcroft

NOVEMBER 26, 2023

In this session, learn how AWS has been supporting customers like the Territorial Intelligence Centre (CIT) in designing cutting-edge tools to address traceability in supply chains with deforestation risks by integrating governmental databases, innovative map services, and land-use data from high spatial resolution satellite imagery.

AWS 52

AWS Energy IoT Best Practices 52