Percona

APRIL 24, 2023

The urge to create more and more indexes is found to be causing severe damage in many systems. Many times, removing indexes is what we should be doing first before considering any new indexes for the benefit of the entire system. This post is about PostgreSQL, but most of the problems also apply to other database systems.

Tuning 125

Tuning Cache Storage Database 125

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads.

AWS 95

AWS Benchmarking Performance Traffic 95

Percona

MARCH 23, 2023

These guidelines work well for a wide range of applications, though the optimal settings, of course, depend on the workload. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. have been released since then with some major changes.

Performance 124

Performance Hardware Tuning Storage 124

Scalegrid

JULY 17, 2020

Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

SEPTEMBER 28, 2020

Before we dive into the technical implementation, let me explain the visual concept of this “Global Status Page”: Another requirement for this status page was that it has to be lightweight, with no data storage at all. This is where the consolidated API, which I presented in my last post , comes into play.

Storage 214

Storage Architecture Tuning Efficiency 214

The Morning Paper

APRIL 16, 2019

Teaching rigorous distributed systems with efficient model checking Michael et al., It describes the labs environment, DSLabs , developed at the University of Washington to accompany a course in distributed systems. 175 undergraduates a year currently go through this course. EuroSys’19.

Systems 43

Systems Efficiency Testing Strategy 43

Brendan Gregg

APRIL 14, 2022

I've also used and helped develop many other technologies for debugging, primarily perf, Ftrace, eBPF (bcc and bpftrace), PMCs, MSRs, Intel vTune, and of course, [flame graphs] and [heat maps]. I hope my last two books, [Systems Performance 2nd Ed] and [BPF Performance Tools] serve Netflix well in my absence and everyone else who reads them.

Java 145

Java Cloud Cache AWS 145

Percona

AUGUST 30, 2023

Without data backup mechanisms, there can be data loss or system downtime. Even worse, entire operating systems can crash, also resulting in data loss. An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Similarly, accidental deletion is a culprit.

Database 86

Database Hardware Open Source Strategy 86

The Netflix TechBlog

MAY 14, 2021

However, they are scattered across multiple systems, and there isn’t an easy way to tie related messages together. You’re joining tables, resolving status types, cross-referencing data manually with other systems, and by the end of it all you ask yourself why? Things got hairy.

Traffic 160

Traffic Latency Java Google 160

Dynatrace

OCTOBER 7, 2020

A topological link to an entity only makes sense, of course, if the measurement that’s sent to Dynatrace has a semantic relationship to that entity. This gives you all the benefits of a metric storage system, including exploring and charting metrics, building dashboards, and alerting on anomalies.

Metrics 246

Metrics Analytics Storage Monitoring 246

Dynatrace

JULY 21, 2020

There are certain situations when an agent based approach isn’t possible, such as with network or storage devices, or a very old OS. You could of course create a custom device in Dynatrace and send data to it using our API or an ActiveGate extension.

Infrastructure 154

Infrastructure Monitoring Open Source Traffic 154

Percona

JANUARY 20, 2023

When using cloud storage like EBS or similar, it is normally easy(er) to extend volumes, which gives us the luxury to plan the space to allocate for data with a good grade of relaxation. To enable volume expansion, you need to delete the storage class and enable it again. The story The case was on AWS using EKS.

AWS 90

AWS Storage Monitoring Cloud 90

Percona

AUGUST 1, 2023

MySQL, a popular database management system, offers online operations since version 5.6, After changing the VARCHAR column size to 200, the following is the storage requirement. Of course, a character set defines the storage requirements, and changing CHARACTER SET also causes an increase in bytes required.

Storage 79

Storage Database Open Source Engineering 79

Dynatrace

NOVEMBER 29, 2021

It offers automated installation, upgrades, and life cycle management throughout the container stack — the operating system, Kubernetes and cluster services, and applications — on any cloud. By removing concerns around storage, security, and lifecycle management, businesses can instead focus on application development, support, and evolution.

Monitoring 147

Monitoring DevOps Infrastructure Metrics 147

Percona

AUGUST 17, 2023

In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). A multi-version concurrency control (MVCC) system ensures multiple users can access the same data simultaneously without conflicts or data loss.

Open Source 78

Open Source Healthcare Social Media Database 78

Dynatrace

SEPTEMBER 30, 2021

AWS Certified SysOps Administrator – Associate: Do you already deploy, manage, and operate AWS system resources and want to learn how to perform those duties even more effectively? Then this one’s for you. Machine learning. There are many ways to prepare for your AWS certification exam.

AWS 218

AWS Best Practices Analytics Cloud 218

High Scalability

OCTOBER 24, 2022

Anyone can rent a rack in a colo and stand up a system. Of course not, but let's ignore that very few organizations in the world have the technological know-how to create such managed services, especially without low level control of the entire system. You can switch between clouds with effort. It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Tasktop

MAY 17, 2021

Regardless of market or industry, the popular management system for setting organizational goals—harnessed so successfully by the major digital innovators —is helping enterprises adapt to all the disruption that 2020 and 2021 have served up. . The ability to measure the flow of value and surface system bottlenecks. Organizational OKRs.

DevOps 59

DevOps Metrics Innovation Storage 59

Percona

OCTOBER 18, 2023

MySQL, PostgreSQL, MongoDB, MariaDB, and others each have unique strengths and weaknesses and should be evaluated based on factors such as scalability, compatibility, performance, security, data types, community support, licensing rules, compliance, and, of course, the all-important learning curve if your choice is new to you.

Open Source 90

Open Source Database Hardware Strategy 90

The Morning Paper

FEBRUARY 6, 2020

Oh, and there’s a scheduler too of course to keep all the plates spinning. The canononical cloud platform architecture decouples storage and compute services so that each can be scaled and operated independently, i.e., they are disaggregated. Cloudburst’s design includes consistent mutable caches in the compute tier.

Lambda 98

Lambda Serverless Cache Latency 98

Dynatrace

JULY 8, 2020

Kubernetes has taken over the container management world and beyond , to become what some say the operating system or the new Linux of the cloud. Of course , you might think, Kubernetes has auto-scaling capabilities so wh y should I bother about resource s ? But of course, there are many others. . Dynatrace news.

Infrastructure 203

Infrastructure Monitoring Cloud Metrics 203

Percona

JULY 17, 2023

5 among all database management systems and No. 1 among non-relational/document-based systems ( DB-Engines, July 2023 ). Taking a deeper dive, MongoDB is a system for analyzing data because documents are easily shared across multiple nodes and because of its indexing, query-on-demand, and real-time aggregation capabilities.

Open Source 75

Open Source Database Scalability Software 75

Percona

JULY 7, 2023

Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Being a more advanced database management system, PostgreSQL is well-suited for performing complex queries in a large environment quickly.

Availability 83

Availability Open Source Architecture Database 83

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” tef : You can use a message broker to glue systems together, but never use one to cut systems apart. CompSciFact : 'Fancy algorithms are slow when n is small, and n is usually small.' -- Rob Pike. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. This, of course, is unless I can organize my products by country as well, which is a bit unusual nowadays but not impossible.

Traffic 123

Traffic Scalability Database Servers 123

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

OCTOBER 26, 2020

As a production system within Microsoft capturing around a quadrillion events and indexing 16 trillion search keys per day it would be interesting in its own right, but there’s a lot more to it than that. These two narratives of reference architecture and ingestion/indexing system are interwoven throughout the paper.

Cloud 104

Cloud Big Data Latency Architecture 104

The Morning Paper

JANUARY 30, 2020

The Mobile Web Worker (MWW) System. The Mobile Web Worker (MWW) System introduces a new client-side Mobile Web Worker Manager component which is responsible for managing web workers, including their migration when this is estimated to be beneficial. This could of course be a local worker on the mobile device. in the cloud).

Mobile 104

Mobile Cloud Latency Games 104

Percona

DECEMBER 14, 2022

System space is at a premium i.e. it’s worth your while to manage space utilization as much as possible. As a General Purpose Database Management System, basic behaviors can be reconfigured in Postgres for different purposes. The CITUS columnar extension feature set includes: Highly compressed tables: Reduces storage requirements.

Database 92

Database Analytics Storage Processing 92

The Morning Paper

MAY 6, 2019

What makes this much harder than it might at first appear of course, is the possibility of failures and asynchronous communication. Such issues are commonplace in some systems… Let’s begin our journey by considering one of the simplest solutions possible… The single acceptor algorithm.

Storage 77

Storage Systems Network Processing 77

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 79

C++ Database Storage Testing 79

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 106

Availability Database Open Source Hardware 106

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

Brendan Gregg

APRIL 14, 2022

I've also used and helped develop many other technologies for debugging, primarily perf, Ftrace, eBPF (bcc and bpftrace), PMCs, MSRs, Intel vTune, and of course, flame graphs and heat maps. I hope my last two books, Systems Performance 2nd Ed and BPF Performance Tools serve Netflix well in my absence and everyone else who reads them.

Java 52

Java Cache Cloud AWS 52

Apica

OCTOBER 17, 2022

The cost of storage alone used to be prohibitive to this practice, but now that we have better bandwidth and capacity, many companies started capturing and warehousing the increasing data emanating from observability agents and streaming sources, and then sorting and analyzing it later. Metrics and observability data hoarding.

Retail 52

Retail Website Infrastructure Software Architecture 52

ScaleOut Software

APRIL 3, 2020

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. By avoiding the need to create or connect to complex databases and ship data to offline analytics systems, it can provide timely answers quickly and easily.

Logistics 52

Logistics Analytics Scalability Cloud 52