Percona

FEBRUARY 1, 2023

This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability. Therefore, TOAST is a storage technique used in PostgreSQL to handle large data objects such as images, videos, and audio files.

Storage 95

Storage Scalability Strategy Performance 95

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19.

Storage 64

Storage Systems Hardware Efficiency 64

Dynatrace

OCTOBER 4, 2022

This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This decoupling ensures the openness of data and storage formats, while also preserving data in context. Thus, it can scale massively.

Artificial Intelligence 264

Artificial Intelligence Analytics Storage Architecture 264

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. However, data loss is always possible due to hardware malfunction, software defects, or other unforeseen circumstances, just like with any computer system.

Best Practices 130

Best Practices Storage Strategy Database 130

Dynatrace

OCTOBER 4, 2022

As a result, organizations need software to work perfectly to create customer experiences, deliver innovation, and generate operational efficiency. Traditionally, though, to gain true business insight, organizations had to make tradeoffs between accessing quality, real-time data and factors such as data storage costs. Event severity.

Analytics 187

Analytics Software Software Storage 187

The Netflix TechBlog

NOVEMBER 29, 2023

In spite of reaching higher qualities than the fixed ladder, the HDR-DO ladder, on average, occupies only 58% of the storage space compared to fixed-bitrate ladder. This is achieved by more efficiently spacing the ladder points, especially in the high-bitrate region. Yes, we are committed to supporting the open-source community.

Open Source 252

Open Source Software Engineering Internet Internet 252

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. The following sections describe our journey in building these components.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

MARCH 24, 2023

Containers enable developers to package microservices or applications with the libraries, configuration files, and dependencies needed to run on any infrastructure, regardless of the target system environment. Originally created by Google, Kubernetes was donated to the CNCF as an open source project.

Infrastructure 182

Infrastructure Open Source Operating System Cloud 182

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay. What is your favorite project?

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. So, what is Neon?

Serverless 115

Serverless Storage Open Source Architecture 115

Dynatrace

JULY 25, 2022

The DevOps playbook has proven its value for many organizations by improving software development agility, efficiency, and speed. This method known as GitOps would also boost the speed and efficiency of practicing DevOps organizations. What is GitOps? Development teams use GitOps to specify their infrastructure requirements in code.

DevOps 221

DevOps Infrastructure Speed Cloud 221

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. This separation aims to streamline transaction write logging, improving efficiency and consistency. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 101

AWS Benchmarking Performance Traffic 101

Percona

DECEMBER 27, 2023

We want adopters of our technology to be able to deploy their critical open source databases and applications across any public or private cloud environment. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 83

Cloud Open Source Strategy Best Practices 83

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution. Hint Hint, ProxySQL helps.

Performance 108

Performance Monitoring Traffic Database 108

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. Another source reported a 43% overall increase in Prometheus adoption for the last six months of 2021. What is Prometheus?

Metrics 175

Metrics Engineering Energy Tuning 175

Percona

AUGUST 30, 2023

Without data backup mechanisms, there can be data loss or system downtime. Even worse, entire operating systems can crash, also resulting in data loss. An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. The software is truly open source.

Database 92

Database Hardware Open Source Strategy 92

Percona

MAY 1, 2023

It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. What is PostgreSQL performance tuning?

Tuning 52

Tuning Efficiency Database Performance 52

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). It has evolved steadily, however, during 25 years as an open source project.

Open Source 82

Open Source Healthcare Social Media Database 82

The Morning Paper

APRIL 16, 2019

Teaching rigorous distributed systems with efficient model checking Michael et al., It describes the labs environment, DSLabs , developed at the University of Washington to accompany a course in distributed systems. EuroSys’19. On the surface you might think today’s paper selection an odd pick.

Systems 43

Systems Efficiency Testing Strategy 43

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Message queue software options to consider.

Monitoring 196

Monitoring Serverless Programming Speed 196

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Message queue software options to consider.

Monitoring 195

Monitoring Serverless Programming Speed 195

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

Percona

JUNE 6, 2023

Full backups are most suitable for critical systems or sensitive data that cannot afford any loss or downtime, allowing for a complete recovery of data in the event of data corruption, hacking, system failures, or natural disasters. In addition, they are used for restoring or moving data to a new system.

Storage 69

Storage Strategy Network Efficiency 69

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 112

Availability Database Open Source Hardware 112

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts.

AWS 208

AWS Strategy Storage Metrics 208

Percona

SEPTEMBER 25, 2023

PostgreSQL is a powerful and popular open source relational database management system. pgBackRest is a highly efficient and versatile tool for managing PostgreSQL backups. This issue tends to occur when your backup storage is located offsite, your database is quite large, and the backup process generates a lot of files.

Database 98

Database Open Source Storage Servers 98

Percona

SEPTEMBER 27, 2023

PostgreSQL Partition Manager — ‘pg_partman’ — is an open source extension freely available, widely supported, and actively maintained by the PostgreSQL community. You can set the parameter either by using ALTER SYSTEM or by manually modifying the config file.

Storage 104

Storage Open Source Database Efficiency 104

Scalegrid

JULY 17, 2020

Syncing with external data sources. Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. JSONB supports indexing the JSON data, and is very efficient at parsing and querying the JSON data. For example, Stripe transactions.

Storage 321

Storage Database Efficiency Processing 321

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JULY 5, 2023

Fragmentation is a common concern in some database systems. If your data is organized following the principle of locality, data access will be more efficient. Regarding tablespace and segment fragmentation, modern storage systems tend to reduce the impact of these types of fragmentation. What is fragmentation?

Open Source 129

Open Source Database Efficiency Testing 129

Dynatrace

DECEMBER 16, 2022

But legacy, custom software can often prevent systems from working together, ultimately hindering growth. Conversely, an open platform can promote interoperability and innovation. As organizations continue to operate in the cloud, open technologies become critical. The platform approach vs. the best-of-breed approach.

Innovation 193

Innovation Software Software Cloud 193

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. To improve their alerting system, the team decided to move to SLO/SLI-based alerting, which require deeper knowledge of the application but are more helpful than generalized metric alerts.

AWS 147

AWS Strategy Storage Metrics 147

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍AutomationCode-based systems also shine in automation.

Open Source 52

Open Source DevOps AWS Azure 52

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. The Netflix Media Database (NMDB) is one such example.

Lambda 189

Lambda Media Open Source Metrics 189

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. WordPress is a content management system (CMS) used to build and manage websites and web applications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. We believe the central constraint in high throughput data processing has moved from compute and storage to the network.

Database 117

Database Design Cloud Storage 117