The Netflix TechBlog

OCTOBER 19, 2020

Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. The biggest drawbacks are that a full backup can be time-consuming, and they require a significant amount of storage space. Therefore, it’s not the ideal choice if there are time or storage limitations.

Best Practices 130

Best Practices Storage Strategy Database 130

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. By default, MongoDB provides a snappy block compression method for storage and network communication.

Storage 105

Storage Network Open Source Latency 105

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. This separation aims to streamline transaction write logging, improving efficiency and consistency. Who can benefit from DLV? and later v10 versions MySQL: 8.0.28

AWS 94

AWS Benchmarking Performance Traffic 94

Percona

MARCH 7, 2023

One approach is to separate compute and storage to allow for independent scaling. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. It’s an open source alternative to AWS Aurora Postgres that utilizes a serverless architecture. So, what is Neon?

Serverless 107

Serverless Storage Open Source Architecture 107

Dynatrace

JULY 25, 2022

The DevOps playbook has proven its value for many organizations by improving software development agility, efficiency, and speed. This method known as GitOps would also boost the speed and efficiency of practicing DevOps organizations. After merging, a CI/CD pipeline builds, tests, and deploys the application. What is GitOps?

DevOps 214

DevOps Infrastructure Speed Cloud 214

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution. Hint Hint, ProxySQL helps.

Performance 102

Performance Monitoring Traffic Database 102

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Disaster recovery strategies and testing One might think disaster begets loss, but with the right planning, that loss can be so minimal it’s more “blip” than “bad.”

Database 86

Database Hardware Open Source Strategy 86

Percona

MAY 1, 2023

PostgreSQL performance optimization aims to improve the efficiency of a PostgreSQL database system by adjusting configurations and implementing best practices to identify and resolve bottlenecks, improve query speed, and maximize database throughput and responsiveness. What is PostgreSQL performance tuning?

Tuning 52

Tuning Efficiency Database Performance 52

Percona

JUNE 30, 2023

Percona, a leading provider of open-source database software and services, announced the general availability of Percona Operator for PostgreSQL version 2. The solution is 100% open source and automates the deployment and management of PostgreSQL clusters on Kubernetes. In version 1.x, Will Percona still support v1?

Availability 92

Availability Open Source Azure Hardware 92

Dynatrace

AUGUST 5, 2022

For nonurgent messages, texting is a more efficient approach. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. The concept is like text messaging — a feature most mobile phone users understand. If you need to send a message, you can call the person.

Monitoring 188

Monitoring Serverless Programming Speed 188

Dynatrace

AUGUST 5, 2022

For nonurgent messages, texting is a more efficient approach. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. The concept is like text messaging — a feature most mobile phone users understand. If you need to send a message, you can call the person.

Monitoring 188

Monitoring Serverless Programming Speed 188

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. It has evolved steadily, however, during 25 years as an open source project. Another reason for PostgreSQL popularity (perhaps the biggest): It’s open source and free to use, distribute, and modify. What is PostgreSQL used for?

Open Source 77

Open Source Healthcare Social Media Database 77

The Netflix TechBlog

MAY 21, 2019

using RL agents for test case scheduling By: Stanislav Kirdey , Kevin Cureton , Scott Rick , Sankar Ramanathan Introduction Netflix brings delightful customer experiences to homes on a variety of devices that continues to grow each day. Detect a regression in a test case. These problems could be solved in several different ways.

Testing 163

Testing AWS Lambda Network 163

Scalegrid

JULY 17, 2020

JSONB supports indexing the JSON data, and is very efficient at parsing and querying the JSON data. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. It is a decomposed binary format to store JSON.

Storage 321

Storage Database Efficiency Processing 321

Percona

JULY 5, 2023

If your data is organized following the principle of locality, data access will be more efficient. Regarding tablespace and segment fragmentation, modern storage systems tend to reduce the impact of these types of fragmentation. This type of fragmentation can improve performance and efficiency.

Open Source 123

Open Source Database Efficiency Testing 123

Percona

JUNE 6, 2023

This includes establishing a regular backup schedule, regular testing to ensure data integrity, storing backups securely and offsite/in multiple locations, and documenting backup procedures. This results in smaller backup sets, reducing storage requirements, time to take the backup, and network usage, as compared to full backups.

Storage 66

Storage Strategy Network Efficiency 66

Percona

JANUARY 19, 2023

In this blog post, we will review key topics to consider for managing large datasets more efficiently in MySQL. Redundant indexes: It is known that accessing rows by fetching an index is more efficient than through a table scan in most cases. 1 mysql mysql 592K Dec 30 02:48 tb1.ibd ibd -rw-r --. 1 mysql mysql 464K Dec 30 02:48 tb2.ibd

Open Source 85

Open Source Storage Database Big Data 85

Scalegrid

JUNE 22, 2020

MySQL is the all-time number one open source database in the world, and a staple in RDBMS space. ScaleGrid provides 30% more storage on average vs. DigitalOcean for MySQL at the same affordable price. In this benchmark, we measure MySQL throughput in terms of queries per second (QPS) to measure our query efficiency.

Database 217

Database Benchmarking Latency Performance 217

Percona

JUNE 4, 2023

MariaDB is a popular SQL open source relational database management system that originated as a fork of MySQL after MySQL was acquired by Sun Microsystems in 2008 and later Oracle in 2010. It continues to be developed and maintained by the open source community and remains free to use under the GNU General Public License.

Open Source 52

Open Source Servers Storage Scalability 52

Percona

SEPTEMBER 25, 2023

PostgreSQL is a powerful and popular open source relational database management system. pgBackRest is a highly efficient and versatile tool for managing PostgreSQL backups. This issue tends to occur when your backup storage is located offsite, your database is quite large, and the backup process generates a lot of files.

Database 91

Database Open Source Storage Servers 91

Percona

JUNE 22, 2023

High availability architecture for open source databases No matter where a database infrastructure is located (on-premises, public or private cloud environment, or hybrid environment) or what technology is used — be it MySQL, PostgreSQL, or MongoDB — it’s vital to eliminate single points of failure.

Availability 105

Availability Database Open Source Hardware 105

Percona

AUGUST 29, 2023

In this case, the backups should be stored on some object storage. For example, my demo - cluster configuration in 04-deploy-cr.yaml looks like this if I want to take the backups to Google Cloud Storage (GCS): pgbackrest: global: - secret: name: demo-cluster-gcs. Please use our documentation to configure backups. Interested?

Storage 91

Storage Database Media Open Source 91

Dynatrace

DECEMBER 16, 2022

Engineering teams often gravitate toward a 100% do-it-yourself approach, which is OK for experimentation and testing. Without open standards, platforms promote lock-in and hinder innovation. With open standards, developers can take a Lego-like approach to application development, which makes delivery more efficient.

Innovation 185

Innovation Software Software Cloud 185

Percona

SEPTEMBER 27, 2023

PostgreSQL Partition Manager — ‘pg_partman’ — is an open source extension freely available, widely supported, and actively maintained by the PostgreSQL community. pg_partman creates and manages both time-based and serial-based table partition sets.

Storage 97

Storage Open Source Database Efficiency 97

CSS - Tricks

SEPTEMBER 21, 2020

They were testing mobile web apps on Android using Lighthouse scores. There has got to be a balance between the propagation and duplicative storage as far as the savings that would be realized by the efficiency of saving requests. at full brightness for the set of popular Android apps that we tested! I kinda doubt it.

Website 97

Website Energy Storage Efficiency 97

Percona

FEBRUARY 23, 2023

Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination. At the same time, the common goal is to save both the network bandwidth and storage space (cost savings!) However, I find zstd way more efficient, so I’ll use it in the examples. eu-central-2.wasabisys.com"}})

AWS 119

AWS Storage Database Open Source 119

Percona

APRIL 10, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. Offered free as an open source solution, Percona XtraBackup drives down backup costs while providing unique features for MySQL backups.

Open Source 76

Open Source Servers AWS Database 76

Percona

FEBRUARY 24, 2023

Making the use of resources efficiently and ensuring that this does not impact the budget available for cloud computing is not a one-time fix but a continuous cycle of picking properly sized resources and eliminating over-provisioning. Over-provisioned instances may lead to unnecessary infrastructure costs.

Cloud 116

Cloud Serverless AWS Storage 116

Percona

AUGUST 2, 2023

Linux native Input/Output (I/O) statistics Pipe viewer utility By following these approaches, we can effectively monitor the restoration process and manage your MySQL database restoration efficiently. Look for the ‘rchar’ field, representing the total bytes read from storage. rw-r--r--. 1 root root 2.3G Happy Monitoring!

Database 81

Database Monitoring C++ Speed 81

Percona

JULY 2, 2023

Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. Alternatively, we can choose a version that is too early and not yet tested enough for production use. This is more efficient than $regex but needs you to prepare in advance by adding text indexes to your data sets.

Database 79

Database Servers Storage Strategy 79

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Many of the Netflix Content and Studio Engineering services rely on Conductor for efficient processing of their business flows. Validations and Testing Dry runs, i.e

Lambda 189

Lambda Media Open Source Metrics 189

HammerDB

JUNE 27, 2022

As the TPC makes its specifications available for free, the need was seen for an open source benchmarking application that could leverage the standards written by the TPC yet implemented quickly, easily and at low cost by anyone. HammerDB is open source software licensed under the. How to build HammerDB from source.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

APRIL 16, 2019

Teaching rigorous distributed systems with efficient model checking Michael et al., During the ten week course, students implement four different assignments: an exactly-once RPC protocol; a primary-backup system; Paxos; and a scalable, transactional key-value storage system. Testing and grading their solutions is another!

Systems 43

Systems Efficiency Testing Strategy 43

Percona

DECEMBER 12, 2022

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. Offered free as an open source solution, Percona XtraBackup drives down backup costs while providing unique features for MySQL backups.

Open Source 61

Open Source Azure Servers Database 61

Percona

SEPTEMBER 19, 2023

Now, since backup speed and compactness are important for busy, important databases, Percona’s open source physical backup solution – Percona XtraBackup (PXB) , takes into account all these aspects and benefits MySQL world with its exceptional capabilities! Create new directories for storing redo log archives.

C++ 101

C++ Servers Storage Speed 101