Abhishek Tiwari

JANUARY 6, 2018

Here we present a list of 10 open-source Kubernetes tools to make your SRE and Ops teams more effective to achieve their service level objectives. auto-completion of commands, auto-suggestions, in-line documentation. everything between nodes and processes including deployments, services, replica sets, pods, and containers.

Open Source 111

Open Source DevOps Storage Engineering 111

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. The first layer, Cassandra , is the source of truth for us. It provides simple APIs for creating indices, indexing or searching documents, which makes it easy to integrate. Net, Ruby, Perl etc.).

Strategy 258

Strategy Cache Analytics Storage 258

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. By default, MongoDB provides a snappy block compression method for storage and network communication.

Storage 108

Storage Network Open Source Latency 108

Dynatrace

JUNE 27, 2023

Many AWS services and third party solutions use AWS S3 for log storage. To date, some customers have used open source or community-backed components to forward logs from S3 to Dynatrace. This is achieved either by Dynatrace AWS S3 forwarder or log processing mechanisms in Dynatrace.

AWS 191

AWS Cloud Lambda Analytics 191

Scalegrid

JULY 17, 2020

It is an open standard format which organizes data into key/value pairs and arrays detailed in RFC 7159. JSON is the most common format used by web services to exchange data, store documents, unstructured data, etc. Note: If a particular key is always present in your document, it might make sense to store it as a first class column.

Storage 321

Storage Database Efficiency Processing 321

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Failover testing: If you have a high availability setup or a secondary data center, test to ensure the failover process switches over to the backup database server. The software is truly open source.

Database 87

Database Hardware Open Source Strategy 87

Dynatrace

JULY 25, 2022

DevOps enables developers to rapidly and frequently release new features and services by using continuous integration and continuous delivery (CI/CD) , suites of collaboration tools, and version control practices, most often with the open source Git software at its core. GitOps also requires extensive approvals for any development.

DevOps 218

DevOps Infrastructure Speed Cloud 218

Dynatrace

OCTOBER 11, 2021

Avoid lock-in with open-source technologies. The platform automatically manages all the computing resources required in those processes, freeing up DevOps teams to focus on developing and delivering features and functions. GCF also has relevance in IoT and file processing tasks. How Google Cloud Functions works.

Google 214

Google Cloud Serverless Azure 214

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Percona Monitoring and Management (PMM) – A fully open source monitoring tool to help you run your databases (not limited to MongoDB). on your radar.

Availability 99

Availability Servers Database Open Source 99

Dynatrace

DECEMBER 16, 2021

The vulnerability was first reported to the Apache Foundation (an open-source project) on November 24 by security researcher Chen Zhaojun of Alibaba, China’s largest e-commerce company, after an attack was documented on December 9 and affected servers of the game Minecraft. The Log4j 2 library controls how strings are logged.

Internet 258

Internet Internet Games Java 258

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. It has evolved steadily, however, during 25 years as an open source project. Another reason for PostgreSQL popularity (perhaps the biggest): It’s open source and free to use, distribute, and modify. What is PostgreSQL used for?

Open Source 78

Open Source Healthcare Social Media Database 78

Percona

AUGUST 29, 2023

You can change this; please see users documentation. In this case, the backups should be stored on some object storage. Please use our documentation to configure backups. With Percona Operator, organizations can seamlessly incorporate their database deployments into their CI/CD processes. Interested?

Storage 94

Storage Database Media Open Source 94

Percona

JANUARY 24, 2023

Our Operators provide built-in backup and restore capabilities, but some users are still looking for old-fashioned ways, like storage-level snapshots (i.e., Both your storage and Container Storage Interface (CSI) must support snapshots. Apart from public clouds, there are open source solutions like Ceph (rook.io

Database 66

Database Storage Open Source AWS 66

Percona

FEBRUARY 24, 2023

Usage reduction is a continuous process. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2. Figure 2: Amazon Elastic Block Storage Running relational or NoSQL databases is one of the use cases where EBS is recommended for.

Cloud 118

Cloud Serverless AWS Storage 118

Percona

JUNE 6, 2023

This includes establishing a regular backup schedule, regular testing to ensure data integrity, storing backups securely and offsite/in multiple locations, and documenting backup procedures. This results in smaller backup sets, reducing storage requirements, time to take the backup, and network usage, as compared to full backups.

Storage 68

Storage Strategy Network Efficiency 68

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Therefore, DBAs must take a piecemeal approach to achieve HA with PostgreSQL, bringing together open source extensions and tools from multiple sources.

Availability 83

Availability Open Source Architecture Database 83

Percona

OCTOBER 17, 2023

Dynamic WiredTiger tickets As a brief recap, WiredTiger tickets in MongoDB serve as the concurrency control mechanism within the WiredTiger storage engine. That’s very welcome after upgrade/downgrade processes when metadata is touched after FCV change. Without further ado, let’s get started.

Metrics 101

Metrics C++ Storage Database 101

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. It continues to be developed and maintained by the open source community and remains free to use under the GNU General Public License.

Open Source 52

Open Source Servers Storage Scalability 52

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. If you’re new to Conductor, this earlier blogpost and the documentation should help you get started and acclimatized to Conductor. The Netflix Media Database (NMDB) is one such example.

Lambda 189

Lambda Media Open Source Metrics 189

Percona

AUGUST 1, 2023

In this blog, we’ll explore the process of altering VARCHAR columns online, delving into insights gained while expanding the size of such columns. We get the answer from the documentation itself, and it has to do with how VARCHAR stores the data, actually prefix and data. However, there are caveats.

Storage 79

Storage Database Open Source Engineering 79

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. As with any database, developers and DBAs working with MongoDB should look at how to optimize the performance of their database, especially nowadays with cloud services, where each byte processed, transmitted, and stored costs money.

Database 79

Database Servers Storage Strategy 79

Percona

JULY 5, 2023

Regarding tablespace and segment fragmentation, modern storage systems tend to reduce the impact of these types of fragmentation. We will review the process with sequential and random insertions to understand how rows are inserted. We opened a bug to MySQL support and Percona Support to get this fixed.

Open Source 125

Open Source Database Efficiency Testing 125

Percona

JUNE 22, 2023

Failover mechanisms The primary purpose of failover — the automatic process of switching from a failed or offline database server to a standby or backup server — is to ensure user access and functionality of databases without interruption, even if there is a hardware or software failure.

Availability 107

Availability Database Open Source Hardware 107

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. There are several ways to find out this information with the easiest way being by referring to the documentation. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

NOVEMBER 1, 2023

The Recovery Point Objective (RPO) is the duration of time and service level within which a business process must be stored after a disaster in order to avoid unacceptable consequences associated with a break in continuity. Encryption Backups have sensitive data, so it’s highly recommended to encrypt, especially for offsite storage.

Best Practices 79

Best Practices Storage Strategy Database 79

Percona

JULY 2, 2023

Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

Percona

MAY 9, 2023

Many MongoDB clusters use storage-level snapshots to provide fast and reliable backups. Step one: Deploy the cluster on K8s In order to deploy Percona Server for MongoDB (PSMDB) on the K8s cluster, follow the documentation. This approach frees the deployment from cloud (and any other vendor) lock-in.

Storage 104

Storage Cloud Servers Google 104

Percona

AUGUST 18, 2023

And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. er tail: cannot open ‘/data/mysql/prod3306.er’ 10-Linux.x86_64.ssl101.tar.gz ln -s /usr/local/Percona-Server-8.0.19-10-Linux.x86_64.ssl101/

Programming 84

Programming Servers Database Hardware 84

Percona

JANUARY 19, 2023

You can refer to the documentation for further details. Compression: Compression is the process of restructuring the data by changing its encoding in order to store it in fewer bytes. It can help us to save costs on storage and backup times. 1 mysql mysql 592K Dec 30 02:48 tb1.ibd ibd -rw-r --. ibd -rw-r --. ibd -rw-r --.

Open Source 87

Open Source Storage Database Big Data 87

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. You can also learn more in our MySQL Firewalls documentation. Automated Backups. Scale On-Demand. Unlimited Databases.

Database 166

Database Cloud Website Azure 166

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process.

Best Practices 52

Best Practices Database Storage Servers 52

HammerDB

JUNE 27, 2022

The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Given the increasing importance of open source and the widespread use of HammerDB, the TPC adopted HammerDB in 2019 and now hosts the project on GitHub. Adoption by the TPC.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Netflix TechBlog

NOVEMBER 2, 2021

It has become a de facto standard for perceptual quality measurements within Netflix and, thanks to its open-source nature , throughout the video industry. This system is responsible for processing incoming media files, such as video, audio and subtitles, and making them playable on the streaming service.

Media 171

Media Innovation Metrics Latency 171

IO River

NOVEMBER 2, 2023

Started years ago with a focus on cloud management, Terraform built a massive community around its open-source license–up until two weeks ago, but more on that later. A significant factor that contributed to Terraform's rise to prominence is its open-source nature. ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Azure 52

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

Adrian Cockcroft

NOVEMBER 26, 2023

Yet many companies find it challenging to integrate digital technologies meaningfully into their operations, and they still rely on inefficient processes that generate unnecessary waste. One of the key challenges organizations face is an ability to extract datasets from different sources.

AWS 52

AWS Energy IoT Best Practices 52

The Netflix TechBlog

FEBRUARY 13, 2020

Using the framework we have open sourced, AVIF compression efficiency can be seen at work and compared against a whole range of image codecs that came before it. Also included is a lightweight conversion process back to JPEG format in order to serve clients that only support legacy JPEG.

Code 212

Code Metrics Efficiency Open Source 212