The Netflix TechBlog

NOVEMBER 29, 2023

By June 2023 the entire HDR catalog was optimized. In spite of reaching higher qualities than the fixed ladder, the HDR-DO ladder, on average, occupies only 58% of the storage space compared to fixed-bitrate ladder. 263–1–8 (2023) [ online ] [2] A. We started backfilling HDR-DO encodes for existing titles from Q2 2022.

Open Source 252

Open Source Software Engineering Internet Internet 252

Dynatrace

JANUARY 17, 2024

An AI observability strategy—which monitors IT system performance and costs—may help organizations achieve that balance. AI requires more compute and storage. Training AI data is resource-intensive and costly, again, because of increased computational and storage requirements. AI performs frequent data transfers.

Strategy 212

Strategy Artificial Intelligence Storage Cloud 212

Dynatrace

MAY 6, 2024

Problem remediation is too time-consuming According to the DevOps Automation Pulse Survey 2023 , on average, a software engineer takes nine hours to remediate a problem within a production application. Context-rich tickets can be created in systems like Jira or ServiceNow for traceability and compliance.

DevOps 275

DevOps Software Engineering Games Infrastructure 275

Dynatrace

JANUARY 22, 2024

And while generative AI was much hyped in 2023, the deterministic quality of causal AI—which determines the precise root cause of an issue—is a key foundation for reliable recommendations that emerge from generative AI technologies. More generally, causal AI can contribute to explainable and fair AI systems. Software development.

Artificial Intelligence 197

Artificial Intelligence Healthcare Retail Government 197

Dynatrace

APRIL 19, 2023

When organizations focus on data privacy by design, they build security considerations into cloud systems upfront rather than as a bolt-on consideration. ” This data is excluded from storage, but teams can still gain value from data enrichment beforehand. Data is segmented and separated based on storage buckets.

Design 181

Design Storage Programming Analytics 181

Percona

SEPTEMBER 19, 2023

This blog post will walk you through how MySQL’s InnoDB redo log archiving uses PXB to manage the redo log files on the busiest systems and look at how a new feature released in PXB version 8.0.34-29 Enabling redo log archiving on the server requires setting a value for the innodb_redo_log_archive_dirs system variable.

C++ 101

C++ Servers Storage Speed 101

Percona

MARCH 13, 2023

First, let’s try streaming copy from mysql57 to mysql8 server as this does not need additional storage. 23) initializing of server in progress as process 6660 2023-03-01T02:38:23.939215Z 1 [System] [MY-013576] [InnoDB] InnoDB initialization has started. Prepare the backup on MySQL 8 with Percona XtraBackup 8.0,

Servers 100

Servers C++ Storage Systems 100

Percona

SEPTEMBER 25, 2023

PostgreSQL is a powerful and popular open source relational database management system. This issue tends to occur when your backup storage is located offsite, your database is quite large, and the backup process generates a lot of files. pgBackRest is a highly efficient and versatile tool for managing PostgreSQL backups.

Database 91

Database Open Source Storage Servers 91

Dynatrace

JULY 11, 2023

The MOVEit vulnerability is a critical SQL injection flaw in the web application MOVEit Transfer , which MITRE published as CVE-2023-34362 on May 31, 2023. On June 6, 2023, the ransomware gang Cl0p claimed responsibility for exploiting the MOVEit Transfer vulnerability starting on May 27, 2023, during the U.S.

Database 150

Database Government Games Servers 150

Dynatrace

JUNE 7, 2023

According to the Kubernetes in the Wild 2023 report, “Kubernetes is emerging as the operating system of the cloud.” Kubernetes also gives developers freedom of choice when selecting operating systems, container runtimes, storage engines, and other key elements for their Kubernetes environments. Ease of use.

Open Source 195

Open Source Social Media Infrastructure Operating System 195

Percona

AUGUST 18, 2023

And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. root@ip-172-31-128-38 share]# cat /usr/lib/systemd/system/mysqld@.service 10-Linux.x86_64.ssl101.tar.gz ln -s /usr/local/Percona-Server-8.0.19-10-Linux.x86_64.ssl101/

Programming 84

Programming Servers Database Hardware 84

Dynatrace

MAY 8, 2023

In fact, the Dynatrace 2023 CIO Report found that 78% of respondents deploy software updates every 12 hours or less. In addition, monitoring DevOps processes provide the following benefits: Improve system performance. Monitoring provides a clearer, more consistent picture of DevOps system performance and overall health.

DevOps 209

DevOps Efficiency Monitoring Infrastructure 209

Percona

MARCH 28, 2023

Every database system has to ensure durability and reliability. In this blog post, we will dive deep into WiredTiger’s Logging and Checkpoint mechanism. MongoDB uses classic Write-Ahead-Logging (WAL) using Journals and Checkpoints. Starting with the basics, why is WAL needed in the first place?

Hardware 85

Hardware C++ Storage Cache 85

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

OCTOBER 17, 2023

Many changes and new features are brought to the system, and as part of keeping in tune with the changes and how they can impact us, we go through the changes to better understand them. Dynamic WiredTiger tickets As a brief recap, WiredTiger tickets in MongoDB serve as the concurrency control mechanism within the WiredTiger storage engine.

Metrics 98

Metrics C++ Storage Database 98

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. According to the 2023 Kubernetes in the Wild report , 65% of organizations use Prometheus.

Metrics 169

Metrics Engineering Energy Tuning 169

Percona

SEPTEMBER 27, 2023

DEFAULT ‘on’::text Because we specified ‘2’ for premake in the create_parent function, you can observe that two partitions ahead have been created, as shown in the table definition below.

Storage 97

Storage Open Source Database Efficiency 97

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 78

C++ Database Storage Testing 78

Percona

MARCH 28, 2023

Taking backup locally with multiple repos: In this example, we have tried to create two repositories in the local backup server itself, namely pgbackrest_repo1 and pgbackrest_repo2.

Servers 81

Servers Azure AWS Cloud 81

Percona

MARCH 30, 2023

Further, open source databases can be modified in infinite ways, enabling institutions to meet their specific needs for data storage, retrieval, and processing. Non-relational databases: Instead of tables, non-relational (NoSQL) databases use document-based data storage, column-oriented storage, and graph databases.

Open Source 73

Open Source Database Storage Scalability 73

Percona

JUNE 23, 2023

It is a good practice to compress the backups to save costs on storage and to encrypt the backups so those can’t be used if the files are compromised as long as you keep your encryption keys safe! ibd.qp.xbcrypt 2023-04-21T00:27:14.875316-00:00 24 [Note] [MY-011825] [Xtrabackup] Compressing and encrypting. dbxxxx/tb1.ibd

Servers 79

Servers Processing Speed Open Source 79

Percona

DECEMBER 27, 2023

As we at Percona wind down 2023 and look into what the next year holds, our attention is drawn to the cloud-native landscape and how it is maturing, growing, and evolving. KubeCon NA 2023 recap The theme for KubeCon NA was very clear — AI and Large Language Models (LLMs). We expect that number to rise higher in 2024.

Cloud 77

Cloud Open Source Strategy Best Practices 77

Percona

JULY 17, 2023

5 among all database management systems and No. 1 among non-relational/document-based systems ( DB-Engines, July 2023 ). Taking a deeper dive, MongoDB is a system for analyzing data because documents are easily shared across multiple nodes and because of its indexing, query-on-demand, and real-time aggregation capabilities.

Open Source 75

Open Source Database Scalability Software 75

Dynatrace

FEBRUARY 15, 2023

Additionally, its modern architecture delivers cost-effective storage and compute. As a result, teams benefit from low-cost cloud storage that provides access to all data and doesn’t require data rehydration. Further, the EdgeConnect capability allows secure connections to on-premises systems.

Analytics 130

Analytics Storage Cloud Code 130

Percona

JULY 5, 2023

EOL is set for the end of October 2023. Now, the first issue with the logical dump restore approach, as somewhat totally expected though, is with system tables. You cannot load a dump of the MySQL system database from MySQL 8.0 Any changes in system tables made since the 8.0 Upgrading to MySQL version 8.0

C++ 115

C++ Database Servers Testing 115

Percona

AUGUST 18, 2023

uses the Aria engine for system tables. 2023-05-12T08:10:38.946611Z 1 [ERROR] [MY-013894] [InnoDB] Found redo log file./ib_logfile0 2023-05-12T08:10:38.946683Z 1 [ERROR] [MY-012930] [InnoDB] Plugin initialization aborted with error Generic error. The incompatibility roadblock MariaDB 10.4

Open Source 65

Open Source Database Storage Engineering 65

Percona

AUGUST 17, 2023

In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ). Craig Kerstiens, crunchydata, August 2023 ) That evolution has created lots of reasons for its expanding popularity.

Open Source 77

Open Source Healthcare Social Media Database 77

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

Percona

NOVEMBER 1, 2023

This blog was originally published in January 2021 and updated in November of 2023. The key question related to RTO is, “How quickly must the data on this system be restored?” Snapshot Backups: Some file system implementations enable “snapshots” to be taken. ” What is the Recovery Point Objective?

Best Practices 77

Best Practices Storage Strategy Database 77

Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Full backups are most suitable for critical systems or sensitive data that cannot afford any loss or downtime, allowing for a complete recovery of data in the event of data corruption, hacking, system failures, or natural disasters.

Storage 66

Storage Strategy Network Efficiency 66

Dynatrace

JUNE 1, 2023

According to the 2023 Dynatrace CIO Report , 78% of respondents deploy software updates every 12 hours or less. It represents the percentage of time a system or service is expected to be accessible and functioning correctly. But how do you get started, and what are some service level objective examples?

Latency 168

Latency Website Traffic Virtualization 168

Dynatrace

JUNE 1, 2023

According to the 2023 Dynatrace CIO Report , 78% of respondents deploy software updates every 12 hours or less. It represents the percentage of time a system or service is expected to be accessible and functioning correctly. 54% deploy updates every two hours or less, and 20% deploy updates every minute or less.

Traffic 173

Traffic Latency Website Virtualization 173

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. As well, very few cases are in need to have a full system/solution to provide scalability with sharding.

Traffic 122

Traffic Scalability Database Servers 122

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. It was a great privilege. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Adrian Cockcroft

APRIL 5, 2023

The usual technique for modeling fuzzy systems is Monte Carlo analysis, which computes with distributions rather than precise values. Energy data can be obtained from power delivery systems in datacenters or from intelligent plugs or power strips. At the one minute granularity security concerns are minimized.

Energy 52

Energy Metrics Cloud Operating System 52

Dynatrace

JANUARY 23, 2024

Enter AI observability, which uses AI to understand the performance and cost-effectiveness details of various systems in an IT environment. In 2023, organizations mostly used these services as a technology disruptor and capability enabler. As organizations adopt more AI technologies, the associated costs are skyrocketing.

Performance 176

Performance DevOps Innovation Artificial Intelligence 176

Percona

JULY 2, 2023

This blog was originally written in September 2018 and was updated in June 2023. In setting up our demonstration system, we use pg_basebackup and continuous archiving. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52