DZone

DECEMBER 14, 2021

Metadata synchronization (sync) is a core feature in Alluxio that keeps files and directories consistent with their source of truth in under-storage systems, thus making it simple for users to reason the data retrieved from Alluxio. Meanwhile, understanding the internal process is important in order to tune the performance.

Design 244

Design Storage Tuning Systems 244

The Netflix TechBlog

MAY 4, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This approach has a handful of benefits.

Traffic 339

Traffic Latency Tuning Systems 339

Percona

APRIL 24, 2023

Indexes are generally considered to be the panacea when it comes to SQL performance tuning, and PostgreSQL supports different types of indexes catering to different use cases. I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them.

Tuning 124

Tuning Cache Storage Database 124

The Netflix TechBlog

MARCH 14, 2023

We implemented a batch processing system for users to submit their requests and wait for the system to generate the output. This limited pilot system greatly reduced the time spent by our users to manually analyze the content. Maintaining disparate systems posed a challenge. Processing took several hours to complete.

Media 291

Media Innovation Energy Architecture 291

HammerDB

APRIL 19, 2023

Predicting application performance is a difficult art, but an important one when choosing the target deployment environment. In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

The Netflix TechBlog

NOVEMBER 6, 2023

We have built an internal system that allows someone to perform in-video search across the entire Netflix video catalog, and we’d like to share our experience in building this system. Building in-video search To build such a visual search engine, we needed a machine learning system that can understand visual elements.

Media 225

Media Social Media Tuning Efficiency 225

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. But often, we use additional services and solutions within our environment for backups, storage, networking, and more.

Metrics 183

Metrics Engineering Energy Tuning 183

Dynatrace

MARCH 15, 2024

Syslog is the go-to protocol that delivers infrastructure administrators, network engineers, and security team logs that tell them all they need to know about their systems’ delivery, performance, availability, and security. Syslog is a protocol with clear specifications that require a dedicated syslog server.

Open Source 206

Open Source Infrastructure Network Government 206

The Netflix TechBlog

SEPTEMBER 24, 2021

The ProRes codec family provides great editing performance and image quality. Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. We took the approach of allocating small or large cloud storage space depending on the actual packaging input size (Figure 2).

Cloud 237

Cloud Media Storage Cache 237

Dynatrace

DECEMBER 5, 2023

This growth was spurred by mobile ecosystems with Android and iOS operating systems, where ARM has a unique advantage in energy efficiency while offering high performance. Huge performance leaps in recent years The top priority is often performance, where ARM resources have improved significantly.

Efficiency 271

Efficiency Architecture Energy Monitoring 271

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. A small percentage of production traffic is redirected to the two new clusters, allowing us to monitor the new version’s performance and compare it against the current version. Canaries and sticky canaries are valuable tools in the system migration process.

Traffic 279

Traffic Metrics Systems Strategy 279

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. PostgreSQL.

Open Source 244

Open Source Tuning C++ Database 244

The Netflix TechBlog

OCTOBER 19, 2020

which is difficult when troubleshooting distributed systems. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Investigating a video streaming failure consists of inspecting all aspects of a member account.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

MAY 1, 2023

Default settings can help you get started quickly – but they can also cost you performance and a higher cloud bill at the end of the month. I’ll show you some MySQL settings to tune to get better performance, and cost savings, with AWS RDS. Want to save money on your AWS RDS bill? IOPs) required by MySQL.

AWS 117

AWS Hardware Storage Tuning 117

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. File System. Storage I/O. We help where we can. .

Tuning 61

Tuning AWS Best Practices Network 61

Dynatrace

JULY 6, 2022

Virtualization has revolutionized system administration by making it possible for software to manage systems, storage, and networks. By removing physical dependencies, automation can help perform SRE at scale. This can reduce labor costs and enhance reliability by enabling systems to self-heal.

Best Practices 193

Best Practices Open Source Tuning Infrastructure 193

Dynatrace

FEBRUARY 14, 2022

Among these, you can find essential elements of application and infrastructure stacks, from app gateways (like HAProxy), through app fabric (like RabbitMQ), to databases (like MongoDB) and storage systems (like NetApp, Consul, Memcached, and InfluxDB, just to name a few). It’s easy—no intermediaries and no redundant moving parts.

Technology 222

Technology Technology Metrics Infrastructure 222

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. File System. Storage I/O. We help where we can. .

Tuning 52

Tuning AWS Best Practices Network 52

The Netflix TechBlog

OCTOBER 27, 2020

Iceberg is widely adopted in Netflix as a data warehouse table format that addresses many of the usability and performance problems with Hive tables. For how our machine learning recommendation systems leverage our key-value stores, please see more details on this presentation.

Latency 243

Latency Storage Big Data Tuning 243

Percona

APRIL 14, 2023

Below, we outline some proactive steps for achieving cost efficiency and maintaining performant database environments amid a turbulent economy: 1. Here are a few ways you can scale down and save: Audit your systems: Auditing your system for unused servers and eliminating those servers can reduce your cloud spend.

Database 80

Database Serverless Tuning Cloud 80

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better.

Tuning 134

Tuning Cache Servers Benchmarking 134

Dynatrace

SEPTEMBER 23, 2020

Operating Systems are not always set up in the same way. Storage mount points in a system might be larger or smaller, local or remote, with high or low latency, and various speeds. Starting with OneAgent version 1.199, the runtime folder is configurable and consequently you can retain your storage mount point setup as-is.

Storage 150

Storage Latency Operating System Network 150

Dynatrace

JUNE 8, 2021

This post was co-authored by Jean-Louis Lormeau, Digital Performance Architect at Dynatrace. . In software we use the concept of Service Level Objectives (SLOs) to enable us to keep track of our system versus our goals, often shown in a dashboard – like below –, to help us to reach an objective or provide an excellent service for users.

Metrics 170

Metrics Tuning Programming Systems 170

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications.

Tuning 44

Tuning Cache Database Storage 44

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Increased collaboration.

Analytics 214

Analytics Monitoring Artificial Intelligence DevOps 214

Percona

AUGUST 7, 2023

Both logs are crucial in the ACID (Atomicity, Consistency, Isolation, Durability) properties of database systems. InnoDB Undo Log The undo log, also known as the rollback segment, is a crucial part of the InnoDB storage engine. In a database system, rollback segments are used to temporarily store undo data during transactions.

Database 94

Database Tuning Storage Open Source 94

Percona

OCTOBER 18, 2023

Community support One of the most significant advantages of open source databases is the expansive global community of users, developers, DBAs, and enthusiasts who collaborate to provide a seemingly never-ending array of how-tos, resources, guidance, and solutions to help you make your database more performant and secure.

Open Source 89

Open Source Database Hardware Strategy 89

The Netflix TechBlog

OCTOBER 15, 2019

Existing Solutions Dual Writes In order to keep two datastores in sync, one could perform a dual write, which is executing a write to one datastore following a second write to the other. Another issue exists for the capture of schema changes, where some systems, like MySQL, don’t support transactional schema changes [1][2].

Transportation 192

Transportation Architecture Processing Storage 192

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Managing a database is hard, as it needs continuous updating, tuning, and monitoring to ensure the performance of your website.

Database 166

Database Cloud Website Azure 166

Dynatrace

APRIL 26, 2022

Understanding why a user is experiencing transactional or performance issues enables organizations to achieve greater observability that goes beyond metrics, traces and logs. Digital experience monitoring (DEM) allows an organization to optimize customer experiences by taking into account the context surrounding digital experience metrics.

Monitoring 209

Monitoring Social Media IoT Metrics 209

The Netflix TechBlog

NOVEMBER 2, 2021

Perceptual quality measurements are used to drive video encoding optimizations , perform video codec comparisons , carry out A/B testing and optimize streaming QoE decisions to mention a few. The coupling problem Until recently, video quality measurements were generated as part of our Reloaded production system.

Media 171

Media Innovation Metrics Latency 171

The Netflix TechBlog

MAY 14, 2021

However, they are scattered across multiple systems, and there isn’t an easy way to tie related messages together. You’re joining tables, resolving status types, cross-referencing data manually with other systems, and by the end of it all you ask yourself why? Things got hairy.

Traffic 160

Traffic Latency Java Google 160

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. Performant – The service would need to be able to maintain consistent performance in the face of diverse customer workloads.

Internet 128

Internet Internet AWS Performance 128

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Percona

DECEMBER 6, 2023

Avoiding unnecessary queries and fetching only the required data can significantly optimize the query’s performance. Use an explain statement in MySQL to understand the query execution plan, offering insights into table access order, index usage, and potential performance bottlenecks.

Strategy 76

Strategy Database Best Practices Tuning 76

Percona

OCTOBER 10, 2023

This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. Reading the below would not make me feel at ease while performing an upgrade: Binary downgrades are no longer supported for MongoDB Community Edition.

Availability 96

Availability Servers Database Open Source 96