Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

Scalegrid

JANUARY 25, 2024

It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. Memory RSS (Resident Set Size) is the number of bytes that the operating system has allocated to Redis. it signifies memory fragmentation.

Metrics 130

Metrics Monitoring Latency Cache 130

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. This allows us to know our operating environment and its capability. For storage, FIO is generally used. Operating System: Ubuntu 22.04 Database: MySQL 8.0.31 Be sure to check back.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. Increased collaboration.

Analytics 208

Analytics Monitoring Artificial Intelligence DevOps 208

Dynatrace

APRIL 26, 2022

EM gives visibility into the user device and performance from the endpoint to provide information on CPU, memory, operating systems, storage, security, networks, and whether software is up to date. Endpoint monitoring (EM). Endpoints can be physical (i.e., PC, smartphone, server) or virtual (virtual machines, cloud gateways).

Monitoring 203

Monitoring Social Media IoT Metrics 203

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

JULY 8, 2020

Kubernetes has taken over the container management world and beyond , to become what some say the operating system or the new Linux of the cloud. That’s another example where monitoring is of tremendous help as it provides the current resource consumption picture and help to continuously fine tune those settings. .

Infrastructure 198

Infrastructure Monitoring Cloud Tuning 198

Adrian Cockcroft

JUNE 21, 2022

I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R. We had specializations in hardware, operating systems, databases, graphics, etc. Rich Pettit is one of the best programmers I ever met.

Tuning 52

Tuning Benchmarking Engineering C++ 52

HammerDB

MAY 5, 2019

Also it is interesting to note that the impact of this change was not observed in other databases or other MySQL storage engines such as MyRocks the only noticeable impact with HammerDB workloads occurred in MySQL with InnoDB where in the source code ut0ut.cc So to test I took a system with Skylake CPUs and all storage on a P4800X SSD.

Testing 48

Testing Tuning Latency Storage 48

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 30, 2018

In this benchmark the difference between looking at workload from a SQL commands standpoint vs a row operation standpoint yields the same results, but it is not going to always be the case. Let’s now look at the operating system level. This workload is write intensive by this measure. Not all writes are equal either.

Benchmarking 46

Benchmarking Database Operating System Architecture 46

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

The Netflix TechBlog

SEPTEMBER 24, 2021

From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step. Since not all projects are terabytes projects, allocating the largest cloud storage to all packager instances is not an efficient use of cloud resources.

Cloud 237

Cloud Media Storage Cache 237

SQL Server According to Bob

JANUARY 11, 2020

Subsystem / Path The ​​ I/O subsystem or path ​​ includes ​​ those ​​ components ​​ that are ​​ used to support an I/O operation. Remove the ​​ power cord ​​ that supplies ​​ power to storage devices.

Servers 40

Servers Cache Database Media 40

All Things Distributed

APRIL 9, 2015

The Amazon ML console and API provide data and model visualization tools, as well as wizards to guide you through the process of creating machine learning models, measuring their quality and fine-tuning the predictions to match your application requirements. The Amazon Elastic File System. Details on the AWS Blog. for a while already.

Lambda 123

Lambda Cloud IoT AWS 123

All Things Distributed

OCTOBER 2, 2017

The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit. This was the genesis of the Amazon Dynamo database.

Internet 130

Internet Internet AWS Performance 130

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Optimize on prem cold storage cost.

Architecture 52

Architecture Cache Azure Storage 52