The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. On the exact same hardware, the benchmark suite is then used to test 36 Linux release versions from 3.0 Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

The Netflix TechBlog

AUGUST 30, 2021

By Benson Ma , Alok Ahuja Introduction At Netflix, hundreds of different device types, from streaming sticks to smart TVs, are tested every day through automation to ensure that new software releases continue to deliver the quality of the Netflix experience that our customers enjoy. In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Hardware 213

Scalegrid

JANUARY 25, 2024

Evaluating the total commands processed per second entails tracking server workload by observing its request-handling capabilities via different techniques such as immediate metric measurements, continuous real-time data flow using MONITOR command, or testing simulated workloads with the Redis benchmark program.

Metrics 130

Metrics Monitoring Latency Cache 130

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Please refer to this tuning guide to tune the system for HammerDB: Open Source Database Tuning Guide on 3rd Generation Intel® Xeon® Scalable Processors Based Platform. 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

KeyCDN

AUGUST 15, 2019

Web performance is a broad subject, and you’ll find no shortage of performance testing tips and tutorials all over the web. Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Sutter's Mill

NOVEMBER 11, 2023

Instead, you want a library that is tuned for your target hardware architecture and ready for par_unseq vectorized algorithms, for blazing speed. The work ended up taking not quite an hour, including to update the repo’s own code where I’m using contracts myself in the compiler and its unit tests. This is that library.

C++ 107

C++ Lambda Network Programming 107

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. Test Environment. Each test result represents the best of ten runs, with all required data and index pages in memory. Cost" column shows the optimizer's cost estimate for each query as reported on the test system. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Percona

JANUARY 19, 2023

Example: Creating four simple tables to store strings but using different data types: db1 test> CREATE TABLE tb1 (id int auto_increment primary key, test_text char(200)); Query OK, 0 rows affected (0.11 sec) db1 test> CREATE TABLE tb2 (id int auto_increment primary key, test_text varchar(200)); Query OK, 0 rows affected (0.05

Open Source 89

Open Source Storage Database Big Data 89

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. Testing Hell Testing and quality assurance with data pipeline is a nightmare.

Latency 63

Latency Analytics Scalability Engineering 63

KeyCDN

SEPTEMBER 20, 2018

Not all back-end errors affect the user experience, but keeping track of them can prove helpful when tuning your app. Monitoring errors on the front-end requires a bit more work because front-end performance is highly dependant on the user’s hardware, software and connection. Manual Testing 5.

Strategy 67

Strategy Monitoring Website Google 67

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. The optimal value can be decided after testing multiple settings, starting from eight is a good choice. If you see concurrency issues, you can tune this variable.

Performance 126

Performance Hardware Tuning Storage 126

O'Reilly

JANUARY 16, 2024

These long solo drives were the perfect opportunity to test out ChatGPT’s voice feature because I couldn’t interact with the app using my hands for safety reasons. software” rather than “hardware” in our brains). would do if I were on a noisy phone connection with someone and didn’t hear them clearly.

Entertainment 72

Entertainment Internet Internet Design 72

Percona

OCTOBER 18, 2023

This approach can minimize complexities but requires complete confidence in your preparations, tests, and abilities. Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. Should I be bringing in external experts to help out?

Open Source 93

Open Source Database Hardware Strategy 93

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. remove the dependency on the monolith after all testing is successful. create a microservice; 2.

Architecture 242

Architecture Artificial Intelligence Cloud Open Source 242

O'Reilly

NOVEMBER 28, 2023

Unexpected outcomes, security, safety, fairness and bias, and privacy are the biggest risks for which adopters are testing. Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

Dynatrace

MAY 1, 2020

This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint. The initial release of OneAgent for the ARM platform with OneAgent version 1.191 is certified and tested to work on SUSE Enterprise Linux 15.x,

Java 134

Java Hardware Tuning Metrics 134

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Then we need to see IF implementing the tuning will work or not. Currently, CPU affinity (i.e., Will this work? test4 run both to see what happen with RG.

Tuning 45

Tuning Virtualization Testing Servers 45

Dynatrace

SEPTEMBER 29, 2021

Container technology is very powerful as small teams can develop and package their application on laptops and then deploy it anywhere into staging or production environments without having to worry about dependencies, configurations, OS, hardware, and so on. The time and effort saved with testing and deployment are a game-changer for DevOps.

Open Source 310

Open Source Traffic DevOps Cloud 310

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. Google goes a step further in offering compute instances with its specialized TPU hardware. You can download these models to use out of the box, or employ minimal compute resources to fine-tune them for your particular task.

Hardware 97

Hardware Storage Big Data Blockchain 97

The Netflix TechBlog

APRIL 29, 2019

Such applications track the inventory of our network gear: what devices, of which models, with which hardware components, located in which sites. Our Infrastructure Security team leverages Python to help with IAM permission tuning using Repokid. We leverage Python to protect our SSH resources using Bless.

Open Source 279

Open Source Network Infrastructure Big Data 279

All Things Distributed

MARCH 19, 2018

Amazon SageMaker training supports powerful container management mechanisms that include spinning up large numbers of containers on different hardware with fast networking and access to the underlying hardware, such as GPUs. Post-training model tuning and rich states. This can all be done without touching a single line of code.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Whether a situation arises during development, testing, deployment, or in production, it’s important to work with a solution that can detect conditions in real-time so teams can troubleshoot issues before they slow down development or impact customers.

Analytics 218

Analytics Monitoring Artificial Intelligence DevOps 218

Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop. This will slow this test a little.) But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

Dynatrace

OCTOBER 26, 2020

Christian Inzko , Performance Engineer out of our Klagenfurt Lab, is running a lot of performance tests to validate performance and scalability of our Dynatrace clusters. For some of these tests, he’s using the open source tool Apache JMeter. So stay tuned. Goal: sending metrics to Dynatrace. Raspberry Pi Model 3 B.

Innovation 159

Innovation Metrics Hardware Games 159

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. From extensive A/B testing, P was empirically determined to be 0.2%/minute. ML-based auto-tuning. The following chart shows an A/B test result for Bigtable with and without zswap enabled. min promotion rate though?

Software 78

Software Software Google Hardware 78

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 5, 2023

This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. Test, Test, and Test Again : Before implementing partitioning in production, thoroughly test it in a controlled environment. Periodically review and adjust.

Strategy 40

Strategy Storage Database Best Practices 40

DZone

AUGUST 16, 2019

It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system. Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM).

Scalability 145

Scalability Efficiency Hardware Software 145

Dynatrace

OCTOBER 22, 2019

Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. Based on this, you can go back and test different ways to write this code. Among other things, you’ll also be able to understand which thread is responsible for high allocation pressure, so stay tuned.

Java 103

Java Scalability Hardware Architecture 103

Dotcom-Montior

OCTOBER 12, 2017

Setup Load Test. Recorded EasyTravel testing script. Setup load test scenario and execute the test. LoadView – Create load testing script. LoadView – Execute Load Test. LoadView is a SaaS based load testing platform fully equipped with protocol, headless or full browser based user simulation techniques.

AWS 40

AWS Tuning Monitoring Servers 40

HammerDB

OCTOBER 18, 2019

Well its difficult to be entirely sure however the tests have all the characteristics of tests observed previously where the CPUs are running in powersave mode. So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests.

Benchmarking 63

Benchmarking Performance Hardware C++ 63

HammerDB

FEBRUARY 25, 2021

HammerDB is a load testing and benchmarking application for relational databases. All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). For HammerDB both TPROC-C and TPROC-H run all of their workloads on the database being tested in SQL. and the following from TPROC-H.

Programming 67

Programming Benchmarking Virtualization C++ 67

Dynatrace

NOVEMBER 20, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements on this topic.

Availability 32

Availability Hardware Java Tuning 32

SQL Performance

JUNE 21, 2019

Managed Instance sets a max server memory value based on the deployed tier, however when I tested resizing the environment, the max memory value was not dynamically changed. If you have big physical hardware with defaults, then you should look at optimizing MAXDOP. With modern hardware, the cost estimation of 5 is outdated.

Servers 49

Servers Azure Hardware Database 49

HammerDB

JANUARY 5, 2019

If you change something and re-run the same test the difference in the results can be attributed to the changes you made. Consequently over time you have a reference point “set in stone” from which future changes can be measured by running the same test. Scalability. can you be sure that it scales?

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 29, 2023

Depending on the configuration, one can tune a hardware RAID for either performance or redundancy. Now let’s stretch our imagination and consider a second method of high availability, ala Citus. The best way to describe the Citus way of doing things is to reflect how data is managed by a disk RAID array.

C++ 80

C++ Database Storage Testing 80