Percona

AUGUST 29, 2018

In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. SHMMAX is a kernel parameter used to define the maximum size of a single shared memory segment a Linux process can allocate. A page is a chunk of RAM that is allocated to a process.

Tuning 55

Tuning Database Servers Processing 55

The Netflix TechBlog

JANUARY 13, 2022

We have now moved to a more systematic approach where unknown errors are fed into a Machine Learning process that performs clustering to propose new regular expressions for commonly occurring errors. In the future, we are looking to automate this process. Expand Pensive with Machine Learning classifiers.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

OCTOBER 2, 2023

Limits of a lift-and-shift approach A traditional lift-and-shift approach, where teams migrate a monolithic application directly onto hardware hosted in the cloud, may seem like the logical first step toward application transformation. Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices.

Architecture 231

Architecture Artificial Intelligence Cloud Open Source 231

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. of PostgreSQL users are currently in the process of migrating to the RDBMS, according to the 2019 PostgreSQL Trends Report , an astounding percentage considering this is the 4th most popular database in the world.

Open Source 244

Open Source Tuning C++ Database 244

Percona

OCTOBER 18, 2023

It’s a complex process involving various factors and meticulous planning. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier. Evaluating your hardware requirements is another vital aspect of resource allocation.

Open Source 91

Open Source Database Hardware Strategy 91

Dynatrace

MAY 1, 2020

This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint. Network measurements with per-interface and per-process resolution. Network metrics are also collected for detected processes.

Java 133

Java Hardware Tuning Metrics 133

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. You can find out which functions experience the highest failure rate or processing time and which of them are executed the most. So stay tuned!

Serverless 236

Serverless Azure Monitoring Lambda 236

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. This plays a crucial role in supervising the replication process.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

NOVEMBER 15, 2021

Logs can include data about user inputs, system processes, and hardware states. Log monitoring is a process by which developers and administrators continuously observe logs as they’re being recorded. Log analytics is the process of evaluating and interpreting log data so teams can quickly detect and resolve issues.

Analytics 208

Analytics Monitoring Artificial Intelligence DevOps 208

All Things Distributed

MARCH 19, 2018

Bill Simmons, CTO of Dataxu, states, "We process 3 million ad requests a second - 100,000 features per request. In other words, processing the 10th gigabyte and 1000th gigabyte is conceptually the same. To seamlessly switch between CPU and GPU machines, we use Apache MXNet to interface with the underlying hardware.

Scalability 159

Scalability Hardware AWS Tuning 159

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. On the exact same hardware, the benchmark suite is then used to test 36 Linux release versions from 3.0 Headline results.

Performance 108

Performance Benchmarking Tuning Hardware 108

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post.

Latency 213

Latency Traffic Transportation Hardware 213

Percona

AUGUST 27, 2018

assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. Good examples are: ETL processes for data archiving, reporting, data consolidation and so on. Currently, CPU affinity (i.e., What is the possible usage?

Tuning 44

Tuning Virtualization Testing Servers 44

Percona

DECEMBER 27, 2023

Most organizations are embracing DevSecOps, a term that covers processes and tooling enabling security to be integrated into the application development life cycle rather than treated as a separate process. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic.

Cloud 79

Cloud Open Source Strategy Best Practices 79

Percona

NOVEMBER 3, 2023

About the cluster Following a step-by-step process, the objective is to create a four-node cluster consisting of: PostgreSQL version 15 Citus extension (I’ll be using version 11, but there are newer ones available.) psql pgbench <<_eof1_ qecho adding node citus3.

Database 104

Database Benchmarking Latency C++ 104

Dynatrace

OCTOBER 26, 2020

So stay tuned. For all the hardware geeks – here is the architectural overview of his project: Architectural overview of all involved components in his COVID-19 home innovation project. If you want to replicate Christians work – here are the software and hardware specs: Hardware. Goal: sending metrics to Dynatrace.

Innovation 153

Innovation Metrics Hardware Games 153

Dynatrace

AUGUST 12, 2020

With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. You can find out which functions experience the highest failure rate or processing time and which of them are executed the most. So stay tuned!

Serverless 141

Serverless Azure Monitoring Lambda 141

DZone

AUGUST 16, 2019

It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system. Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM).

Scalability 145

Scalability Efficiency Hardware Software 145

Percona

JANUARY 4, 2024

Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning. mysql> SHOW VARIABLES LIKE 'innodb_directories'; + --+ -+ | Variable_name | Value | + --+ -+ | innodb_directories | | + --+ -+ 1 row in set (0.00

Storage 87

Storage Engineering Database Hardware 87

Dynatrace

OCTOBER 28, 2021

The discoveries form inputs into the software development and delivery process, so new software and microservices will better stand up to unforeseeable events. To mitigate damage to production environments, chaos engineers start in a non-production environment, then slowly extend to production in a controlled way.

Engineering 224

Engineering Entertainment Cloud Infrastructure 224

HammerDB

APRIL 19, 2023

In the context of MySQL performance evaluation, it simulates a typical online transaction processing (OLTP) workload on your MySQL database. The OLTP workload simulates a typical online transaction processing workload, where multiple clients execute transactions on a database concurrently. Instead, use the default settings. and 8.0.32

Performance 54

Performance Benchmarking Cache Storage 54

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc. that a lot of people used.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Dynatrace

OCTOBER 22, 2019

Ultimately, it leads to a state where your system won’t be able to process more data even if you add more hardware. Now, let’s look at a Cassandra process group and see if we can find any CPU-hungry threads and thread groups. Such behavior not only limits speed but also your ability to increase throughput by adding resources.

Java 103

Java Scalability Hardware Architecture 103

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

NOVEMBER 10, 2019

Snap’s architecture is a composition of recent ideas in user-space networking, in-service upgrades, centralized resource accounting, programmable packet processing, kernel-bypass, RDMA functionality, and optimized co-design of transport, congestion control and routing. It reminds me of ZeroMQ. Snap’s control plane is orchestrated via RPCs.

Network 92

Network Transportation Latency Entertainment 92

The Morning Paper

MAY 21, 2019

Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. ML-based auto-tuning. This model is used by a Gaussian Process (GP) Bandit machine learning model to guide the parameter search towards an optimal point with a minimal number of trials.

Software 78

Software Software Google Hardware 78

John McCalpin

APRIL 25, 2023

This metric is interesting because we don’t always have the luxury of parallelizing every application we run, and our operating systems almost always process each call (e.g., Stay tuned! This post is about a secondary performance characteristic — sustained memory bandwidth for a single thread running on a single core.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Alex Podelko

OCTOBER 20, 2016

System’s configuration is not given anymore and often can’t be easily mapped to hardware. As already mentioned, performance testing is rather a performance engineering process (with tuning, optimization, troubleshooting and fixing multi-user issues) eventually bringing the system to the proper state rather than just testing.

Performance Testing 100

Performance Testing Architecture Testing Performance 100

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Adrian Cockcroft

JUNE 2, 2023

FSD has a sense of purpose, a planning capability, has real time agency and responds to its environment via an ego model, predicting the behavior of pedestrians and other road users, and is being tuned to drive in a very human way, so that other road users interact with it as a predicable normal driver.

Social Media 98

Social Media Innovation Open Source Entertainment 98

All Things Distributed

NOVEMBER 30, 2016

There are many more application areas where we use ML extensively: search, autonomous drones, robotics in fulfillment centers, text processing and speech recognition (such as in Alexa) etc. Effectively applying AI involves extensive manual effort to develop and tune many different types of machine learning and deep learning algorithms (e.g.

AWS 165

AWS Lambda Artificial Intelligence Mobile 165

Percona

AUGUST 5, 2023

This means that multiple partitions can be processed simultaneously, making better use of available hardware resources and further enhancing query performance. Special considerations are needed to ensure these processes still work seamlessly after partitioning. Documentation : Always be documenting!

Strategy 40

Strategy Storage Database Best Practices 40

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The Sort only has 19 rows to process, so it consumes only 1ms or so. The parallel column store aggregate push down result of 57 million rows processed in 7ms (using 40ms of CPU) is remarkable, especially considering the hardware.

Servers 86

Servers Tuning Database Efficiency 86

Dotcom-Montior

NOVEMBER 11, 2020

Serverless computing can be a huge benefit to organizations that don’t have the necessary resources or teams to manage physical resources, like servers/hardware, and all the maintenance and licensing that goes along with that, allowing them to focus on developing their code and applications. Benefits of a Serverless Model.

Serverless 57

Serverless Monitoring Lambda Latency 57

SQL Performance

JUNE 21, 2019

Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Part of that process is his Index Optimize procedure, which can take additional parameters to update statistics.

Servers 49

Servers Azure Hardware Database 49

Dynatrace

NOVEMBER 20, 2019

The IBM Z platform is a range of mainframe hardware solutions that are quite frequently used in large computing shops. Typically, these shops run the z/OS operating system, but more recently, it’s not uncommon to see the Z hardware running special versions of Linux distributions. Stay tuned for more announcements on this topic.

Availability 31

Availability Hardware Java Tuning 31

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40