Percona

AUGUST 29, 2018

For optimum performance, a PostgreSQL database depends on the operating system parameters being defined correctly. In this post, we will discuss some important kernel parameters that can affect database server performance and how these should be tuned. PostgreSQL uses System V (SysV) that requires SHMMAX setting.

Tuning 58

Tuning Database Servers Processing 58

Dynatrace

MAY 1, 2020

Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java. This is especially the case with microservices and applications created around multiple tiers, where cheaper hardware alternatives play a significant role in the infrastructure footprint.

Java 133

Java Hardware Tuning Metrics 133

Percona

OCTOBER 18, 2023

Parallel run : Operating both the existing and new database system simultaneously during the transition, allowing for a seamless fallback in case of any issues. Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you.

Open Source 96

Open Source Database Hardware Strategy 96

The Netflix TechBlog

NOVEMBER 9, 2021

AV1 playback on TV platforms relies on hardware solutions, which generally take longer to be deployed. Throughout 2020 the industry made impressive progress on AV1 hardware solutions. The Encoding Technologies team took a first stab at this problem by fine-tuning the encoding recipe. Stay tuned!

Media 246

Media Open Source Efficiency Software Engineering 246

Scalegrid

JANUARY 25, 2024

These essential data points heavily influence both stability and efficiency within the system. It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. it signifies memory fragmentation.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

AUGUST 10, 2019

Having the ability to monitor the performance and availability of your organization’s internal applications—in addition to your organization’s customer-facing applications—from within your corporate network is an important benefit of synthetic monitoring. Compliance with hardware requirements. Dynatrace news.

Monitoring 104

Monitoring Hardware Tuning Mobile 104

Dynatrace

SEPTEMBER 29, 2021

Think of containers as the packaging for microservices that separate the content from its environment – the underlying operating system and infrastructure. For a deeper look into how to gain end-to-end observability into Kubernetes environments, tune into the on-demand webinar Harness the Power of Kubernetes Observability.

Open Source 304

Open Source Traffic DevOps Cloud 304

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Log monitoring vs log analytics.

Analytics 211

Analytics Monitoring Artificial Intelligence DevOps 211

Dynatrace

OCTOBER 28, 2021

The crisis could be technical, natural, or malicious events, for example an earthquake affecting data center availability, or a cyberattack infecting applications and websites. Because it can touch many systems, chaos engineering can have broad implications, affecting groups and stakeholders across the organization.

Engineering 228

Engineering Entertainment Cloud Infrastructure 228

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 108

Database Benchmarking Latency C++ 108

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. For example, when running tests, the state of the device will change from “available for testing” to “in test.” In this blog post, we will focus on the latter feature set.

Latency 213

Latency Traffic Transportation Hardware 213

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waiting queries mean waiting applications and users, and no one likes to wait!

Tuning 115

Tuning Servers Monitoring Hardware 115

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. A micro-benchmark suite, LEBench was then built around tee system calls responsible for most of the time spent in the kernel.

Performance 108

Performance Benchmarking Tuning Hardware 108

Percona

JANUARY 4, 2024

In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning.

Storage 92

Storage Engineering Database Hardware 92

Percona

DECEMBER 27, 2023

All of the database automation for running a highly available, resilient, and secure database is built into the operator to simplify the operation and management of your clusters. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 83

Cloud Open Source Strategy Best Practices 83

Dynatrace

NOVEMBER 20, 2019

Having released this functionality in an Early Adopter Release with OneAgent version 1.173 and Dynatrace version 1.174 back in August 2019, we’re now happy to announce the General Availability of OneAgent full-stack monitoring for Linux on the IBM Z platform, sometimes informally referred to as Z/Linux. Host-performance measures.

Availability 31

Availability Hardware Java Tuning 31

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Percona

AUGUST 27, 2018

Resource groups permit assigning threads running within MySQL to particular groups so that threads execute according to the resources available to this group. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth.

Tuning 46

Tuning Virtualization Testing Servers 46

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

OCTOBER 22, 2019

If your system is under high load, it can run into thread-locking issues that prevent upward linear scaling of your application. Many systems don’t scale in a linear fashion because they need to coordinate work across many threads. Dynatrace news. Threads enable your application to execute multiple tasks at the same time.

Java 103

Java Scalability Hardware Architecture 103

The Morning Paper

MAY 21, 2019

” This paper describes a “far memory” system that has been in production deployment at Google since 2016. Zswap is readily available and runs as a swap device in the Linux kernel. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. ML-based auto-tuning.

Software 78

Software Software Google Hardware 78

Dynatrace

AUGUST 8, 2019

We’re happy to announce the Early Adopter Release of OneAgent full-stack monitoring for Linux on the IBM Z platform, sometimes informally referred to as Z/Linux (available with OneAgent version 1.173 and Dynatrace version 1.174). For details on available metrics, see our help page on host performance monitoring.

Availability 25

Availability Hardware Java Tuning 25

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Managed here means that the system automates resource provisioning for models to match a set of SLO constraints (cf. autoscaling).

Hardware 58

Hardware Latency Serverless Energy 58

HammerDB

OCTOBER 18, 2019

So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests. So by default, the system boots into powersave. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00 uname -a Linux ubuntu19 5.3.0-rc3-custom 3834 2696 .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. But wow, I didn’t think we’d be at the point yet where we’d be abandoning TCP/IP!

Network 92

Network Transportation Latency Entertainment 92

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results.

Speed 126

Speed Java AWS Virtualization 126

Percona

AUGUST 29, 2023

Data redundancy, a database version of a RAID Pondering the case of high availability and redundancy, one replicates data by creating a replica via streaming replication. Now let’s stretch our imagination and consider a second method of high availability, ala Citus. The same can be said for Citus data sharding. 1 citus | 11.1-1

C++ 84

C++ Database Storage Testing 84

The Morning Paper

MARCH 17, 2020

One thing they all had in common is an evaluation using some kind of simulation of the expected behaviour of NVDIMMs, because the real thing wasn’t yet available. The Optane DIMM is the first scalable, commercially available NVDIMM. most recently ‘ Efficient lock-free durable sets ‘). But now it is!

Scalability 59

Scalability Latency Cache Media 59

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. It has 32GB RAM, with 24GB available to the SQL Server 2019 instance. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. Final Thoughts.

Servers 86

Servers Tuning Database Efficiency 86

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

HammerDB

JANUARY 5, 2019

As the chart shows because we know that both HammerDB and the implementation of the TPC-C workload scales then we can determine that with this particular database engine both the software and hardware scales as well. If you only test your own application (and if you have more than one application which one will you use for benchmarking?)

Benchmarking 40

Benchmarking Database Social Media Scalability 40

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. For this reason we need to implement our database sessions in the form of operating system threads. To prevent the roundtrip between the client and database becoming the bottleneck.

Programming 67

Programming Benchmarking Virtualization C++ 67

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. System Setup: CPU, Memory and I/O Configuration. hardware limits: 1000 MHz - 3.80

Best Practices 40

Best Practices Scalability Performance C++ 40

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once? Exactly once?

Architecture 80

Architecture Scalability Google Operating System 80

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04

Virtualization 76

Virtualization AWS Engineering Hardware 76