Dynatrace

OCTOBER 28, 2021

The science has spawned specialized chaos engineers who dedicate themselves to disrupting cloud software and the on-prem systems they interact with to make them resilient. Because it can touch many systems, chaos engineering can have broad implications, affecting groups and stakeholders across the organization. Lack of observability.

Engineering 225

Engineering Entertainment Cloud Infrastructure 225

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Optimized system performance. What is log monitoring? Log monitoring vs log analytics.

Analytics 209

Analytics Monitoring Artificial Intelligence DevOps 209

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results.

Speed 40

Speed Java AWS Virtualization 40

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. A micro-benchmark suite, LEBench was then built around tee system calls responsible for most of the time spent in the kernel.

Performance 108

Performance Benchmarking Tuning Hardware 108

Percona

DECEMBER 27, 2023

Another significant issue within security concerns is the escalating complexity of modern systems, especially in platforms like Kubernetes, which highlights the need for unified threat models and scanning tools to address vulnerabilities. Creating repositories for memory-safe patterns in cloud systems to improve overall security.

Cloud 82

Cloud Open Source Strategy Best Practices 82

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. In order to speed up the benchmark indexes must be added. Repeating the benchmark once again demonstrates that performance has degraded somewhat.

Database 107

Database Benchmarking Latency C++ 107

Percona

JANUARY 4, 2024

In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables. Flexible location : Data files can reside within the MySQL data directory or an independent location, enabling finer control over storage management and performance tuning.

Storage 91

Storage Engineering Database Hardware 91

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. sysbench is a widely used open-source benchmarking tool that is designed to evaluate the performance of CPU, memory, disk I/O, and database systems. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

OCTOBER 22, 2019

If your system is under high load, it can run into thread-locking issues that prevent upward linear scaling of your application. Many systems don’t scale in a linear fashion because they need to coordinate work across many threads. Such behavior not only limits speed but also your ability to increase throughput by adding resources.

Java 103

Java Scalability Hardware Architecture 103

The Morning Paper

MAY 21, 2019

.” This paper describes a “far memory” system that has been in production deployment at Google since 2016. Using zswap means that no new hardware solutions are required, enabling rapid deployment across clusters. The system also collects per-job cold-page histograms for a given set of predefined cold age thresholds.

Software 78

Software Software Google Hardware 78

The Morning Paper

NOVEMBER 10, 2019

It’s been clear for a while that software designed explicitly for the data center environment will increasingly want/need to make different design trade-offs to e.g. general-purpose systems software that you might install on your own machines. ” That’s 4-8x the speed of evolution and feedback cycles.

Network 92

Network Transportation Latency Entertainment 92

Adrian Cockcroft

JUNE 2, 2023

My talk was on Innovation and Tipping Points, the first half was based on some content I’ve given before on how to get out of the way of innovation by speeding up time to value or idea to implementation. This is disrupting journalism, education, marketing, and search engine optimization, as well as causing concerns around deep fake images.

Social Media 98

Social Media Innovation Open Source Entertainment 98

HammerDB

OCTOBER 18, 2019

So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests. So by default, the system boots into powersave. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00 uname -a Linux ubuntu19 5.3.0-rc3-custom 3834 2696 .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. This machine has four i7 CPUs (hyperthreaded to 8) with a base speed of 2.4GHz. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism.

Servers 86

Servers Tuning Database Efficiency 86

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

SQL Performance

JUNE 21, 2019

I always check backups first when looking at a new system. Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Memory settings. Statistics. Index maintenance.

Servers 49

Servers Azure Hardware Database 49

Percona

AUGUST 29, 2023

Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables. Depending on the configuration, one can tune a hardware RAID for either performance or redundancy. The same can be said for Citus data sharding. But with Citus, we’ve raised the bar.

C++ 83

C++ Database Storage Testing 83

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

HammerDB

OCTOBER 12, 2018

As with the previous guides as an Intel employee (#IAMINTEL) the examples are taken from a MySQL 8 on Linux on Intel system and the approach is the same for whatever system you are testing although some of the settings you see may be different. System Setup: CPU, Memory and I/O Configuration. hardware limits: 1000 MHz - 3.80

Best Practices 40

Best Practices Scalability Performance C++ 40

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

All Things Distributed

MARCH 19, 2018

" To make things even more challenging, a system that can handle a single large training job is not nearly good enough if training jobs are slow or expensive. This post lifts the veil on some of the scientific, system design, and engineering decisions we made along the way. Post-training model tuning and rich states.

Scalability 159

Scalability Hardware AWS Tuning 159

Smashing Magazine

AUGUST 22, 2021

A Primer on Speed. Discussing performance and “speed” can quickly get complex, because many underlying aspects contribute to a web-page loading “slowly”. It is physically limited by the speed of light or, practically, how fast signals can travel in wires or in the open air. also “only” take two round trips ((b) is rarely shown).

Performance 105

Performance Network Latency Servers 105

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Java used to power core file system code. What is the name of your system and where can we find out more about it?

Architecture 52

Architecture Cache Azure Storage 52