Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

SEPTEMBER 19, 2023

Doubly so as hardware improved, eating away at the lower end of Hadoop-worthy work. A single document may represent thousands of features. Google goes a step further in offering compute instances with its specialized TPU hardware. Millions of tests, across as many parameters as will fit on the hardware.

Hardware 97

Hardware Storage Big Data Blockchain 97

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Hardware 213

O'Reilly

NOVEMBER 28, 2023

Even with cloud-based foundation models like GPT-4, which eliminate the need to develop your own model or provide your own infrastructure, fine-tuning a model for any particular use case is still a major undertaking. That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

Percona

AUGUST 27, 2018

MySQL 8 introduced a feature that is explained only in a single documentation page. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. MySQL package installers for Linux systems should set this capability.

Tuning 44

Tuning Virtualization Testing Servers 44

Adrian Cockcroft

JUNE 2, 2023

FSD has a sense of purpose, a planning capability, has real time agency and responds to its environment via an ego model, predicting the behavior of pedestrians and other road users, and is being tuned to drive in a very human way, so that other road users interact with it as a predicable normal driver. Tristan Zajonc, CEO of Continual.ai

Social Media 98

Social Media Innovation Open Source Entertainment 98

Adrian Cockcroft

NOVEMBER 13, 2023

In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down. I’ve written before about how to tune out retry storms.

Energy 52

Energy Cloud Traffic Transportation 52

O'Reilly

OCTOBER 11, 2022

We’ll see it in the processing of the thousands of documents businesses handle every day. meme originated in IT’s transformation from manual system administration to automated configuration management and software deployment. We could see it as an example of 1980s-style “ expert systems ,” based on deterministic business rules.

Games 114

Games Healthcare Processing Retail 114

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

SQL Performance

JUNE 21, 2019

I always check backups first when looking at a new system. Prior to SQL Server 2012, the maximum server memory value only applied to the bufferpool, so customers needed to limit the amount of memory the bufferpool could use to save memory for the operating system and other processes. Memory settings. Statistics. Index maintenance.

Servers 49

Servers Azure Hardware Database 49

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Copyright The information contained in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. Complying with all applicable copyright laws is the responsibility of the user.

Servers 40

Servers Cache Media Hardware 40

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. For this reason we need to implement our database sessions in the form of operating system threads. To prevent the roundtrip between the client and database becoming the bottleneck.

Programming 67

Programming Benchmarking Virtualization C++ 67

John McCalpin

JANUARY 22, 2018

The double-precision matrix multiplication routine “DGEMM” is typically the computational kernel that achieves the highest fraction of peak performance on high performance computing systems. of the “adjusted peak performance”, there is no longer a significant upside to performance tuning. cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Abhishek Tiwari

JULY 12, 2018

In a nutshell, a data pipeline is a distributed system. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. If tuned for performance, there is a good change reliability is compromised - and vice versa. Pipeline reliability and performance go hand in hand.

Latency 63

Latency Analytics Scalability Engineering 63

Smashing Magazine

AUGUST 22, 2021

However, TCP is typically implemented in the operating system’s (OS’) kernel, a secure and more restricted environment, which for most OSes isn’t even open source. As such, tuning congestion logic is usually only done by a select few developers, and evolution is slow. We can also expect QUIC-specific hardware to become available.

Performance 106

Performance Network Latency Servers 106

SQL Server According to Bob

JANUARY 11, 2020

Copyright The information ​​ that is contained ​​ in this document represents the current view of Microsoft Corporation on the issues discussed as of the date of publication. Complying with all applicable copyright laws is the responsibility of the user. ​​ Read it before you read this paper.

Servers 40

Servers Cache Database Media 40

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Document store. Java used to power core file system code. You can reach him at @kpatelwork. Introduction.

Architecture 52

Architecture Cache Azure Storage 52