Hardware, Network, Storage and Tuning - Technology Performance Pulse

PostgreSQL vs. Oracle: Difference in Costs, Ease of Use & Functionality

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. There is also a wide network of Oracle partners available to help you negotiate a discount , typically ranging from 15%-30%, though larger discounts of up to 40%-60% are available for larger accounts. Compare Ease of Use.

Open Source

Open Source Tuning C++ Database

Why log monitoring and log analytics matter in a hyperscale world

Dynatrace

NOVEMBER 15, 2021

A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. Logs can include data about user inputs, system processes, and hardware states. Although cold storage and rehydration can mitigate high costs, it is inefficient and creates blind spots.

Analytics

Analytics Monitoring Artificial Intelligence DevOps

How to Assess MySQL Performance

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 4.22 %usr 38.40

Performance

Performance Benchmarking Cache Storage

From Proprietary to Open Source: The Complete Guide to Database Migration

Percona

OCTOBER 18, 2023

Resource allocation: Personnel, hardware, time, and money The migration to open source requires careful allocation (and knowledge) of the resources available to you. Evaluating your hardware requirements is another vital aspect of resource allocation. Look closely at your current infrastructure (hardware, storage, networks, etc.)

Open Source

Open Source Database Hardware Strategy

Crucial Redis Monitoring Metrics You Must Watch

Scalegrid

JANUARY 25, 2024

It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. A higher value for this metric can indicate issues on the master/slave or some network problems. It further causes the slave to serve stale data.

Metrics

Metrics Monitoring Latency Cache

Updated Azure SQL Database Tier Options

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. New Hardware Configuration for Provisioned Compute Tier.

Azure

Azure Database Serverless Hardware

MongoDB Best Practices: Security, Data Modeling, & Schema Design

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. systemctl stop tuned $ systemctl disable tuned Dirty ratio The dirty_ratio is the percentage of total system memory that can hold dirty pages.

Best Practices

Best Practices Design Tuning Database

What Adrian Did Next?—?Part 2?—?Sun Microsystems

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning

Tuning Benchmarking Engineering C++

A case for managed and model-less inference serving

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware

Hardware Latency Serverless Energy

SQL Server I/O Basics Chapter #1

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers

Servers Cache Media Hardware

Egnyte Architecture: Lessons learned in building and scaling a multi petabyte content platform

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture

Architecture Cache Azure Storage

Friends don't let friends build data pipelines

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency

Latency Analytics Scalability Engineering

Solaris to Linux Migration 2017

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. x series.

Virtualization

Virtualization AWS Engineering Hardware

Structural Evolutions in Data

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” Cloud computing?