article thumbnail

Building an elastic query engine on disaggregated storage

The Morning Paper

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. Snowflake is a data warehouse designed to overcome these limitations, and the fundamental mechanism by which it achieves this is the decoupling (disaggregation) of compute and storage. joins) during query processing. Workload characteristics.

Storage 112
article thumbnail

Kubernetes in the wild report 2023

Dynatrace

Accordingly, the remaining 27% of clusters are self-managed by the customer on cloud virtual machines. Of the organizations in the Kubernetes survey, 71% run databases and caches in Kubernetes, representing a +48% year-over-year increase. Java Virtual Machine (JVM)-based languages are predominant.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

View from Nutanix storage during Postgres DB benchmark

n0derunner

The Linux VM running postgres has two virtual disks – one taking transaction log writes. Since the DB is small (50% the size of the Linux RAM) – the database is mostly cached on the read side – so we only see writes going to the DB files. In this example from prior post.

article thumbnail

A MyRocks Use Case

Percona

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes.

Storage 55
article thumbnail

USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon

Brendan Gregg

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

article thumbnail

How to Assess MySQL Performance

HammerDB

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components.

article thumbnail

Percona Monitoring and Management 2 Scaling and Capacity Planning

Percona

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Virtual Memory utilization was averaging 48 GB of RAM. VictoriaMetrics maintains an in-memory cache for mapping active time series into internal series IDs. Capacity planning and setup details We used a dedicated 32-core CPU and 64GB of RAM for our testing.