Introduction to Benchmarking in Julia

DZone

open source benchmarking juliaFor the number of years I’ve been programming using Julia, I’ve never really been concerned with performance.

Benchmark Netifi RSocket Broker on Alibaba Cloud

DZone

Recently there has been some discussions around service mesh benchmark tests. performance benchmarking rsocket benchmarking test service mesh architecture netifiPurpose.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

RSocket vs. gRPC Benchmark

DZone

Almost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out. java performance scalability latency cpu grpc rpc qps

Benchmark With JMH

DZone

????????????????????????????. JMH stands for Java Micro-benchmark Harness and is a toolkit used for implementing benchmarks for applications running on JVM.??. performance benchmarking performance engineering jmh microbenchmark

Benchmarking spreadsheet systems

The Morning Paper

Benchmarking spreadsheet systems Rahman et al., construct a set of benchmarks to try and understand what might be going on under the covers in Microsoft Excel, Google Sheets, and LibreOffice Calc. Preprint. A recent TwThread drew my attention to this pre-print paper.

Benchmarking with Postgres PT2

n0derunner

The post Benchmarking with Postgres PT2 appeared first on n0derunner. Databases benchmarks database postgresIn this example we run pgbench with a scale factor of 1000 which equates to a database size of around 15GB. The linux VM has 32G RAM, so we don’t expect to see many reads.

Benchmarking with Postgres PT1

n0derunner

<span style="font-family: Andale Mono;">$ sudo -u postgres createdb <span class="highlight">pgbench-sf10</span></span> Initialise the DB with data ready to run the benchmark. The post Benchmarking with Postgres PT1 appeared first on n0derunner.

Scaling Benchmarks With More Robust UseNUMA Flag in OpenJDK

DZone

java jdk openjdk benchmark nodes performanace jdk11 flag numa lagWhat happens when you run a Java application without checking your hardware configuration? Obviously, your application lags in terms of performance.

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook

The Morning Paper

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. FAST’20. You get good at what you practice.

View from Nutanix storage during Postgres DB benchmark

n0derunner

The post View from Nutanix storage during Postgres DB benchmark appeared first on n0derunner. A quick look at how the workload is seen from the Nutanix CVM. In this example from prior post. The Linux VM running postgres has two virtual disks – one taking transaction log writes.

Introducing Page Speed Benchmarks – a new resource for the performance community

Speed Curve

What are some good sites I can use for benchmarking? Page Speed Benchmarks is an interactive dashboard that lets you explore and compare web performance data for leading websites across several industries – from retail to media. What you can do with these benchmarks: 1.

SQL Server Index Fill factor with Performance Benchmark

SQL Shack

In this article, we will study in detail about the how SQL Server Index Fill factor works. Index Fill factor SQL Server Index Fill Factor is a percentage value to be filled data page with data in SQL Server. This option is available in index properties to manage data storage in the data pages.

Brand-new comparison reports for your Website Performance Benchmarks

Dareboost

With an improved user experience and some additional data available, benchmarking your competition is now easier than ever! A single tool … Continue reading Brand-new comparison reports for your Website Performance Benchmarks → Service Updates

How to maximize CPU performance for PostgreSQL 12.0 benchmarks on Linux

HammerDB

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So now lets see what we get in performance mode, an almost 32% improvement (and 53% higher than the published benchmarks). ./bin/pgbench

Real Time Oracle Performance Monitoring for Benchmarks

HammerDB

Finally like all HammerDB features everything that is available on Linux is equally available on Windows as well so if running an Oracle client on Windows you can access exactly the same features to monitor your benchmark performance in real time.

The top 5 reasons to run your own database benchmarks

HammerDB

This post addresses some of the opinions around database benchmarking and gives the top 5 reasons why industry standard benchmarking is important and should be an essential foundation of your database engineering strategy. So are standard database benchmarks meaningless?

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems

The Morning Paper

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., ASPLOS’19.

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. I have spent much of my career refuting bad benchmarks, and have developed such a knack for it that prior employers would not publish benchmarks unless they were approved by me. These kinds of benchmarks are misleading.

ScyllaDB Trends – How Users Deploy The Real-Time Big Data Database

Scalegrid

In fact, according to ScyllaDB’s performance benchmark report, their 99.9 Amazon AWS Azure Benchmarks Cassandra Cloud Database Google Cloud On-Premise ScyllaDB Trend Report #1. ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. Released just four years ago in 2015, Scylla has averaged over 220% year-over-year growth in popularity according to DB-Engines.

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

High Scalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today?

Improving AWS Performance For The Future

DZone

performance aws refactoring review migration amazon web services optimize improvements well architected framework performance benchmarkThe true power of cloud computing lies in the way it can be optimized for maximum performance and efficiency.

AWS 141

How to improve Redo, Transaction Log and WAL throughput for HammerDB benchmarks

HammerDB

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. .

How to identify NVME drive types and test throughput

n0derunner

NVME Performance Workloads & Benchmarks fio nvme

Memory Bandwidth Requirements of the HPL benchmark

John McCalpin

The High Performance LINPACK (HPL) benchmark is well known for delivering a high fraction of peak floating-point performance. The (historically) excellent scaling of performance as the number of processors is increased and as the frequency is increased suggests that memory bandwidth has not been a performance limiter. But this does not mean that memory bandwidth will *never* be a performance limiter.

The Surprising Effectiveness of Non-Overlapping, Sensitivity-Based Performance Models

John McCalpin

To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It Computer Architecture Performance memory bandwidth memory latency STREAM benchmark

Microsoft diskpd. Part 1 Preparing to test.

n0derunner

diskspd benchmarking storage windowsInstalling Disk-Speed (diskspd).

Speed 52

The Phony Balance Benchmark

Alex Russell

There’s a palpable tension in my shoulders as I tap this out — I know already that this post will create cringe-worthy responses and name calling and all the rest. But on we plod. A friend called out to me a peculiar feature of a conference Program Committee they were serving on: that it was part of the PC’s role to keep a look out for strong minority/female speakers and encourage them to submit to the open CFP.

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

Scalegrid

MySQL Performance Benchmark Configuration. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 144

HammerDB: Avoiding bottlenecks in client.

n0derunner

HammerDB is a great tool for running Database benchmarks. However it is very easy to create an artificial bottleneck which will give a very poor benchmark result. Databases Performance Testing benchmarking database hammerDB sqlserver

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

High Scalability

AWS Amazon RDS Cloud Database DevOps Latency MySQL Performance RDBMS Replication Lag SSD Throughput administration amazon aws benchmark best platform cloud cluster cost savings database database replication database scalability deployment ec2 enterprise high availability hosting master-slave mysql mysql cluster mysql load mysql scalability public cloud sql testingAWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

AWS 150

New (Old) Paper.

n0derunner

A 2007 paper, that still has lots to say on the subject of benchmarking storage and filesystems. Primarily aimed at researchers and developers, but is relevant to anyone about to embark on a benchmarking effort. A Nine year study of filesystem and storage benchmarking Download. Use a mix of macro and micro benchmarks Understand what you are testing, cached results are fine – as long as that is what you had intended.

HCI Performance testing made easy (Part 3)

n0derunner

Creating a HCI benchmark to simulate multi-tennent workloads. The DB Colocation test utilizes two properties of X-Ray not found in other benchmarking tools. Time based benchmark actions. Modeling Workloads & Benchmarks X-Ray benchmarks cloud database hci OLTP x-ray

Why does my SSD not issue 1MB IO’s?

n0derunner

Why do we tend to use 1MB IO sizes for throughput benchmarking? SSD Performance benchmarking kernel linux ssd storageFirst things First. CDC 9762 SMD disk drive from 1974. To achieve the maximum throughput on a storage device, we will usually use a large IO size to maximize the amount of data is transferred per IO request.

Install a bitnami image to Nutanix AHV cluster.

n0derunner

We can use these same appliance images on Nutanix AHV to easily do a Postgres database benchmark. Nutanix ahv benchmark database nutanix postgres

Best Practice for Creating Indexes on your MySQL Tables

High Scalability

AWS Add Index Azure Create Index Database DevOps EC2 Latency Master-Slave MySQL MySQL Index MySQL Performance MySQL Table Performance Performance Test SELECT Queries administration benchmark benchmarks best platform cloud data management database database replication database scalability deployment ec2 high availability hosting indexing master-slave mysql mysql cluster mysql load nodes optimization scalabitliy sql testing uptime

You are here. The art of HCI performance testing

n0derunner

Feeds & Speeds Nutanix Workloads & Benchmarks X-RayAt some point potential Hyper-converged infrastructure (HCI) users want to know – “How fast does this thing go?” ” The real question is “how do we measure that?”

Timing Methodology for MPI Programs

John McCalpin

While working on the implementation of the MPI version of the STREAM benchmark, I realized that there were some subtleties in timing that could easily lead to inaccurate and/or misleading results. Performance Reference STREAM benchmarkThis post is a transcription of my notes as I looked at the issues… Primary requirement: I want a measure of wall clock time that is guaranteed to start before any rank does work and to end after all ranks have finished their work.

Top500 list: a brief introduction

PDC

It ranks the world’s 500 most powerful supercomputers based on their performance as measured by the Linpack benchmark. The performance, R max , is measured by the Linpack benchmark with 64-bit floating point arithmetic. Benchmark Performance Exascale Supercomputer

Percona Database Performance Blog 2018 Year in Review: Top Blog Posts

Percona

In this benchmark, I discovered some interesting discrepancies in performance between AMD and Intel CPUs when running under systemd. Amazon Aurora Amazon RDS AWS Benchmarks Containers MariaDB MongoDB MySQL Performance Tuning

Invited Talk at SuperComputing 2016!

John McCalpin

Computer Architecture Computer Hardware Performance cache DRAM high performance computing memory bandwidth memory latency STREAM benchmark“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm).

Measuring Performance of Your Methods Using JMH in Java

DZone

You may also like: JMH: Benchmark REST APIs. Measure Java performance! From JDK-12 onwards, the JDK comes with JMH (Java Microbenchmark Harness), It is a toolkit that helps you implement Java microbenchmarks correctly.

Java 130

Measuring MySQL Performance in Kubernetes

DZone

I will use a very simple CPU-bound benchmark to measure MySQL performance in OLTP read-only workload: performance mysql deployment kubernetes pods guaranteed qos

Java Performance: For-Looping vs. Streaming

DZone

The traditional way of iterating in Java has been a for-loop starting at zero and then counting up to some pre-defined number: private static final int ITERATIONS = 10_000; @Benchmark public int forUp() { int sum = 0; for (int i = 0; i < ITERATIONS; i++) { sum += i; } return sum; }.

Java 153