Scalegrid

OCTOBER 24, 2019

xlarge (Multi-AZ). Multi-AZ Deployment with 1 Read Replica. Each scenario is run with varying number of sysbench client threads ranging from 50 to 400, and each test is run for a duration of 10 minutes. This is almost a 200% increase over MySQL RDS performance which averages only 9,411 QPS across the same range of threads.

AWS 183

AWS Latency Performance Benchmarking 183

Randon ASCII

JANUARY 17, 2023

Some of the SearchApp threads were named (yay!) but not all of them were and I couldn’t find the main thread to see what it was waiting on, so I had to poke around and hope something became obvious. but the main thread was easily identifiable as the one using the most CPU time. So now we understand the problem. Conclusions.

Programming 114

Programming Processing Code Performance 114

Percona

MARCH 21, 2023

By default, the replication threads use the privileges of the MySQL user account configured for replication. The replication threads will use the limited privileges of the PRIVILEGE_CHECKS_USER account, which can help prevent the execution of unauthorized SQL statements or the manipulation of sensitive data.

Storage 84

Storage Open Source Database Engineering 84

Smashing Magazine

JUNE 30, 2021

There is a way to break from running in lock-step with the browser’s rendering thread. We can move some of our code to a different thread. A web worker can be constructed by passing in the path to a separate JavaScript file that will be loaded and run in this newly created thread: const worker = new Worker("./worker.js");

Games 145

Games Architecture Code C++ 145

The Morning Paper

MAY 16, 2019

A major design goal of Go is to improve traditional multi-threaded programming languages and make concurrent programming easier and less error-prone. Goroutines are lightweight user-level threads (‘green’ threads). Goroutines are lightweight user-level threads (‘green’ threads). and 43% of all usages.

Programming 100

Programming C++ Design Code 100

Dynatrace

APRIL 21, 2021

FID issues are mostly caused by heavy JavaScript execution and to reduce delays, Connett recommends: Minimizing main thread work. Multi-dimensional analysis — Analyze CWV over time by key dimensions, properties, and values. For websites, the ideal FID is less than 100 milliseconds. Keeping request counts low. In a word, everywhere.

Metrics 134

Metrics Google Website Speed 134

Adrian Cockcroft

MAY 23, 2022

One of those trends was parallel and multi-threaded processing, and I led our early use of the Inmos Transputer and Occam language on some projects, including spinning off a startup called Niche Technology so that we could do development work for them.

C++ 98

C++ Software Engineering Education Engineering 98

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. However, Redis, with its single-threaded architecture, may encounter bottlenecks with large numbers of concurrent connections.

Cache 130

Cache Storage Scalability Architecture 130

DZone

FEBRUARY 14, 2024

The hurdle arises from the complexity of Redis' horizontal scaling model: Redis is mostly single-threaded, unable to fully utilize modern multi-core servers. We have optimized Dragonfly, a modern multi-threaded drop-in replacement for Redis that can be used as a backend data store for Sidekiq, to address these scaling challenges.

Servers 226

Servers 226

The Netflix TechBlog

APRIL 17, 2019

Moreover, we expect multi-core platforms be prevalently used for video encoding in the future, which makes it important to test new tools in an architecture supporting many threads. It can be argued that extensive parallelization may have compression efficiency trade-offs but it also allows testing more encoding options.

Open Source 166

Open Source Scalability Speed Efficiency 166

Percona

JUNE 23, 2023

When you look at the multi-version concurrency control (MVCC) design that PostgreSQL uses and compare it to the designs of other databases, it looks chaotic. MySQL uses a pool of threads, which is much less work for the server than PostgreSQL’s needing to fork off a process to make the connection.

Database 118

Database Transportation Servers Cloud 118

The Netflix TechBlog

OCTOBER 15, 2019

We have observed a series of distinct patterns which have tried to address multi-datastore synchronization, such as dual writes, distributed transactions, etc. In addition, we support Cassandra (multi-master). Typically when using multiple datastores, one of them acts as the primary store, and the others as derived stores.

Transportation 192

Transportation Architecture Processing Storage 192

Wayfair Tech

FEBRUARY 29, 2016

Statsdcc is a Statsd-compatible high performance multi-threaded network daemon written in C++. It aggregates stats and sends the results to backends, especially Graphite. We are proud to announce that we are opensourcing it today. Check out the code at [link] At Wayfair we’re big believers in “measure anything, measure everything,” as.

C++ 40

C++ Network Code Performance 40

SQL Performance

JULY 3, 2019

The documentation for the ORM they are using clearly states that when any multi-entity action occurs, it is performed inside of a transaction. It always pays to investigate why the blocking thread isn't able to release its locks quickly.

Servers 64

Servers Hardware Code Virtualization 64

Dynatrace

FEBRUARY 1, 2024

When looking for the unknown, you often stumble upon an unexpected thread of evidence that sparks a new idea and takes the investigation in a new direction. Enabling the multi-line content details view shows the stack traces with their line breaks in their original form, enabling you to understand the data much faster.

Speed 202

Speed Games Efficiency Processing 202

Percona

DECEMBER 11, 2023

Benchmark results for DLV-enabled instance vs. standard instance Write-only traffic Read-write traffic Read-only traffic Benchmarking analysis For both read-only and read-write traffic, there is a constant improvement in the QPS counters as the number of threads increases.

AWS 93

AWS Benchmarking Performance Traffic 93

Adrian Cockcroft

JUNE 21, 2022

He became a leading expert in Solaris multi-threading. Phil Harman is a friend of mine from Sun UK, we were the two most senior systems engineers in the UK at the time I left for the USA, and he came over on rotation a few times.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Netflix TechBlog

MARCH 13, 2020

Compared to the most recent master version of libaom (AV1 reference software), SVT-AV1 is similar in compression efficiency and at the same time achieves significantly lower encoding latency on multi-core platforms when using its inherent parallelization capabilities. A single-threaded compression mode is used.

Open Source 154

Open Source Efficiency C++ Speed 154

Percona

SEPTEMBER 1, 2023

Thread concurrency settings dictate the number of simultaneous connections MySQL can handle efficiently, and transaction isolation levels, such as Read Committed or Repeatable Read, affect how locking mechanisms operate, impacting concurrency and query execution speed. Note that this requires either ROW or MIXED binlog format.

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

AUGUST 18, 2019

name[tid] thread-local. See the tutorial for an explanation of each of these. ## Provided Tools Apart from one-liners, bpftrace programs can be multi-line scripts. When you write bpftrace programs, try to use the static types first, before the dynamic ones, so that your programs are more stable. ## Variable Types. Variable Description.

Latency 68

Latency C++ Cache Programming 68

Percona

FEBRUARY 24, 2023

For example, an Amazon Elastic Compute Cloud (EC2) instance with Graviton2 processors will be a better choice than non-ARM options, as it’s cheaper, and you will get real and faster cores which means the CPU cores are physical and not with hyper-threading. Multi-AZ deployments offer advantages, especially for HA and disaster recovery.

Cloud 116

Cloud Serverless AWS Storage 116

Randon ASCII

OCTOBER 4, 2020

This actually shouldn’t be done very often – threads should normally be waiting on events rather than timers – but it is sometimes necessary. Ideally the CPU goes to sleep when Sleep(1) is called, in order to save power, so how does the operating system (OS) wake your thread if the CPU is sleeping? The answer is hardware interrupts.

Programming 145

Programming Games Hardware Operating System 145

Sutter's Mill

MAY 28, 2012

Mainstream hardware – many kinds of parallelism: What’s the relationship among multi-core CPUs, hardware threads , SIMD vector units (Intel SSE and AVX , ARM Neon ), and GPGPU (general-purpose computation on GPUs, which I covered at C++ and Beyond 2011 )?

C++ 40

C++ Hardware Best Practices Tuning 40

Scalegrid

JANUARY 8, 2019

The first consideration is to handle the ‘semi’ behavior of semisynchronous replication which only guarantees that the data has been received and flushed to the relay logs by the I/O thread of the slave, but not necessarily committed by the SQL thread. This is necessary to preserve data consistency. slave_preserve_commit_order = 1.

Availability 113

Availability Tuning Speed Network 113

High Scalability

NOVEMBER 9, 2018

Paul Alcorn ~ The 7nm Rome CPUs come with 64 physical Zen 2 cores, which equates to 128 threads per processor, double that of the first-gen Naples chips. In a two socket server, that equates to 128 physical cores and 256 threads in a single box. MLPerf's deadline is also soon ([link] ). Rome is also the first PCIe 4.0

Internet 192

Internet Internet Scalability Blockchain 192

Randon ASCII

OCTOBER 28, 2019

That is, it allocates additional per-thread lists of free memory in order to maximize parallelism, but this means (again, on my multi-core many-GB workstation) that more than half of the heap memory is not actually in use. On my workstation (your mileage may vary) the Windows heap seems to be tuned to trade memory for performance.

Processing 47

Processing Programming Tuning Availability 47

Percona

MARCH 23, 2023

innodb_autoinc_lock_mode (Static) – Setting the value to ‘2’ (interleaved mode) can remove the need for an auto-inc lock (at the table level) and can increase performance when using multi-row insert statements to insert values into a table with an auto-increment primary key. for more information on configuration.

Performance 123

Performance Hardware Tuning Storage 123

High Scalability

SEPTEMBER 7, 2018

Once inside the function, there's nothing wrong with multi-threading to do the work as efficiently as possible. Whod a thought that one would be able to run an 8-core/16-thread CPU at full load at only 85W and still reap. @sapessi : Lambda simplifies concurrency at the frontend, enforcing one event per function at a time.

Internet 137

Internet Internet Scalability Lambda 137

SQL Performance

MAY 3, 2021

It’s a basic tenet of computer science that whenever a data structure exists in a multi-threaded system, the data structure must be protected in some way. This protection gives the following provisos: (Guaranteed) A data structure cannot be changed by a thread while another thread is reading it. Acquiring a Latch.

Servers 98

Servers Tuning Scalability Systems 98

Scalegrid

JULY 29, 2020

Multi-cluster support. Pgpool-II does not have multi-cluster support. All tests ran as a single thread, on a single-CPU, 2-core machine, for a duration of 5 minutes. Supports automatic load balancing – is even intelligent enough to redirect read requests to standbys, and writes to masters. Connection control.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

HammerDB

FEBRUARY 25, 2021

All the databases that HammerDB tests implement a form of MVCC (multi-version concurrency control). On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. HammerDB is a load testing and benchmarking application for relational databases. The Python GIL.

Programming 67

Programming Benchmarking Virtualization C++ 67

Dynatrace

OCTOBER 22, 2019

Threads enable your application to execute multiple tasks at the same time. This is why threads are often the source of scalability as well as performance issues. If your system is under high load, it can run into thread-locking issues that prevent upward linear scaling of your application. Dynatrace news.

Java 103

Java Scalability Hardware Architecture 103

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. What's changed ? As you can imagine, that was unreasonably expensive.

Storage 199

Storage Performance AWS Efficiency 199

HammerDB

JULY 5, 2022

elseif {$choice <= 20} { payment $lda $w_id $w_id_input } elseif {$choice <= 21} { delivery $lda $w_id } elseif {$choice <= 22} { slev $lda $w_id $stock_level_d_id } elseif {$choice <= 23} { ostat $lda $w_id } } pg_disconnect $lda thread::wait }] } vwait forever. Use a different Browser. #!/usr/local/bin/tclsh8.6

Benchmarking 98

Benchmarking Database C++ Virtualization 98

Testsigma

JUNE 10, 2021

2 Factor Authentication is a subset of the multi factor authentication service that we see mainly in FinTech Apps. While 2 Factor authentication may have some vulnerabilities, using a multi factor authentication system like the above will result in users fleeing your application in pursuit of simpler systems. Introduction.

FinTech 140

FinTech Mobile Speed Testing 140

Alex Russell

APRIL 29, 2021

Combined with WebGL2/WebGPU and WASM threading (see below), Audio Worklets unlock more of a device's available computing power, resulting in consistently good sound without fear of glitching. Critical in adapting web content to mobile, particularly regarding multi-touch gestures. WASM Threads and Shared Array Buffers.

Media 145

Media Games Education Engineering 145

The Morning Paper

SEPTEMBER 27, 2020

PARSEC is a set of benchmarks for multi-threaded programs. MOOSE is a parallel finite element framework for mechanics, phase-field, Navier-Stokes, and heat conduction problems. WRF is a weather forecasting tool. ENZO is an astrophysics and hydrodynamics simulator. GROMACS is a molecular dynamics application. lines of code.

Benchmarking 101

Benchmarking Hardware Programming Code 101