Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Scalegrid

APRIL 16, 2020

A vast majority of the features are the same, outside of these advanced features available through the BYOC model: Virtual Private Clouds / Virtual Networks. Amazon Virtual Private Clouds (VPC) and Azure Virtual Networks (VNET) are private, isolated sections of the cloud infrastructure where you can launch resources.

Cloud 242

Cloud Azure AWS Database 242

Brendan Gregg

MARCH 16, 2024

The problem is that this system has a default libc that has been compiled without frame pointers, so any stack walking stops at the libc layer, producing a partial stack that's missing the application frames. This is pretty common and usually goes unnoticed as the flame graph looks ok at first glance.

Java 145

Java Cache Google Hardware 145

Percona

APRIL 7, 2023

But since retrieving data from disk is slow, databases tend to work with a caching mechanism to keep as much hot data, the bits and pieces that are most often accessed, in memory. In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. In PostgreSQL, it is called shared buffers.

Tuning 137

Tuning Cache Servers Benchmarking 137

The Morning Paper

MARCH 8, 2020

have altered the many assumptions that guided the design and optimization of the Snowflake system. Traditional data warehouse systems are largely based on shared-nothing designs: persistent data is partitioned across a set of nodes, each responsible for its local data. From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

HammerDB

JUNE 27, 2022

HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. An important concept was to simulate database users called Virtual Users in parallel (rather than concurrently) to accurately simulate a real database workload with multiple users running from separate systems. HammerDB Licensing.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Dynatrace

APRIL 21, 2022

Getting precise root cause analysis when dealing with several layers of virtualization in a containerized world. To optimize your back-end systems, you can use the service flow view within Dynatrace to identify layers of application architecture. Missing caching layers. Understanding resource utilization for cost management.

Azure 184

Azure Monitoring Virtualization Metrics 184

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

Percona

MARCH 17, 2023

Virtual Memory utilization was averaging 48 GB of RAM. VictoriaMetrics maintains an in-memory cache for mapping active time series into internal series IDs. Average datapoints size We recommended having at least two GB RAM and a two-core system for PMM Server as a bare minimum requirement to set up monitoring your database services.

Monitoring 101

Monitoring Scalability Cache Database 101

All Things Distributed

SEPTEMBER 3, 2013

Amazon ElastiCache is a fully managed, in-memory caching service for customers to optimize the latency, performance and cost of their read workloads. Integration with Amazon CloudWatch gives customers visibility into key performance metrics, further simplifying system management.

Cache 129

Cache Cloud Performance Retail 129

Scalegrid

OCTOBER 2, 2019

The demand for Redis™ is skyrocketing across dozens of use cases, particularly for cache, queues, geospatial data, and high speed transactions. Redis™, the #1 key-value store and top 10 database in the world, has grown by over 300% in popularity over that past 5 years, per the DB-Engines knowledge base.

Azure 100

Azure Availability Open Source Virtualization 100

ScaleOut Software

MAY 15, 2014

Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers. One or more specified cache servers are unavailable, which could be caused by busy network or servers. …). Please retry later.

Cache 40

Cache Servers Network Design 40

Percona

SEPTEMBER 1, 2023

This can affect the overall performance of your database system, potentially leading to slower response times. This can introduce maintenance overhead, particularly in large and complex database systems. These table cache instances could be accessed concurrently, allowing DML to use cached table descriptors without locking each other.

Cache 62

Cache Database Games Healthcare 62

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

HammerDB

FEBRUARY 26, 2024

This is particularly important when running automated workloads back-back to generate a performance profile for a progressively increasing number of virtual users.

C++ 62

C++ Cache Database Virtualization 62

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Dynatrace

DECEMBER 15, 2020

Upcoming Operating systems support changes. The following operating systems will no longer be supported starting 01 February 2021. The following operating systems will no longer be supported starting 01 May 2021. The following operating systems will no longer be supported starting 01 May 2021. Linux: Ubuntu 19.10.

Operating System 107

Operating System Java Mobile Cache 107

Percona

SEPTEMBER 28, 2023

Whenever you install your favorite MySQL server on a freshly created Ubuntu instance, you start by updating the configuration for MySQL, such as configuring buffer pool, changing the default datadir director, and disabling one of the most outstanding features – query cache. It’s a nice thing to do, but first things first.

Servers 115

Servers Best Practices Database Open Source 115

Randon ASCII

JULY 11, 2022

Downloads go through the cache, the cache is saved to disk, and saves to disk are slowed by (some) anti-virus software. I’d been testing on a virtual machine in a data center that I had access to, purely because this machine has an internet connection that runs at over 2 Gbps. It looks like this can happen. Case closed.

Cache 105

Cache Energy Google Processing 105

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

The Morning Paper

DECEMBER 10, 2019

This is a companion paper to the " persistent problem " piece that we looked at earlier this week, going a little deeper into the object pointer representation choices and the mapping of a virtual object space into physical address spaces. " Epheremal virtual addresses don’t cut it as the basis for persistent pointers.

Hardware 52

Hardware Virtualization Operating System Programming 52

Scalegrid

JULY 29, 2020

However, these must be set up outside the PostgreSQL system, while PgBouncer can offload this to the PostgreSQL server. PgBouncer provides a virtual database that reports various useful statistics. Administration. Pgpool-II provides a detailed administration interface, including a GUI. Even then, PgBouncer was the faster alternative.

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. I am pretty sure some if not all of these papers deserved to be elected to the hall of fame of best papers in distributed systems. Feb 11 - A Survey of Rollback-Recovery Protocols in Message-Passing Systems , E. All Things Distributed. Comments ().

Operating System 144

Operating System Cache AWS Scalability 144

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. Fault tolerance aims for zero downtime and data loss.

Availability 110

Availability Database Open Source Hardware 110

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

HammerDB

OCTOBER 17, 2018

However most people use HammerDB with keying and thinking time disabled and therefore each virtual user can approximately drive the CPU resources of one CPU core on the database server. By default each virtual user has the concept of a home warehouses where approximately 75% of its workload will take place.

C++ 40

C++ Testing Virtualization Cache 40

Rigor

NOVEMBER 7, 2019

Reading time 4 min The CPDoS attack that was discovered in October 2019 and the corresponding attention paid to it within the technology sphere brought to light an issue many of us overlook: the boundaries of our web applications have expanded, and that has increased the number of systems and services that must be monitored and secured.

Monitoring 40

Monitoring Performance Cache Ecommerce 40

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

IO River

NOVEMBER 2, 2023

Given its unchanging nature, static content is ideal for caching. Login & Authentication: Systems that verify user credentials and maintain session-specific data. By the time the player needs it, the content is already cached and ready to go. It doesn’t change very often and is generally not affected by user sessions.

Architecture 52

Architecture Performance Internet Internet 52

The Morning Paper

APRIL 14, 2019

Just as today’s systems offer memory protection, they call this time protection. Microarchitectural state of interest includes data and instruction caches, TLBs, branch predictors, instruction- and data-prefetcher state machines, and DRAM row buffers. set out a principled basis for protecting against this class of attacks.

Hardware 44

Hardware Cache Latency Speed 44

Enprowess

SEPTEMBER 7, 2021

Real-time software system – Collaboration tools used for video/audio conferencing, document writing, Chat applications, etc. It helps isolated bugs quickly and reduces system downtime. React is an open-source front-end library based on JavaScript, created and maintained by Facebook, and is well known for its virtual DOM feature.

Open Source 52

Open Source Virtualization Programming Servers 52

Enprowess

MAY 24, 2022

More incredible Speed with Virtual DOM. Reactjs can help your business in web and mobile application development by bringing fast speed using the virtual DOM. Virtual DOM of React refreshes only parts of the page, so it is faster than the conventional full refresh model. Virtual DOM is an additional feature offered by React.

Mobile 52

Mobile Open Source Virtualization Speed 52

Percona

MAY 15, 2023

In both cases, when using virtually-synchronous replication, the process will require certification from each node and local (by node) write; as such, the number of writes is NOT distributed across multiple nodes but duplicated. As well, very few cases are in need to have a full system/solution to provide scalability with sharding.

Traffic 125

Traffic Scalability Database Servers 125

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

IO River

NOVEMBER 2, 2023

Login & Authentication: Systems that verify user credentials and maintain session-specific data. These can be cached – much more effectively than what’s usually used:‍Standard CDNs for Static Content:The very nature of video streaming makes its traffic relatively straightforward to manage.

Architecture 52

Architecture Performance Internet Internet 52

HammerDB

JULY 5, 2022

Vuser 1:1 Active Virtual Users configured Vuser 1:TEST RESULT : System achieved 1844256 NOPM from 4232155 PostgreSQL TPM Vuser 1:FINISHED SUCCESS ALL VIRTUAL USERS COMPLETE. buff/cache MiB Swap: 2048.0 buff/cache MiB Swap: 2048.0 /hammerdbcli auto pgtime.tcl HammerDB CLI v4.4 Running a single process pre-test.

Benchmarking 98

Benchmarking Database C++ Virtualization 98

Brendan Gregg

AUGUST 18, 2019

bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. BPF has been extended (aka eBPF) in recent years for providing a safe way to extend kernel functionality, and has become a hot topic in systems engineering, with at least 24 talks on BPF at the last Linux Plumber's conference.

Latency 68

Latency C++ Cache Programming 68