Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. At hardware reset the boot code is granted maximally permissive architectural capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. sysbench is a widely used open-source benchmarking tool that is designed to evaluate the performance of CPU, memory, disk I/O, and database systems.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JUNE 20, 2023

In order to overcome these issues, the concept of paging and segmentation was introduced, where physical address space and virtual address space were designed. Here, virtual(logical) to physical address translation is much easier as segment tables store adequate information. A detailed description of these concepts is below.

Programming 84

Programming C++ Database Virtualization 84

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. hardware Hardware counter-based instrumentation. BEGIN Start of bpftrace.

Latency 68

Latency C++ Cache Programming 68

Abhishek Tiwari

DECEMBER 27, 2017

Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. To address this, the open source community is now trying to develop Kubernetes custom schedulers specifically optimised for big data workloads.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. Firecracker is open source, and there are a number of projects that make it easy to work with outside of the AWS environment too, including Weave Firekube (disclaimer: Accel is an investor in Weaveworks).

Serverless 101

Serverless Virtualization Lambda AWS 101

Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. Without enough infrastructure (physical or virtualized servers, networking, etc.), What does high availability mean? What is fault tolerance?

Availability 79

Availability Hardware Open Source Database 79

Abhishek Tiwari

JULY 12, 2018

A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. In some cases, this can be enhanced by combining data virtualization techniques with microservices architecture. A data pipeline can process data in a different order than they were received.

Latency 63

Latency Analytics Scalability Engineering 63

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. These factors meant that often when looking for database performance information, the results for a particular combination of software and hardware were not available. How to build HammerDB from source.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

O'Reilly

NOVEMBER 28, 2023

16% of respondents working with AI are using open source models. Many of the new open source models are much smaller and not as resource intensive but still deliver good results (especially when trained for a specific application). Open source models are a large and diverse group.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 108

Availability Database Open Source Hardware 108

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Therefore, DBAs must take a piecemeal approach to achieve HA with PostgreSQL, bringing together open source extensions and tools from multiple sources. there cannot be high availability.

Availability 84

Availability Open Source Architecture Database 84

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. It is an open-source platform that is free to use and offers a wide range of features and capabilities.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Percona

JUNE 12, 2023

Open source databases provide great foundations for high availability — without the pitfalls of vendor lock-in that can come with proprietary software. However, open source software doesn’t typically include built-in HA solutions.

Architecture 96

Architecture Availability Open Source Healthcare 96

HammerDB

FEBRUARY 25, 2021

To benchmark a database we introduce the concept of a Virtual User. We could use processes, however given we may want to create hundreds or thousands of virtual users multithreading is the best approach to implement a Virtual User. Basic Benchmarking Concepts. The Python GIL. Tcl Multithreading in parallel.

Programming 67

Programming Benchmarking Virtualization C++ 67

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. Now in development in WebKit after years of radio silence, WebXR APIs provide Augmented Reality and Virtual Reality input and scene information to web applications. is access to hardware devices. Device APIs: The Final Frontier.

Media 145

Media Games Education Engineering 145

HammerDB

OCTOBER 18, 2019

As noted previously the main developer of HammerDB is an Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are my own, specific to the context of HammerDB as an independent personal project and not representing Intel. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Percona’s open source database monitoring tool monitors the health of your database infrastructure and helps you improve MongoDB performance.

Best Practices 52

Best Practices Design Tuning Database 52

HammerDB

JANUARY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and any opinions are specific to the context of HammerDB as an independent personal project and are not related to Intel in any way. Repeatability. can you be sure that it scales?

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Smashing Magazine

JANUARY 11, 2021

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing and execution times (we’ll talk about them in detail later). There are many tools allowing you to achieve that: SiteSpeed.io

Performance 145

Performance Cache Media Metrics 145