Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

ACM Sigarch

APRIL 26, 2018

They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens. FPU: Floating Processing Unit (FPU).

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

HammerDB

OCTOBER 23, 2023

With a simple example such as this, it would not necessarily be expected for the additional network traffic to be significant between the 2 approaches. However, with more complex application logic this network round trip soon becomes a key focus area for improving performance. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. NETWORK METRICS sysstat_net_ens260f1_rx_kB/s 38,241 22,700 1.68

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

JANUARY 23, 2012

The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable. The AWS Storage Gateway is a service connecting an on-premises software appliance with cloud-based storage. s storage infrastructure. Once the AWS Storage Gatewayâ??s

Storage 115

Storage AWS Virtualization Cloud 115

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. software Kernel software-based events. usdt User-level statically defined tracing.

Latency 68

Latency C++ Cache Programming 68

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This process effectively duplicates essential parts of information to safeguard against potential loss.

Storage 130

Storage Systems Big Data Azure 130

Abhishek Tiwari

DECEMBER 27, 2017

Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. optimised container networking and security. optimised container networking and security. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Dotcom-Montior

DECEMBER 8, 2021

You cannot virtualize everything…yet. Software services still require physical devices and hardware for them to function. Change management is the process of determining how changes will affect the service deployment and/or consider the effects on the business itself. Asset Management.

Social Media 90

Social Media Monitoring Latency DevOps 90

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Dynatrace

NOVEMBER 3, 2022

In fact, according to a Gartner forecast , revenue for global container management software and services will reach $944 million in 2024 — up from $465.8 With the significant growth of container management software and services, enterprises need to find ways to simplify the process. million in 2020. Managed orchestration.

Serverless 219

Serverless Azure Hardware Transportation 219

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Percona

AUGUST 22, 2023

Some of the most important elements include: No single point of failure (SPOF): You must eliminate any SPOF in the database environment, including any potential for an SPOF in physical or virtual hardware. Without enough infrastructure (physical or virtualized servers, networking, etc.), there cannot be high availability.

Availability 83

Availability Hardware Open Source Database 83

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Amazon Web Services (AWS) Outpost : This offering provides pre-configured hardware and software for customers to run native AWS computing, networking, and services on-premises in a cloud-native manner.

Infrastructure 184

Infrastructure Cloud Azure AWS 184

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Monolithic architectures were commonplace with legacy, on-premises software solutions. Infrastructure as a service (IaaS) handles compute, storage, and network resources. FaaS vs. monolithic architectures.

Development 253

Development Serverless Best Practices Lambda 253

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 112

Availability Database Open Source Hardware 112

All Things Distributed

MARCH 11, 2016

Almost from day one, we knew that the software we were building would not be the software that would be running a year later. We needed to build such an architecture that we could introduce new software components without taking the service down. Build evolvable systems. Primitives not frameworks. Automation is key.

AWS 144

AWS Hardware Retail Virtualization 144

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery.

Availability 88

Availability Open Source Architecture Database 88

Testsigma

FEBRUARY 3, 2021

Mobiles have different models, screen resolutions, operating systems, network types, hardware configurations, etc. Also, how to test the hardware of the mobile phone itself, is it supporting all the software as it should? Let us have a look at the most popular types of mobile testing for applications and hardware.

Mobile 82

Mobile Testing Hardware C++ 82

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. The recipe was straightforward. Peer-to-Peer.

Systems 74

Systems Monitoring Hardware Network 74

The Morning Paper

APRIL 2, 2019

Establishing software root of trust unconditionally Gligor & Woo, NDSS’19. In this context it means there are no external dependencies on e.g. secrets, trusted hardware modules, or special instructions (e.g. Disabling caches, virtual memory, and the TLB (this can be done verifiably as shown in theorem 6 in section IV.E).

Software 40

Software Software Programming Hardware 40

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. Advanced Data Analysis does a decent job of exploring and analyzing datasets—though we expect data analysts to be careful about checking AI’s output and to distrust software that’s labeled as “beta.”

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Traditionally one of the major costs when moving data in and out of memory (be it to persistent media or over the network) is serialisation.

Hardware 56

Hardware Programming Media Storage 56

HammerDB

FEBRUARY 25, 2021

This post explains why HammerDB made the language decisions it made to make it the best performing and most usable database benchmarking software. To benchmark a database we introduce the concept of a Virtual User. So having an application client mutex lock that artificially stalls our Virtual Users does not sound good.

Programming 67

Programming Benchmarking Virtualization C++ 67

Alex Russell

APRIL 29, 2021

Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Modern, asynchronous network APIs that dramatically improve performance in some situations. A tool for reliably sending data — for example, chat and email messages — in the face of intermittent network connections.

Media 145

Media Games Education Engineering 145

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. There are also stateless interconnects including buses and on-chip networks. virtually-addressed state must be flushed. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

Dotcom-Montior

JUNE 19, 2017

Let’s face it – the ideal load test emulates real world traffic, yet most load testing software doesn’t come close. Today we’ll be reviewing LoadView , an on-demand load-testing platform from Dotcom-Monitor that makes realistic load testing possible without an up-front investment in hardware or software infrastructure.

Performance Testing 40

Performance Testing Testing Performance Virtualization 40

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). They use third-party software like Docker or Kubernetes to simplify their administration. People rarely create them manually.

Virtualization 76

Virtualization AWS Engineering Hardware 76