The Morning Paper

DECEMBER 10, 2019

This is a companion paper to the " persistent problem " piece that we looked at earlier this week, going a little deeper into the object pointer representation choices and the mapping of a virtual object space into physical address spaces. Both abstractions must be implemented in a way that is efficient using existing hardware.

Hardware 52

Hardware Virtualization Operating System Programming 52

Percona

JUNE 20, 2023

In order to understand “segmentation fault,” it is a must to know the basic idea of segmentation and its implementation in C programming. When we need to execute any program, it should be loaded into memory first. Here, memory is divided into equal sizes of partitions where the code of a program resides.

Programming 85

Programming C++ Database Virtualization 85

ACM Sigarch

OCTOBER 25, 2019

When it comes to hardware support to mitigate software security issues, there is a significant gap between what is available in products today and known solutions. Attestation—Providing systems the means to attest or verify the integrity of their components. . A History of Architecture Support for Security.

Hardware 98

Hardware Virtualization Architecture Games 98

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. And this all has to work for whole-system executions, not just the C-language portion of user processes.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. The call for participation ends on March 2nd 23:59 SGT!

Performance 110

Performance Latency Cache Virtualization 110

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. What programming languages does HammerDB use and why does it matter? Why HammerDB was developed.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Adrian Cockcroft

FEBRUARY 9, 2023

The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. The next layer is operating system platforms, what flavor of Linux, what version of Windows etc. Both mobile and web front ends call an Application Program Interface (API) that is managed by an API proxy.

Engineering 137

Engineering Serverless Lambda AWS 137

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 126

Speed Java AWS Virtualization 126

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. The Twizzler programming model.

Hardware 56

Hardware Programming Media Storage 56

Brendan Gregg

MARCH 16, 2024

The problem is that this system has a default libc that has been compiled without frame pointers, so any stack walking stops at the libc layer, producing a partial stack that's missing the application frames. and we may have been flying close to the edge of hardware cache warmth, where adding a bit more instructions caused a big drop.

Java 145

Java Cache Google Hardware 145

O'Reilly

SEPTEMBER 15, 2021

Our audience is particularly strong in the software (20% of respondents), computer hardware (4%), and computer security (2%) industries—over 25% of the total. Given the difficulty of hiring expertise from outside, we expect an increasing number of companies to grow their own ML and AI talent internally using training programs.

Azure 145

Azure Social Media Programming AWS 145

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. It was a great privilege. That's about 24 hours from now!

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

AUGUST 18, 2019

bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. BPF has been extended (aka eBPF) in recent years for providing a safe way to extend kernel functionality, and has become a hot topic in systems engineering, with at least 24 talks on BPF at the last Linux Plumber's conference.

Latency 68

Latency C++ Cache Programming 68

Nick Desaulniers

OCTOBER 24, 2018

Typically, when we modify a program, we’d like to run it to verify our changes. Before booting a compiled Linux kernel image on actual hardware, it can save us time and potential headache to do a quick boot in a virtual machine like QEMU. qemu-system-x86_64. qemu-system-x86_64 -kernel arch/x86_64/boot/bzImage.

C++ 56

C++ Hardware Virtualization Systems 56

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else. as a result there were product and messaging changes.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Morning Paper

APRIL 2, 2019

Root of trust (RoT) establishment on an untrusted system ensures that a system state comprises all and only content chosen by the user, and the user’s code begins execution in that state. In this context it means there are no external dependencies on e.g. secrets, trusted hardware modules, or special instructions (e.g.

Software 40

Software Software Programming Hardware 40

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 52

Speed Java AWS Virtualization 52

Smashing Magazine

SEPTEMBER 21, 2021

I couldn’t start my system anymore. All and all, it took me days to get back to the system I had before the crash. I can reinstall my whole system with a bunch of scripts I’ve written, including all the tools I use and their configurations. Note : The tools I advocate in this article work on Linux-based systems.

Development 98

Development Energy Programming Efficiency 98

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. PWA App Icon Badging.

Media 145

Media Games Education Engineering 145

KeyCDN

JANUARY 23, 2020

A wide range of users with different operating systems, browsers, hardware configurations and other variables provides a wide sample size that helps developers discover as many issues as possible. This helps developers decide when to increase server disk space and power or whether or not using a virtual cloud server is optimal.

Strategy 72

Strategy Metrics Monitoring Servers 72

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Was there some other program consuming CPU, like a misbehaving Ubuntu service that wasn't in CentOS? As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI.

Speed 40

Speed Java AWS Virtualization 40

Particular Software

MARCH 11, 2019

To attempt to apply strict in-order processing would be to impose artificial limitations on our system. That's because to guarantee message ordering is technically very difficult and, even if successful, always comes with tradeoffs like lower message throughput and less scalability that hamper the system's ability to be successful.

Virtualization 69

Virtualization Scalability Servers Processing 69

Randon ASCII

APRIL 14, 2020

I tried to tap the control key (virtual key code 162) once a second until the password input field appeared. Some of it is programs (including som internal Google tools) that have registered in Task Scheduler to run “On workstation lock of any user” – who knew? Ultimately there are a lot of programs spinning very hard.

Programming 89

Programming Processing Systems Hardware 89

Randon ASCII

AUGUST 16, 2018

As usual I had UIforETW running in the background, tracing to circular buffers, so I just had to type Ctrl+Win+R and the buffers, representing the last thirty seconds or so of system activity, were saved to disk. Normally running every 6 ms is enough to make a program responsive, but for some reason it wasn’t making any progress.

Programming 75

Programming Virtualization Code Processing 75

All Things Distributed

SEPTEMBER 4, 2017

Both concepts are virtually omnipresent and at the top of most buzzword rankings. The management consultants at McKinsey expect that the global market for AI-based services, software and hardware will grow annually by 15-25% and reach a volume of around USD 130 billion in 2025. More room for optimism.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

Nick Desaulniers

APRIL 6, 2020

“War stories” in programming are entertaining tales of truly evil bugs that kept you up at night. halt (); Some sort of very early exception handler; better to sit busy in an infinite loop than run off and destroy hardware or corrupt data, I suppose. Recent work. halt_loop: while ( true ). a “gadget.”)

C++ 67

C++ Hardware Code Virtualization 67

Nick Desaulniers

MAY 30, 2016

One of the first few programs a programmer might write after hello world is something like this: 1. When they run that program, they see: 1. Someone from the back shouts virtual machines then ducks as a chair is thrown. 64-Bit Programming Models: Why LP64? The UNIX System — 64bit and Data Size Neutrality.

C++ 59

C++ Programming Code Hardware 59

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. USENIX ATC is a top-tier venue with a broad range of systems research papers from both industry and academia.

Architecture 12

Architecture Hardware Cache Storage 12

Brendan Gregg

AUGUST 8, 2017

Linux load averages are "system load averages" that show the running thread (task) demand on the system as an average number of running plus waiting threads. This measures demand, which can be greater than what the system is currently processing. then your system is idle. - cat /proc/loadavg. 42/3411 43603. 42/3411 43603.

Latency 111

Latency Metrics C++ Systems 111

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

SQL Server According to Bob

NOVEMBER 29, 2016

Let’s actually use the calculator program in Windows 10 to look at this a different way. Your NUMA system may not have different processor groups for each node. Here is another example from another two node system I have with one processor group. This is a two node system with 6 cores per node (with HT 12 logical CPUs per node).

Servers 45

Servers Virtualization Scalability Hardware 45

O'Reilly

NOVEMBER 28, 2023

And everyone has opinions about how these language models and art generation programs are going to change the nature of work, usher in the singularity, or perhaps even doom the human race. AI users say that AI programming (66%) and data analysis (59%) are the most needed skills. Many AI adopters are still in the early stages.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

SQL Server According to Bob

JULY 13, 2016

desktop machine (I won’t tell you the hardware details. And the Operating System environment for Windows Server has become more robust but has introduced more features and complexity. Launching this program brings you to the new Basic Installer Screen. Here is what it looked like on my system. Go install it”.

Servers 40

Servers Media Engineering Virtualization 40

High Scalability

JULY 26, 2018

Peter : DARPA foresee a third one in which context-based programs are able to explain and justify their own reasoning. Ops: "Sorry, 3-5 month lead time on DC hardware and our switches are near capacity" - coming soon to an on-prem "serverless" project near you. Only maintenance from now on, everything new will be in @rustlang.

Internet 124

Internet Internet Scalability Serverless 124