Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Percona

JUNE 12, 2023

Open source databases provide great foundations for high availability — without the pitfalls of vendor lock-in that can come with proprietary software. However, open source software doesn’t typically include built-in HA solutions. This blog provides links to such architectures — for MySQL and PostgreSQL software.

Architecture 100

Architecture Availability Open Source Healthcare 100

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk.

Best Practices 52

Best Practices Design Tuning Database 52

ACM Sigarch

OCTOBER 25, 2019

When it comes to hardware support to mitigate software security issues, there is a significant gap between what is available in products today and known solutions. Acceleration—Adding hardware support to reduce the runtime overheads of security features. hardware support for malware detection/prevention).

Hardware 98

Hardware Virtualization Architecture Games 98

Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed. primarily virtual?—?and

Serverless 98

Serverless Hardware AWS Architecture 98

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Where a high availability design once worked well, it can no longer keep up with more complex requirements.

Availability 87

Availability Open Source Architecture Database 87

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 140

Performance Latency Hardware Storage 140

The Morning Paper

DECEMBER 10, 2019

This is a companion paper to the " persistent problem " piece that we looked at earlier this week, going a little deeper into the object pointer representation choices and the mapping of a virtual object space into physical address spaces. Both abstractions must be implemented in a way that is efficient using existing hardware.

Hardware 52

Hardware Virtualization Operating System Programming 52

ACM Sigarch

MAY 31, 2023

using Compute Express Link or CXL), organizing memory components for optimal performance, adapting system software traditionally designed for homogeneous memory systems, and developing memory abstractions and programming constructs for HCM management. About CXL hardware availability with academia. Using emulation (e.g.

Latency 52

Latency Hardware Cache Architecture 52

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

ACM Sigarch

APRIL 26, 2018

BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. They introduced the architecture of coarse grain reconfigurable array (CGRA) for statically scheduled data flow computing in HOTCHIPS’17 and its software stack of compiler and linker in ICCAD’17. processor” targets at autonomous driving, while “Sunrise 1.0

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Brendan Gregg

MARCH 16, 2024

To explain this example in more detail: The profiler periodically interrupts software execution, and for those disconnected stacks it happens to be the execution of the kernel software ("vfs*", "ext*", etc.). The overhead to walk DWARF is also too high, as it was designed for non-realtime use. Just to name a couple of languages.

Java 145

Java Cache Google Hardware 145

Smashing Magazine

OCTOBER 27, 2021

If you are designing an app or a website, you can test how easy and intuitive it is to complete a specific task, fill out a form, find certain information, or buy a product. Before those studies, web pages were designed as printed media, with columns and big blocks of text. Eye-Tracking Evolution. Source: Oculid) ( Large preview ).

Mobile 111

Mobile Website Hardware Social Media 111

Percona

JUNE 20, 2023

In order to overcome these issues, the concept of paging and segmentation was introduced, where physical address space and virtual address space were designed. Paging This was designed to allow non-contiguous space allocation to processes. It is the responsibility of software developers to build debug symbols.

Programming 87

Programming C++ Database Virtualization 87

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Traditional pointers address a memory location (often virtual of course). At least, the nature of pointers that we want to make persistent.

Hardware 56

Hardware Programming Media Storage 56

HammerDB

FEBRUARY 25, 2021

This post explains why HammerDB made the language decisions it made to make it the best performing and most usable database benchmarking software. As we have seen databases are designed to handle multiple database sessions at the same time. To benchmark a database we introduce the concept of a Virtual User. The Python GIL.

Programming 67

Programming Benchmarking Virtualization C++ 67

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] , Nov 2020 [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] , Jul 2020 [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 52

Performance Latency Cache Virtualization 52

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. Instead, readers should refer to the HammerDB documentation.

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 52

Performance Latency Hardware Storage 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

HammerDB

OCTOBER 23, 2023

HammerDB has always used stored procedures as a design decision because the original benchmark was implemented as close as possible to the example workload in the TPC-C specification that uses stored procedures. When we observe the global CPU usage one clear difference is the increase in softirqs or software interrupts.(If

Benchmarking 62

Benchmarking Database Network C++ 62

Testsigma

JULY 3, 2021

From the maintenance and monitoring of the machines and software to upgrading and installations — you’ll need all hands on deck. More control: While performing on-premise testing, organizations have more control over configurations, setup, hardware, and software. As the name suggests, it happens on-premise.

Cloud 57

Cloud Testing Storage DevOps 57

Percona

SEPTEMBER 1, 2023

To address these challenges, architects must design robust and scalable MongoDB databases and adopt appropriate sharding strategies that can efficiently handle increasing workloads while ensuring continuous availability. 2) Hardware limitations Disk and memory are inexpensive nowadays. An example is running MongoDB on Mesos.

Best Practices 75

Best Practices Traffic Database Servers 75

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

JANUARY 23, 2012

The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable. The AWS Storage Gateway is a service connecting an on-premises software appliance with cloud-based storage. s storage infrastructure. Once the AWS Storage Gatewayâ??s

Storage 115

Storage AWS Virtualization Cloud 115

Alex Russell

APRIL 29, 2021

Now in development in WebKit after years of radio silence, WebXR APIs provide Augmented Reality and Virtual Reality input and scene information to web applications. Apple's policy against browser engine choice adds years of delays beyond the (expected) delay of design iteration, specification authoring, and browser feature development.

Media 145

Media Games Education Engineering 145

HammerDB

DECEMBER 5, 2020

A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

ACM Sigarch

FEBRUARY 23, 2018

In industry, generally due to time-to-market restrictions, we tend to think extremely short term with evolutionary design changes rather than riskier revolutionary ideas that have a longer timeline for returns. Virtualization, for instance, was being addressed by IBM in the 1960s. However, a similar near term bias exists in academia.

Architecture 47

Architecture Cache Hardware Virtualization 47

Dotcom-Montior

JUNE 19, 2017

Let’s face it – the ideal load test emulates real world traffic, yet most load testing software doesn’t come close. Today we’ll be reviewing LoadView , an on-demand load-testing platform from Dotcom-Monitor that makes realistic load testing possible without an up-front investment in hardware or software infrastructure.

Performance Testing 40

Performance Testing Testing Performance Virtualization 40

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. software Kernel software-based events. usdt User-level statically defined tracing.

Latency 68

Latency C++ Cache Programming 68

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

HammerDB

JANUARY 5, 2019

That is why we run a workload designed exactly for this purpose as it gives us a “benchmark” 2. Benchmarks are nothing like your real applications, and that’s actually good thing because unlike your application a good benchmark application like HammerDB has been designed to scale. Scalability.

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Dotcom-Montior

DECEMBER 8, 2021

ITSM defines how teams design, create, and deliver their services. You cannot virtualize everything…yet. Software services still require physical devices and hardware for them to function. We should also note that incident management is just one element of a larger concept known as IT Service Management, or ITSM.

Social Media 90

Social Media Monitoring Latency DevOps 90

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. Mirroring can be implemented at a software or hardware level.

Servers 40

Servers Cache Media Hardware 40

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Smashing Magazine

SEPTEMBER 21, 2021

Once upon a time, in the magical land of Software development, there was a young developer, your humble servant, discovering Linux for the first time. Designing and implementing these graphical interfaces takes a lot more work. It’s very similar to the virtual desktops many Linux desktop managers have. Matthieu Cneude.

Development 98

Development Energy Programming Efficiency 98