Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

ACM Sigarch

APRIL 26, 2018

EPU: Emotion Processing Unit is designed by Emoshape , as the MCU microchip design to enable a true emotional response in AI, robots and consumer electronic devices as a result of a virtually unlimited cognitive process. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens. The new GV100 packs 7.4

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

HammerDB

OCTOBER 23, 2023

With a simple example such as this, it would not necessarily be expected for the additional network traffic to be significant between the 2 approaches. However, with more complex application logic this network round trip soon becomes a key focus area for improving performance. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Adrian Cockcroft

FEBRUARY 9, 2023

The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. The next layer is operating system platforms, what flavor of Linux, what version of Windows etc. Above that there’s a deployment platform such as Kubernetes or AWS Lambda.

Engineering 137

Engineering Serverless Lambda AWS 137

DZone

DECEMBER 20, 2023

Virtualization has become a crucial element for companies and individuals looking to optimize their computing resources in today’s rapidly changing technological landscape. Mini PCs have become effective virtualization tools in this setting, providing a portable yet effective solution for a variety of applications.

Virtualization 161

Virtualization Efficiency Hardware Games 161

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 56

Hardware Latency Virtualization Cloud 56

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance.

Hardware 40

Hardware Latency Virtualization Cloud 40

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable. All Things Distributed. Expanding the Cloud - The AWS Storage Gateway. By Werner Vogels on 23 January 2012 12:01 AM.

Storage 115

Storage AWS Virtualization Cloud 115

Dotcom-Montior

DECEMBER 8, 2021

Systems, web applications, servers, devices, etc., SREs and DevOps teams can use these incidents to build back better and improve their systems and services. Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation.

Social Media 90

Social Media Monitoring Latency DevOps 90

Dotcom-Montior

NOVEMBER 27, 2018

Today’s applications are built on multiple technologies, relying on vast networks of third-party providers and CDN’s. Additionally, end users can access your site or applications from anywhere in the world using different browsers, operating systems, and mobile devices, all with varying connection speeds.

Performance Testing 40

Performance Testing Strategy Testing Performance 40

Brendan Gregg

AUGUST 18, 2019

bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. BPF has been extended (aka eBPF) in recent years for providing a safe way to extend kernel functionality, and has become a hot topic in systems engineering, with at least 24 talks on BPF at the last Linux Plumber's conference.

Latency 68

Latency C++ Cache Programming 68

Abhishek Tiwari

DECEMBER 27, 2017

Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. optimised container networking and security. In fact, if we go by current trends containerised microservices running on Kubernetes are the future.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. Web developers or administrators did not have to worry or even consider the complexity of distributed systems of today. Great, your system was ready to be deployed. What is a Distributed System?

Systems 74

Systems Monitoring Hardware Network 74

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Abhishek Tiwari

JULY 12, 2018

In a nutshell, a data pipeline is a distributed system. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable. In some cases, this can be enhanced by combining data virtualization techniques with microservices architecture.

Latency 63

Latency Analytics Scalability Engineering 63

Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster.

Availability 83

Availability Hardware Open Source Database 83

Dynatrace

NOVEMBER 3, 2022

These containers are software packages that include all the relevant dependencies needed to run software on any system. Instead, enterprises manage individual containers on virtual machines (VMs). Container-based software isn’t tied to a platform or operating system, so IT teams can move or reconfigure processes easily.

Serverless 219

Serverless Azure Hardware Transportation 219

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Amazon Web Services (AWS) Outpost : This offering provides pre-configured hardware and software for customers to run native AWS computing, networking, and services on-premises in a cloud-native manner.

Infrastructure 184

Infrastructure Cloud Azure AWS 184

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Infrastructure as a service (IaaS) handles compute, storage, and network resources. Because a third party manages part of the infrastructure, IT teams give up a measure of control over system architecture.

Development 253

Development Serverless Best Practices Lambda 253

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 112

Availability Database Open Source Hardware 112

All Things Distributed

MARCH 11, 2016

Build evolvable systems. But we couldn’t adopt the old style approach of upgrading systems through a maintenance outage, as many businesses around the world are relying on our platform for 24/7 availability. This is a given, whether you are using the highest quality hardware or lowest cost components. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

SQL Server According to Bob

JULY 13, 2016

desktop machine (I won’t tell you the hardware details. And the Operating System environment for Windows Server has become more robust but has introduced more features and complexity. So the initial time to run this all depends on your network speed. Here is what it looked like on my system. Go install it”.

Servers 40

Servers Media Engineering Virtualization 40

Testsigma

FEBRUARY 3, 2021

Mobiles have different models, screen resolutions, operating systems, network types, hardware configurations, etc. Also, how to test the hardware of the mobile phone itself, is it supporting all the software as it should? Let us have a look at the most popular types of mobile testing for applications and hardware.

Mobile 82

Mobile Testing Hardware C++ 82

Percona

JULY 7, 2023

HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery. Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run.

Availability 88

Availability Open Source Architecture Database 88

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. To benchmark a database we introduce the concept of a Virtual User. For this reason we need to implement our database sessions in the form of operating system threads. The Python GIL.

Programming 67

Programming Benchmarking Virtualization C++ 67

Percona

AUGUST 15, 2023

Network Connectivity: Establish a reliable network connection between the primary and replica servers. MySQL replication provides high availability, load balancing, and data redundancy, enhancing system reliability. It’s a rather new plugin build for virtual synchronous replication. and it has many advantages.

Servers 52

Servers Database Availability Traffic 52

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56