Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

Percona

MAY 1, 2023

PostgreSQL performance optimization aims to improve the efficiency of a PostgreSQL database system by adjusting configurations and implementing best practices to identify and resolve bottlenecks, improve query speed, and maximize database throughput and responsiveness. This is a trade-off between performance and reliability.

Tuning 52

Tuning Efficiency Database Performance 52

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

Percona

DECEMBER 27, 2023

Consequently, they might miss out on the benefits of integrating security into the SDLC, such as enhanced efficiency, speed, and quality in software delivery. It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic. You mentioned ‘More Simple Kubernetes’?

Cloud 77

Cloud Open Source Strategy Best Practices 77

The Morning Paper

JANUARY 30, 2020

The design of the HTML5 Web Worker interface turns out to be a great match for migration – Workers are already designed to work on a separate thread communicating via message passing, and are typically used to offload expensive computation that you don’t want to do in the main thread with the user waiting.

Mobile 104

Mobile Cloud Latency Games 104

Testsigma

JULY 3, 2021

More control: While performing on-premise testing, organizations have more control over configurations, setup, hardware, and software. The security and data storage infrastructure has to meet certain security compliances and standards; only then, the infrastructure is good to go for testing. All of these require a lot of capital.

Cloud 57

Cloud Testing Storage DevOps 57

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Reliability.

Serverless 273

Serverless AWS Lambda Storage 273

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. until today.

Cloud 118

Cloud AWS Automotive Latency 118

Dynatrace

AUGUST 11, 2022

Effective application development requires speed and specificity. Cloud providers then manage physical hardware, virtual machines, and web server software management. Infrastructure as a service (IaaS) handles compute, storage, and network resources. Dynatrace news. Therefore, many organizations turn to function as a service.

Development 244

Development Serverless Best Practices Lambda 244

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 86

Database Hardware Open Source Strategy 86

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Many shows have needs that exceed 100,000 frames, so aggregate rendering time can impact the timely delivery of a show on Netflix.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design. What Exactly is Greenplum?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

KeyCDN

FEBRUARY 22, 2023

PWAs are designed to work offline, be fast, and provide a seamless user experience across different devices. Motion UI Motion UI is a design trend involving animation and other interactive elements to create a more dynamic and engaging user experience. They thus adapt to the user's browser, screen size, and device specifications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. If you don’t have well-designed and small columns for this composite primary key, it could enlarge all of your secondary indexes. Additionally, MySQL 8.0

Strategy 40

Strategy Storage Database Best Practices 40

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. New Hardware Configuration for Provisioned Compute Tier.

Azure 55

Azure Database Serverless Hardware 55

HammerDB

JUNE 27, 2022

This post is targeted towards the questions most often asked by non-technical management who want to get up to speed on what HammerDB is (what it isn’t) and how it can benefit their organization. It enables the user to measure database performance and make comparative judgements about database hardware and software.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. Microsoft currently has eight main types of virtual machines designed for different types of workloads. Azure VM Types and Series.

Azure 72

Azure Virtualization Servers Storage 72

Percona

SEPTEMBER 1, 2023

To address these challenges, architects must design robust and scalable MongoDB databases and adopt appropriate sharding strategies that can efficiently handle increasing workloads while ensuring continuous availability. Depending on the database size and on disk speed, a backup/restore process might take hours or even days!

Best Practices 70

Best Practices Traffic Database Servers 70

Percona

DECEMBER 14, 2022

The key goals of OLTP applications are availability, speed, concurrency, and recoverability. The CITUS columnar extension feature set includes: Highly compressed tables: Reduces storage requirements. Columnar storage. speeds up scans, . These applications are used concurrently by hundreds of users. drill-down. Getting it.

Database 92

Database Analytics Storage Processing 92

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set. MongoDB is popular with developers as it is easy to get started with.

Database 78

Database Servers Storage Strategy 78

The Morning Paper

SEPTEMBER 19, 2019

Autoscaling tiered cloud storage in Anna. Could it be Analyzing efficient stream processing on modern hardware ? On one of the themes that captures my imagination, how changing hardware platform influence system design: Rethinking database high availability with RDMA networks. Research papers. (In In random order!).

Blockchain 46

Blockchain Hardware Google Analytics 46

Testsigma

MAY 3, 2021

Web developers are moving their focus from desktop-first to mobile-first web design which further solidifies our understanding of how important this pocket device has become. What could be the best choice to cut down the costs and gain speed to move the pipeline faster than test automation?

Mobile 77

Mobile Testing Operating System Hardware 77

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Physalia is designed to offer consistency and high-availability, even under network partitions. Requirements.

Database 106

Database AWS Network Design 106

Abhishek Tiwari

DECEMBER 27, 2017

More importantly, UDM utilizes a single storage backend with benefits of multiple storage systems which avoids moving data across systems hence data duplication, and data consistency issues. Delta implements the unified data management layer by extending the Amazon S3 object storage for ACID transactions and automatic data indexing.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

Alex Russell

SEPTEMBER 20, 2020

Pre-publication gates were valuable when better answers weren't available, but commentators should update their priors to account for hardware and software progress of the past 13 years. The world didn't yet have pervasive multi-process browser sandboxing, JS JITs , or metal-speed binary isolation. Don't like the consequences?

Hardware 64

Hardware Mobile Programming Java 64

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 78

C++ Database Storage Testing 78

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Hardware Past As Performance Prologue. Regardless, the overall story for hardware progress remains grim, particularly when we recall how long device replacement cycles are: Tap for a larger version.

Performance 124

Performance Network Cache Metrics 124

SQL Server According to Bob

JANUARY 11, 2020

​​ With new ​​ innovations ​​ come ​​ new terms, designs, ​​ and ​​ algorithms. This is different from ​​ the reference count design ​​ that was ​​ used in SQL Server 7.0 and ​​ 2000.

Servers 40

Servers Cache Database Media 40

The Morning Paper

JANUARY 19, 2020

Now you might say that the system is designed such that A only talks to B, and B only talks to C. But do A and C share the same storage, compute, or network resources for example? Intially being buffered by system mechanisms designed to cope with partial failures etc., Take a trivial example with three components A, B, and C.

C++ 50

C++ Systems Software Software 50

Alex Russell

OCTOBER 22, 2017

JavaScript is the single most expensive part of any page in ways that are a function of both network capacity and device speed. Add onto that the yawning chasm between low-end and high-end device performance thanks to chip design factors like cache sizes, and it can be difficult to know where to set a device baseline.

Performance 68

Performance Benchmarking Network Mobile 68

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. Intel Quick Assist Technology (QAT) was the focus of the QZFS paper which used this new hardware device to speed up file system compression.

Architecture 12

Architecture Hardware Cache Storage 12

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. The “wal_level” is set at logical. Download Percona Distribution for PostgreSQL Today!

Database 102

Database Benchmarking Latency C++ 102

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Note : If you use Page Speed Insights or Page Speed Insights API (no, it isn’t deprecated!),

Performance 145

Performance Cache Media Metrics 145