SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. Microsoft currently has eight main types of virtual machines designed for different types of workloads. Conclusion.

Azure 72

Azure Virtualization Servers Storage 72

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) But the ephemeral storage service for intermediate data is not based on S3.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

NOVEMBER 3, 2022

Instead, enterprises manage individual containers on virtual machines (VMs). IaaS provides direct access to compute resources such as servers, storage, and networks. In FaaS environments, providers manage all the hardware. Alternatively, in a CaaS model, businesses can directly access and manage containers on hardware.

Serverless 218

Serverless Azure Hardware Transportation 218

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Infrastructure as a service (IaaS) handles compute, storage, and network resources. Microservices, on the other hand, make it possible to quickly scale up a single aspect of an application, such as storage or compute use.

Development 250

Development Serverless Best Practices Lambda 250

Dynatrace

SEPTEMBER 15, 2020

It differentiates Dynatrace as an AWS Partner Network (APN) member with a fully tested product on AWS Outposts. “We Dynatrace can help customers monitor, troubleshoot, and optimize application performance for workloads operating on AWS Outposts, in AWS Regions, and on customer-owned hardware for a truly consistent hybrid experience.”.

AWS 200

AWS Design Storage Cloud 200

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Without it, sending an email over a long distance would require the immediate availability of every node on the routing network to forward each message. A producer creates the message, and a consumer processes it.

Monitoring 199

Monitoring Serverless Programming Speed 199

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Without it, sending an email over a long distance would require the immediate availability of every node on the routing network to forward each message. A producer creates the message, and a consumer processes it.

Monitoring 198

Monitoring Serverless Programming Speed 198

Percona

AUGUST 22, 2023

Some of the most important elements include: No single point of failure (SPOF): You must eliminate any SPOF in the database environment, including any potential for an SPOF in physical or virtual hardware. Without enough infrastructure (physical or virtualized servers, networking, etc.), there cannot be high availability.

Availability 77

Availability Hardware Open Source Database 77

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? With the launch of the AWS Storage Gateway our customers can now integrate their on-premises IT environment with AWSâ??s

Storage 116

Storage AWS Virtualization Cloud 116

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 140

Performance Latency Hardware Storage 140

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 105

Availability Database Open Source Hardware 105

Percona

JULY 7, 2023

HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery. Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. there cannot be high availability.

Availability 81

Availability Open Source Architecture Database 81

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

SQL Performance

APRIL 27, 2020

The basic tier provides up to 5 DTUs with standard storage. The standard tier supports from 10 up to 3000 DTUs with standard storage and the premium tier supports 125 up to 4000 DTUs with premium storage, which is orders of magnitude faster than standard storage. vCore Pricing Tier. GB per vCore. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Traditionally one of the major costs when moving data in and out of memory (be it to persistent media or over the network) is serialisation.

Hardware 56

Hardware Programming Media Storage 56

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk.

Best Practices 52

Best Practices Design Tuning Database 52

Abhishek Tiwari

DECEMBER 27, 2017

Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. faster access to external storage and data locality (I/O, bandwidth). optimised container networking and security. Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product. I also helped out in the run-up to the 2004 Athens Olympics.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Morning Paper

APRIL 2, 2019

That is to say, even in the presence of persistent malware e.g. in the firmware of peripheral controllers, network interface cards, disk and USB controllers, and so on, root of trust can assure us that the system has booted into a known and trusted state (or alternatively, uncover the presence of malware with high probability).

Software 40

Software Software Programming Hardware 40

Dynatrace

AUGUST 5, 2019

While most of our cloud & platform partners have their own dependency analysis tooling, most of them focus on basic dependency detection based on network connection analysis between hosts. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 31

Cloud Traffic Database Network 31

Alex Russell

APRIL 29, 2021

Chrome has missed several APIs for 3+ years: Storage Access API. Real-time network protocols for enabling videoconferencing, desktop sharing, and game streaming applications. Modern, asynchronous network APIs that dramatically improve performance in some situations. is access to hardware devices. Where Chrome Has Lagged.

Media 145

Media Games Education Engineering 145

SQL Server According to Bob

JANUARY 11, 2020

Stable Media Stable media is often confused with physical storage. SQL Server defines stable media as storage that can survive system restart or common failure. Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well.

Servers 40

Servers Cache Media Hardware 40

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. Intel Quick Assist Technology (QAT) was the focus of the QZFS paper which used this new hardware device to speed up file system compression.

Architecture 12

Architecture Hardware Cache Storage 12

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. x series.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Moto G4) on a slow 3G network, emulated at 400ms RTT and 400kbps transfer speed. 300ms RTT, 1.6 Mbps down, 0.8

Performance 145

Performance Cache Media Metrics 145

SQL Server According to Bob

JANUARY 11, 2020

url=/library/en-us/fileio/fs/sparse_files.asp ) ​​ on the ​​ Microsoft Developer Network ​​ (MSDN). Streams ​​ NTFS volumes ​​ enable ​​ data files to have one or more secondary storage streams.

Servers 40

Servers Cache Database Media 40

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. The importance of the network.

AWS 147

AWS Hardware Retail Virtualization 147