SQL Performance

DECEMBER 17, 2019

One initial, easy step to moving your SQL Server on-premises workloads to the cloud is using Azure VMs to run your SQL Server workloads in an infrastructure as a service (IaaS) scenario. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 111

Virtualization AWS Hardware Storage 111

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. These storage nodes collaborate to manage and disseminate the data across numerous servers spanning multiple data centers.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

NOVEMBER 3, 2022

Instead, enterprises manage individual containers on virtual machines (VMs). Serverless container offerings such as AWS Fargate enable companies to manage and modify containers while abstracting server layers to offer customization without increased complexity. In FaaS environments, providers manage all the hardware.

Serverless 216

Serverless Azure Hardware Transportation 216

Percona

AUGUST 22, 2023

Some of the most important elements include: No single point of failure (SPOF): You must eliminate any SPOF in the database environment, including any potential for an SPOF in physical or virtual hardware. Load balancing: Traffic is distributed across multiple servers to prevent any one component from becoming overloaded.

Availability 80

Availability Hardware Open Source Database 80

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. This code is then executed on remote servers in response to an event, such as users interacting with functional web elements. Infrastructure as a service (IaaS) handles compute, storage, and network resources.

Development 247

Development Serverless Best Practices Lambda 247

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Load balancers can detect when a component is not responding and put traffic redirection in motion.

Availability 110

Availability Database Open Source Hardware 110

Scalegrid

APRIL 16, 2020

This is why our BYOC pricing is less than our Dedicated Hosting pricing, as the costs listed for BYOC are only what you pay for ScaleGrid and don’t include your hardware costs. A vast majority of the features are the same, outside of these advanced features available through the BYOC model: Virtual Private Clouds / Virtual Networks.

Cloud 242

Cloud Azure AWS Database 242

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. I'd expect between 0.1%

Virtualization 40

Virtualization AWS Hardware Storage 40

Dotcom-Montior

NOVEMBER 24, 2021

There was a time when standing up a website or application was simple and straightforward and not the complex networks they are today. Do you have a web server? Is the web server running? The last item to check was if the web server was able to talk to the database? The recipe was straightforward. Do you have a database?

Systems 74

Systems Monitoring Hardware Network 74

Percona

JULY 7, 2023

HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery. In general terms, to achieve HA in PostgreSQL, there must be: Redundancy: To ensure data redundancy and provide continuous performance when a primary server fails, multiple copies of the database reside in replica servers.

Availability 85

Availability Open Source Architecture Database 85

HammerDB

OCTOBER 23, 2023

With a simple example such as this, it would not necessarily be expected for the additional network traffic to be significant between the 2 approaches. However, with more complex application logic this network round trip soon becomes a key focus area for improving performance. On MySQL, we saw a 1.5X performance advantage.

Benchmarking 62

Benchmarking Database Network C++ 62

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory.

Performance 110

Performance Latency Cache Virtualization 110

Percona

AUGUST 15, 2023

In this blog post, I provide an in-depth introduction to MySQL Replication, answering what it is, how it works , its benefits and challenges, as well as reviewing some of the MySQL replication concepts that are part of the MySQL environment (and Percona Server for MySQL specifically). Set the server-id to a unique value.

Servers 52

Servers Database Availability Traffic 52

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components.

Performance 54

Performance Benchmarking Cache Storage 54

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

HammerDB

FEBRUARY 25, 2021

To benchmark a database we introduce the concept of a Virtual User. When we have multiple CPU cores on both the benchmark client and database server it is crucial that these database sessions run independently of each other at the same time, in parallel. The following is an example from TPROC-C from SQL Server. select top 100.

Programming 67

Programming Benchmarking Virtualization C++ 67

SQL Performance

APRIL 27, 2020

Many of the newer features we have in SQL Server were initially launched in Azure SQL Database, including (but not limited to) Always Encrypted, Dynamic Data Masking, Row Level Security, and Query Store. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. DTU Pricing Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Testsigma

FEBRUARY 5, 2021

These devices ran on a diverse range of OS versions, screen resolutions, and network types. Once you have chosen your target devices, consider the architectural aspect of your hardware. You need strong and reliable servers to manage mobile devices and execute test scripts. Device Infrastructure. Automated Testing.

Mobile 52

Mobile Testing Hardware DevOps 52

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. 20-30% is a good general default for “dirty_ratio,” but on large-memory database servers, this can be a lot of memory.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

SQL Server According to Bob

JANUARY 11, 2020

Microsoft, ​​ Windows, ​​ Windows NT, ​​ and Windows Server ​​ are registered trademarks of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers 40

Servers Cache Database Media 40

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory.

Performance 52

Performance Latency Cache Virtualization 52

Testsigma

FEBRUARY 3, 2021

Mobiles have different models, screen resolutions, operating systems, network types, hardware configurations, etc. Also, how to test the hardware of the mobile phone itself, is it supporting all the software as it should? Let us have a look at the most popular types of mobile testing for applications and hardware.

Mobile 82

Mobile Testing Hardware C++ 82

SQL Server According to Bob

JULY 13, 2016

20+ years ago when I joined Microsoft I was handed a diskette (maybe it was two), and was told “Here is SQL Server. So I proceeded to install SQL Server 4.20 desktop machine (I won’t tell you the hardware details. There was a GUI as part of setup but within just a few clicks, SQL Server was installed and ready for use.

Servers 40

Servers Media Engineering Virtualization 40

Adrian Cockcroft

JUNE 21, 2022

The early days at Sun Cambridge were special, I absorbed a lot about networking and the technical side of the role from my fellow systems engineer Martin Baines, and we were driving all over the region in cool company cars (I had a Citroen BX 16V) selling a really hot product.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. In the end, it’s not the load events or server response times that define the experience, but the perception of how snappy the interface feels. It used to provide an insight into how quickly the server outputs any data.

Performance 145

Performance Cache Media Metrics 145

All Things Distributed

JANUARY 23, 2012

The Amazon Virtual Private Cloud extends on-premises compute with all the power of AWS, making it elastic, scalable and highly reliable. Data written to these volumes is maintained on your on-premises storage hardware while being asynchronously backed up to AWS, where it is stored in Amazon S3 in the form of Amazon EBS snapshots.

Storage 115

Storage AWS Virtualization Cloud 115

Dotcom-Montior

JUNE 19, 2017

A series of GET requests from an in-house server can’t possibly replicate what actually happens when a website sees a sudden increase in users from all over the world. Thanks to cloud-based virtual servers, LoadView can send traffic to your site or application from around the world. First up is a summary.

Performance Testing 40

Performance Testing Testing Performance Virtualization 40

Dotcom-Montior

NOVEMBER 27, 2018

Today’s applications are built on multiple technologies, relying on vast networks of third-party providers and CDN’s. Analyzing server performance (CPU, memory, bandwidth, disk I/O) and database response times. All resources are dedicated to this test – no shared servers. Identifying performance bottlenecks.

Performance Testing 40

Performance Testing Strategy Testing Performance 40

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). Oracle VM Server is based on Xen. Live kernel patching is another capability, that is currently being integrated in the 4.x

Virtualization 76

Virtualization AWS Engineering Hardware 76

Dynatrace

AUGUST 5, 2019

While most of our cloud & platform partners have their own dependency analysis tooling, most of them focus on basic dependency detection based on network connection analysis between hosts. What is the network traffic going to be between services we migrate and those that have to stay in the current data center?

Cloud 31

Cloud Traffic Database Network 31

Dotcom-Montior

DECEMBER 8, 2021

Systems, web applications, servers, devices, etc., You cannot virtualize everything…yet. Software services still require physical devices and hardware for them to function. In the world of a site reliability engineer (SRE) , failure is not only an option, but also expected. It is an unavoidable fact. Asset Management.

Social Media 90

Social Media Monitoring Latency DevOps 90

Brendan Gregg

AUGUST 8, 2017

Thankfully, I found some older linux-devel mailing list archives, rescued from server backups, often stored as tarballs of digests. 90491 N|rnberg (Germany) Consulting+Networking+Programming+etc'ing 42. It's time in some cgroup paths, but this server is not doing much disk I/O. My search was starting to feel cursed.

Latency 111

Latency Metrics C++ Systems 111

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63