The Morning Paper

MARCH 1, 2020

We looked at a couple of papers that had pre-prints available last week, today we’ll be looking at one of the most anticipated papers of this year’s crop: Amazon’s Firecracker. Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018.

Serverless 101

Serverless Virtualization Lambda AWS 101

Dynatrace

JANUARY 26, 2021

Traditional computing models rely on virtual or physical machines, where each instance includes a complete operating system, CPU cycles, and memory. VMware commercialized the idea of virtual machines, and cloud providers embraced the same concept with services like Amazon EC2, Google Compute, and Azure virtual machines.

Serverless 242

Serverless Efficiency Lambda Azure 242

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

Dotcom-Montior

NOVEMBER 24, 2021

Web developers or administrators did not have to worry or even consider the complexity of distributed systems of today. Great, your system was ready to be deployed. Once the system was deployed, to ensure everything was running smoothly, it only took a couple of simple checks to verify. What is a Distributed System?

Systems 74

Systems Monitoring Hardware Network 74

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

Dynatrace

JANUARY 16, 2023

As Kubernetes adoption increases and it continues to advance technologically, Kubernetes has emerged as the “operating system” of the cloud. Kubernetes is emerging as the “operating system” of the cloud. Accordingly, the remaining 27% of clusters are self-managed by the customer on cloud virtual machines.

Open Source 340

Open Source Java Operating System Programming 340

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Five available hybrid cloud platforms from the top public cloud providers include the following: Azure Stack : Consumers can access different Azure cloud services from their own data center and build applications for Azure cloud.

Infrastructure 179

Infrastructure Cloud Azure AWS 179

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Two styles of message queuing.

Monitoring 196

Monitoring Serverless Programming Speed 196

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Two styles of message queuing.

Monitoring 195

Monitoring Serverless Programming Speed 195

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Increased availability. Because FaaS is a cloud-native approach, it makes great use of multisite cloud architecture to improve availability and reliability. Consider the challenges of function as a service.

Development 247

Development Serverless Best Practices Lambda 247

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). Here are the databases and cloud providers supported through each model: Supported Databases.

Cloud 242

Cloud Azure AWS Database 242

Testlodge

APRIL 14, 2021

A software tester’s work life includes making sure that systems that have been designed to achieve specific results behave exactly as they should. These systems are a combination of different hardware and software which have been configured to perform the desired task. What is Configuration Testing? An Example.

Testing 89

Testing Hardware Virtualization Operating System 89

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. WordPress is a content management system (CMS) used to build and manage websites and web applications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed.

Serverless 98

Serverless Hardware AWS Architecture 98

ACM Sigarch

OCTOBER 25, 2019

When it comes to hardware support to mitigate software security issues, there is a significant gap between what is available in products today and known solutions. Attestation—Providing systems the means to attest or verify the integrity of their components. . A History of Architecture Support for Security.

Hardware 98

Hardware Virtualization Architecture Games 98

Dynatrace

APRIL 15, 2022

Organizations hit this cloud operations wall when replacing static virtual machines with dynamic container orchestration and expanding to multicloud environments. In the past, severe database issues seriously hurt system performance, causing delayed shipping times for prescriptions. “We have a rich metric expression language.

Cloud 174

Cloud Infrastructure Innovation Monitoring 174

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. The workload also outputted the data from the Virtual Users by simulating individual terminals.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object). tsc $ time java TimeBench.

Speed 126

Speed Java AWS Virtualization 126

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. And this all has to work for whole-system executions, not just the C-language portion of user processes.

C++ 61

C++ Hardware Virtualization Benchmarking 61

ACM Sigarch

APRIL 26, 2018

EPU: Emotion Processing Unit is designed by Emoshape , as the MCU microchip design to enable a true emotional response in AI, robots and consumer electronic devices as a result of a virtually unlimited cognitive process. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens. The new GV100 packs 7.4

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

SEPTEMBER 1, 2023

Database architects working with MongoDB encounter specific challenges related to database systems and system growth. Vertical scaling is also often discussed, which involves increasing the resources of a single server, which can have limitations in hardware capabilities and become costly as demands grow.

Best Practices 73

Best Practices Traffic Database Servers 73

Percona

JUNE 20, 2023

Inside the memory, they can be allocated any available space. When a program leaves the memory, space becomes available; however, the OS may or may not be able to allocate vacant memory space to another program or process as it has some issues. The next version of the pg_gather will have these details available.

Programming 85

Programming C++ Database Virtualization 85

Brendan Gregg

MARCH 16, 2024

The problem is that this system has a default libc that has been compiled without frame pointers, so any stack walking stops at the libc layer, producing a partial stack that's missing the application frames. and we may have been flying close to the edge of hardware cache warmth, where adding a bit more instructions caused a big drop.

Java 145

Java Cache Google Hardware 145

The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. While we understand it’s virtually impossible to achieve a linear increase in throughput as the number of vCPUs grow, a near-linear increase is attainable. We decided to move one of our Java microservices?—?let’s let’s call it GS2?—?to

Hardware 363

Hardware Cache Performance Latency 363

Dynatrace

OCTOBER 22, 2019

If your system is under high load, it can run into thread-locking issues that prevent upward linear scaling of your application. A scalable architecture needs to distribute work across many threads in order to facilitate all the CPUs of a physical or virtual machine. Dynatrace news.

Java 102

Java Scalability Hardware Architecture 102

HammerDB

FEBRUARY 25, 2021

On high-performance multi-core systems all the supported databases can return performance in the many millions of transactions per minute. To benchmark a database we introduce the concept of a Virtual User. For this reason we need to implement our database sessions in the form of operating system threads. The Python GIL.

Programming 67

Programming Benchmarking Virtualization C++ 67

HammerDB

OCTOBER 18, 2019

So lets take an Ubuntu system with Platinum 8280 CPUs with the following Ubuntu OS, reboot and check the CPU configuration before running any tests. So by default, the system boots into powersave. hardware limits: 1000 MHz - 4.00 hardware limits: 1000 MHz - 4.00 uname -a Linux ubuntu19 5.3.0-rc3-custom 3834 2696 .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

HammerDB

OCTOBER 23, 2023

Stored Procedures and Client SQL comparison To test the stored procedures and client implementations, we ran both workloads against a system equipped with Intel Xeon 8280L. The data shows a scripted automated workload running a number of back to back tests each time with an increasing number of virtual users. On MySQL, we saw a 1.5X

Benchmarking 62

Benchmarking Database Network C++ 62

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

Percona

AUGUST 15, 2023

MySQL replication provides high availability, load balancing, and data redundancy, enhancing system reliability. Replication also provides for data availability by enabling failover to a replica in case the primary server becomes unavailable. It’s a rather new plugin build for virtual synchronous replication.

Servers 52

Servers Database Availability Traffic 52

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Count of APIs available from JavaScript by Web Confluence.

Media 145

Media Games Education Engineering 145

The Morning Paper

APRIL 14, 2019

Just as today’s systems offer memory protection, they call this time protection. The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. set out a principled basis for protecting against this class of attacks.

Hardware 44

Hardware Cache Latency Speed 44

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object).

Speed 52

Speed Java AWS Virtualization 52