HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. NETWORK METRICS sysstat_net_ens260f1_rx_kB/s 38,241 22,700 1.68

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

DECEMBER 20, 2017

These examples underline that the purpose of software today is not solely to support business processes, but that software solutions have broadly become an essential element in multiple business areas. This is done through software and IT services that are delivered through software APIs. More than mere support.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Dotcom-Montior

OCTOBER 6, 2021

A site reliability engineer, or SRE, is a role that that encompasses aspects of both software engineering and operations/infrastructure. At that time, the team was made up of software engineers. Site reliability engineers bridge the gap between operations and software developers. What are Some Common SRE Responsibilities?

Engineering 67

Engineering DevOps Monitoring Google 67

All Things Distributed

JULY 13, 2010

Customers with complex computational workloads such as tightly coupled, parallel processes, or with applications that are very sensitive to network performance, can now achieve the same high compute and networking performance provided by custom-built infrastructure while benefiting from the elasticity, flexibility and cost advantages of Amazon EC2.

Cloud 118

Cloud AWS Automotive Latency 118

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 56

Hardware Latency Virtualization Cloud 56

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Rendering on AWS provides the flexibility to control how quickly a project is completed. By: Peter Cioni (Netflix), Alex Schworer (Netflix), Mac Moore (Conductor Tech.),

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

VoltDB

JUNE 1, 2017

It was – like the hypothetical movie I describe above – more than a little bit odd, as you could leave a session discussing ever more abstract layers of virtualization and walk into one where they emphasized the critical importance of pinning a network interface to a specific VM for optimal performance. The “Public Private Cloud” folks.

Hardware 40

Hardware Latency Virtualization Cloud 40

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Dynatrace

NOVEMBER 3, 2022

In fact, according to a Gartner forecast , revenue for global container management software and services will reach $944 million in 2024 — up from $465.8 With the significant growth of container management software and services, enterprises need to find ways to simplify the process. million in 2020. Serverless container services.

Serverless 219

Serverless Azure Hardware Transportation 219

Dynatrace

JUNE 29, 2022

They use the same hardware, APIs, tools, and management controls for both the public and private clouds. Amazon Web Services (AWS) Outpost : This offering provides pre-configured hardware and software for customers to run native AWS computing, networking, and services on-premises in a cloud-native manner.

Infrastructure 184

Infrastructure Cloud Azure AWS 184

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. A log is a detailed, timestamped record of an event generated by an operating system, computing environment, application, server, or network device. billion in 2020 to $4.1

Analytics 211

Analytics Monitoring Artificial Intelligence DevOps 211

High Scalability

OCTOBER 24, 2022

Limit the cloud services a cloud provider can offer and you limit the quality of the software we can build. Each cloud-native evolution is about using the hardware more efficiently. Building software is not moving freight. It would make the job of building quality software even harder and slower and more expensive.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work?

Development 253

Development Serverless Best Practices Lambda 253

Dynatrace

DECEMBER 8, 2021

You may be using serverless functions like AWS Lambda , Azure Functions , or Google Cloud Functions, or a container management service, such as Kubernetes. Many customers try to use traditional tools to monitor and observe modern software stacks, but they struggle to deal with the dynamic and changing nature of cloud environments.

Cloud 228

Cloud Serverless Hardware Operating System 228

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 123

Cloud Serverless AWS Storage 123

Dynatrace

MAY 1, 2020

The investment continues—we’re anticipating an upcoming release of the AWS Graviton2 processor , which has already been announced to be significantly more powerful than its predecessor. Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java.

Java 133

Java Hardware Tuning Metrics 133

The Netflix TechBlog

APRIL 29, 2019

Open Connect Open Connect is Netflix’s content delivery network (CDN). takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e., video streaming) takes place in the Open Connect network. takes place in Amazon Web Services (AWS), whereas everything that happens afterwards (i.e.,

Open Source 279

Open Source Network Infrastructure Big Data 279

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Instead, to speed up response times, applications are now processing most data at the network’s perimeter, closest to the data’s origin.

Infrastructure 185

Infrastructure Availability Systems Retail 185

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The first version of AWS Lambda was built using Linux containers. All of the existing approaches we just examined involve trade-offs that AWS didn’t want to make.

Serverless 101

Serverless Virtualization Lambda AWS 101

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. How will AI adopters react when the cost of renting infrastructure from AWS, Microsoft, or Google rises? They will simply be part of the environment in which software developers work.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Testsigma

MAY 19, 2021

Infrastructure as a Service is the term used for those cloud-based solutions that provide complete infrastructure to the users including all the overheads, hardware, and networking facilities. As a user, you just need to pay for the services, install low-level requirements and set up the networking. Software as a Service (SaaS).

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Acceleration and distribution.

Scalability 159

Scalability Hardware AWS Tuning 159

All Things Distributed

JUNE 21, 2012

Amazon DynamoDB is the fastest growing new service in the history of AWS. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. Earth Networks recently launched a new lightning proximity feature for their popular WeatherBug app.

Games 142

Games Scalability AWS Database 142

The Netflix TechBlog

FEBRUARY 9, 2021

The homepage needs to load in a reasonable amount of time, even in poor network conditions. We can leverage high performance VMs in AWS to generate the assets. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires.

Engineering 165

Engineering Storage Latency Entertainment 165

Dotcom-Montior

OCTOBER 12, 2017

EasyTravel demo application on AWS server. LoadView scripting tool Easystep on AWS server. Firewall on AWS server. AWS server security policy. Software used in the showcase. Setup Demo App EasyTravel on AWS box. Connect demo application hosted on AWS to Dynatrace. Setup Demo App EasyTravel on AWS Box.

AWS 40

AWS Tuning Monitoring Servers 40

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). They use third-party software like Docker or Kubernetes to simplify their administration. People rarely create them manually.

Virtualization 76

Virtualization AWS Engineering Hardware 76