Brendan Gregg

SEPTEMBER 25, 2021

As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Measuring the speed of time Is there already a microbenchmark for os::javaTimeMillis()? Other EC2 instance types, such as C5 or M5, use the AWS Nitro Hypervisor. But I'm not completely sure.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. I'd expect between 0.1% small (thanks @cperciva ). ## 3.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Acceleration and distribution.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Dynatrace news.

Serverless 234

Serverless Azure Monitoring Lambda 234

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. Instead, to speed up response times, applications are now processing most data at the network’s perimeter, closest to the data’s origin.

Infrastructure 179

Infrastructure Availability Systems Retail 179

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. The multi-cloud platform allows you to deploy and manage on AWS, Azure or Google Cloud (coming soon) cloud platforms, or VMware on-premise environments. over Greenplum 5.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

NOVEMBER 15, 2021

Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes. Logs can include data about user inputs, system processes, and hardware states. In fact, the global log management market is expected to grow from 1.9 billion in 2020 to $4.1

Analytics 205

Analytics Monitoring Artificial Intelligence DevOps 205

Dynatrace

OCTOBER 28, 2021

In 2009, the purveyor of online videos migrated to AWS cloud infrastructure to deliver its entertainment to a growing audience. A disruption spanning hardware, networks, and cloud infrastructure can require input and participation from network and infrastructure architects, risk experts, security teams, and even procurement officers.

Engineering 221

Engineering Entertainment Cloud Infrastructure 221

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. With Azure Functions, engineers don’t have to worry about provisioning and maintaining underlying hardware; they simply upload their code, and it’s up and running seconds later. Dynatrace news.

Serverless 140

Serverless Azure Monitoring Lambda 140

Adrian Cockcroft

AUGUST 9, 2022

So right from the beginning, I’m happy to spend some time getting back up to speed and developing some of my ideas around new hardware capabilities. One is general technology advice on the state of the art in development practices, along the lines of the Cloud for CEOs booklet I published for AWS in 2019.

IoT 52

IoT Best Practices AWS Media 52

Dynatrace

JUNE 30, 2020

In my role as DevOps and Autonomous Cloud Activist at Dynatrace, I get to talk to a lot of organizations and teams, and advise them on how to speed up delivery while also increasing the delivery in order to minimize the impact on operations. Dynatrace news.

Lambda 174

Lambda Monitoring Cloud DevOps 174

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge In order to speed up the benchmark indexes must be added. The “wal_level” is set at logical.

Database 107

Database Benchmarking Latency C++ 107

Brendan Gregg

FEBRUARY 28, 2023

## References I've reproduced the references from my SREcon22 keynote below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. QuickSight is a cloud-powered BI service built from the ground up to address the big data challenges around speed, complexity, and cost.

Analytics 152

Analytics Availability Media Social Media 152

All Things Distributed

JULY 14, 2015

DynamoDB Streams is the enabling technology behind two other features announced today: cross-region replication maintains identical copies of DynamoDB tables across AWS regions with push-button ease, and triggers execute AWS Lambda functions on streams, allowing you to respond to changing data conditions. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

OCTOBER 7, 2015

In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. QuickSight is a cloud-native BI service built from the ground up to address the big data challenges around speed, complexity, and cost.

Cloud 137

Cloud Big Data AWS Analytics 137

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 135

Analytics Cloud Healthcare Retail 135

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

FEBRUARY 28, 2023

References I've reproduced the references from my SREcon22 keynote below, so you can click on links: [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] , Jul 2008 [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] , 2010 [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency?

Performance 52

Performance Latency Cache Virtualization 52

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 56

Hardware Latency Virtualization Cloud 56

Testsigma

MAY 19, 2021

Thinking back on how SDLC started and what it is today, the only reasons for its success can be accounted to efficiency, speed and most importantly automation – DevOps and cloud-based solutions can be considered major contributors here (after all DevOps is 41% less time-consuming than traditional ops ). . Sign up Now.

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it). until today.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

APRIL 5, 2012

Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). I often get to meet, discuss, and learn from innovators how they are using AWS to deliver transformative applications to their users, customers and partners. Troy: We moved our service from internal servers to AWS. the recoverability of data.

Innovation 146

Innovation AWS Education Network 146

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Rendering on AWS provides the flexibility to control how quickly a project is completed. By: Peter Cioni (Netflix), Alex Schworer (Netflix), Mac Moore (Conductor Tech.),

Cloud 282

Cloud Entertainment AWS Infrastructure 282

HammerDB

APRIL 19, 2023

For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 on identical hardware, with identical settings, but at different load levels. For example, if we want to evaluate moving our OLTP applications from MySQL 8.0.27 and 8.0.32 HammerDB 4.5

Performance 54

Performance Benchmarking Cache Storage 54

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 40

Hardware Latency Virtualization Cloud 40

All Things Distributed

DECEMBER 20, 2017

Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud. We need mechanisms that enable the mass production of data using software and hardware capabilities. These mechanisms need to be lean, seamless and effective.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

Percona

JULY 26, 2023

To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set. Indexing can help to speed up read queries, but it comes with an extra cost of storage, and they will slow down write operations.

Database 81

Database Servers Storage Strategy 81

Brendan Gregg

SEPTEMBER 5, 2017

Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters). But there's another factor at play: jobs are also migrating from both Solaris and Linux to cloud jobs instead, specifically AWS.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

JANUARY 11, 2021

You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Note : If you use Page Speed Insights or Page Speed Insights API (no, it isn’t deprecated!),

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

You need a business stakeholder buy-in, and to get it, you need to establish a case study, or a proof of concept using the Performance API on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Start Render time, Speed Index ). Treo Sites provides competitive analysis based on real-world data.

Performance 145

Performance Cache Network Metrics 145

High Scalability

NOVEMBER 25, 2019

Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. To add elasticity, reliability and durability, these data centers are connected to Google Cloud platform using high speed, secure Google Interconnect network. AWS for builds.

Architecture 52

Architecture Cache Azure Storage 52

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Lift & Shift is where you basically just move physical or virtual hosts to the cloud – essentially you just run your host on somebody else’s hardware.

Cloud 31

Cloud Traffic Database Network 31

Smashing Magazine

JANUARY 7, 2019

You need a business stakeholder buy-in, and to get it, you need to establish a case study on how speed benefits metrics and Key Performance Indicators ( KPIs ) they care about. Note : If you use Page Speed Insights (no, it isn’t deprecated), you can get CrUX performance data for specific pages instead of just the aggregates.

Performance 103

Performance Cache Metrics Network 103