Dynatrace

APRIL 5, 2021

But with the benefits also come concerns about observability, and how to monitor and manage ever-expanding cloud software stacks. AWS continues to improve how it handles latency issues. Organizations are realizing the cost savings and management benefits of serverless automation. The Amazon Web Services ecosystem.

Lambda 175

Lambda AWS Serverless Hardware 175

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Scalegrid

MARCH 22, 2024

They can also bolster uptime and limit latency issues or potential downtimes. It’s important to ensure the bells and whistles of any software-as-a-service (SaaS) they offer can support where you aim to take your business, keeping your strategy tight and on track.

Strategy 130

Strategy Cloud Government Innovation 130

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. Replication lag can occur due to various factors such as network latency, system resource limitations, complex transactions, or heavy write loads on the primary/master database.

Performance 105

Performance Monitoring Traffic Database 105

Brendan Gregg

JULY 2, 2021

opensnoop Files opened table. biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. This is thinking like a sysadmin who installs and maintains software, and not like a programmer who codes everything. The problems I'm describing are specific to BPF software and kernel tracing.

Latency 145

Latency Cache Energy Systems 145

The Netflix TechBlog

MARCH 13, 2020

SVT-AV1: open-source AV1 encoder and decoder by Andrey Norkin , Joel Sole , Mariana Afonso , Kyle Swanson, Agata Opalach , Anush Moorthy , Anne Aaron SVT-AV1 is an open-source AV1 codec implementation hosted on GitHub [link] under a BSD + patent license. We welcome more contributors to the project.

Open Source 154

Open Source Efficiency C++ Speed 154

Brendan Gregg

AUGUST 18, 2019

bpftrace is a new open source tracer for Linux for analyzing production performance problems and troubleshooting software. For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. software Kernel software-based events.

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

Testsigma

AUGUST 24, 2020

Continuous Testing is the process of testing at all stages of software development – one after the another- without any human intervention. Continuous Testing makes it possible to eliminate testing as a bottleneck for faster software development and delivery. Continuous Testing is key to faster delivery of Agile products to the market.

Testing 69

Testing Open Source Scalability Latency 69

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. Technology advancements in content creation and consumption have also increased its data footprint. Wednesday?—?December

AWS 37

AWS Entertainment Open Source Benchmarking 37

Brendan Gregg

JULY 2, 2021

If you're using an open source monitoring platform, first check if it already has a BPF agent. opensnoop Files opened table 3. biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. They need constant updates to keep working across different software versions.

Open Source 40

Open Source Latency Cache Energy 40

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. Join Lee Packham, AWS Solutions Architect and Enrico Huijbers, AWS Software Development Engineer to find out how easy it is.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. Join Lee Packham, AWS Solutions Architect and Enrico Huijbers, AWS Software Development Engineer to find out how easy it is.

Open Source 40

Open Source AWS Lambda Serverless 40

The Morning Paper

FEBRUARY 23, 2020

How’s that going to work given what we know about the throughput and latency of blockchains, and the associated mining costs?" The data relevant for any particular query may be stored across many different contractors, that each have substantially different levels of quality of service and query processing latencies.

Blockchain 94

Blockchain Internet Internet IoT 94

O'Reilly

JANUARY 16, 2024

For years I had an aspirational goal of unifying all of my backups into one central directory tree, akin to the concept of a monorepo in software development. software” rather than “hardware” in our brains). So I figured that ChatGPT could help me brainstorm during one of my long drives.

Entertainment 73

Entertainment Internet Internet Design 73

KeyCDN

AUGUST 15, 2019

In the context of web development, performance testing entails using software tools to simulate how an application runs under specific circumstances. Wait time: Sometimes called average latency, wait time refers the amount of time a request spends in a queue before it gets processed. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Morning Paper

NOVEMBER 5, 2019

Ceph is a widely-used, open-source distributed file system that followed this convention [of building on top of a local file system] for a decade. The storage backend is the software module directly managing the storage device attached to physical machines. Taking it to the next level.

Storage 64

Storage Systems Hardware Efficiency 64

Percona

JULY 17, 2023

MongoDB Community Edition software might set the stage for achieving your high-volume database goals, but you quickly learn that its features fall short of your enterprise needs. So you look at MongoDB Enterprise software, but its costly and complex licensing structure does not meet your budget goals.

Open Source 77

Open Source Database Scalability Software 77

Brendan Gregg

OCTOBER 8, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 110

C++ Virtualization Programming Latency 110

Abhishek Tiwari

DECEMBER 27, 2017

Over last few years, we have seen several attempts to run data workload in the containers especially distributed big data frameworks like Apache Hadoop, Apache Storm [3] , and Apache Spark [4] [5] without any software modifications. Obviously, containerized data workloads have their own challenges. optimised container networking and security.

Big Data 63

Big Data Storage Benchmarking Hardware 63

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. Vector is open source and in use by multiple companies.

Performance 211

Performance Latency Open Source Metrics 211

The Symphonia

MAY 22, 2018

I also rewrote the section on Startup Latency since Cold Starts are one of the big “FUD” areas of Serverless. Also there’s been a lot of open source updates, including from Amazon and Microsoft. I also wrote an article on just this area last year.

Serverless 40

Serverless Architecture Lambda Azure 40

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. The architects and developers who create the software must design it to be observed.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Percona

MARCH 29, 2023

Snappy Data size: 14.95GB Data size after compression: 10.75GB Avg latency: 12.22ms Avg cpu usage: 34% Avg insert ops rate: 16K/s Time taken to import 120000000 document: 7292 seconds Zstd (with default compression level 6) Data size: 14.95GB Data size after compression: 7.69GB Avg latency: 12.52ms Avg cpu usage: 31.72% Avg insert ops rate: 14.8K/s

Storage 110

Storage Network Open Source Latency 110

Dynatrace

JUNE 25, 2021

As a strong supporter of open source and open standards, I’m aware that the wide availability of standards, open-source tools, and some newly coined terms are causing a lot of confusion. I also serve as co-chair of the W3C Distributed Tracing working group , which works on standards like W3C Trace Context.

Open Source 195

Open Source Monitoring Google Systems 195

Dynatrace

MAY 17, 2023

Making applications observable—relying on metrics, logs, and traces to understand what software is doing and how it’s performing—has become increasingly important as workloads are shifting to multicloud environments. This allows us to quickly tell whether the network link may be saturated or the processor is running at its limit.

Metrics 166

Metrics Monitoring Database Network 166

Percona

NOVEMBER 9, 2023

If you have any experience working with database software, you have undoubtedly heard the term Kubernetes a lot. At its core, Kubernetes (often abbreviated as K8s) is an open source tool that automates the deployment, scaling, and management of containerized applications.

Efficiency 104

Efficiency Cloud Healthcare Open Source 104

Brendan Gregg

OCTOBER 7, 2018

Created by Alastair Robertson , bpftrace is an open source high-level tracing front-end that lets you analyze systems in custom ways. eBPF was created by Alexei Starovoitov while at PLUMgrid (he's now at Facebook) as a generic in-kernel virtual machine, with software defined networks as the primary use case. eBPF does more.

C++ 40

C++ Virtualization Programming Latency 40

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. Discover how our expert support, services, and enterprise-grade open source database software can make your business run better. Who can benefit from DLV? Get in touch

AWS 98

AWS Benchmarking Performance Traffic 98

Dynatrace

APRIL 6, 2022

Endpoints include on-premises servers, Kubernetes infrastructure, cloud-hosted infrastructure and services, and open-source technologies. Observability can identify the baseline user experience and allow teams to improve it by optimizing page load times or reducing latency. Why full-stack observability matters.

DevOps 225

DevOps Innovation Infrastructure Analytics 225

Dynatrace

DECEMBER 22, 2021

Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage. With limited visibility, teams have a narrow understanding of how those decisions impact other software components and vice-versa. Observability is made up of three key pillars: metrics, logs, and traces.

Artificial Intelligence 171

Artificial Intelligence Metrics Architecture DevOps 171

Testsigma

DECEMBER 18, 2019

To improve the quality of a software product built by developers, software testing is the key. As software testing plays a significant role in the delivery of the final product, it is necessary to consider that the testing process must involve accurate, exhaustive test cases and firm test strategy.

Testing 73

Testing Open Source Strategy Processing 73