Adrian Cockcroft

JANUARY 17, 2022

There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability. The need for systems to be resilient is still increasing, and chaos engineering tools and techniques are developing as a key way to validate that resilience is working as designed. primarily virtual?—?and

Serverless 98

Serverless Hardware AWS Architecture 98

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 105

Availability Database Open Source Hardware 105

Dynatrace

NOVEMBER 29, 2022

As a torchbearer of modern AIOps, the Dynatrace’ AI engine, Davis®, provides a purpose-built AI platform for today’s web-scale modern cloud. The Dynatrace AI engine, Davis, provides intelligence and context to such detected events and helps to decide the remediation workflow automatically. Register now!

Infrastructure 177

Infrastructure Code Cloud DevOps 177

Dynatrace

APRIL 15, 2022

Organizations hit this cloud operations wall when replacing static virtual machines with dynamic container orchestration and expanding to multicloud environments. While modern cloud systems simplify tasks — such as deploying apps and provisioning new hardware and servers — cloud environments can be surprisingly complex.

Cloud 182

Cloud Infrastructure Innovation Monitoring 182

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. These factors meant that often when looking for database performance information, the results for a particular combination of software and hardware were not available. What is HammerDB? Why HammerDB was developed.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

High Scalability

JULY 26, 2018

Ops: "Sorry, 3-5 month lead time on DC hardware and our switches are near capacity" - coming soon to an on-prem "serverless" project near you. ” Incredibly, this growth is largely the result of eXp Realty’s use of an online virtual world similar to Second Life. Moore's Law was sustained for five decades.

Internet 124

Internet Internet Scalability Serverless 124

All Things Distributed

MARCH 11, 2016

Marvin Theimer, Amazon Distinguished Engineer, once jokingly said that the evolution of Amazon S3 could best be described as starting off as a single engine Cessna plane, but over time the plane was upgraded to a 737, then a group of 747s, all the way to the large fleet of Airbus 380s that it is now. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

Alex Podelko

SEPTEMBER 8, 2020

Instead of diving in arguing about specific points (which I partly did in my earlier post – start from The Future of Performance Testing if you are interested), I decided to talk to people who monetize on these “myths” So here is a virtual interview with Guillaume Betaillouloux , co-founder and Performance Director of OctoPerf.

Open Source 223

Open Source Performance Testing Testing Performance 223

ACM Sigarch

APRIL 26, 2018

EPU: Emotion Processing Unit is designed by Emoshape , as the MCU microchip design to enable a true emotional response in AI, robots and consumer electronic devices as a result of a virtually unlimited cognitive process. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Dotcom-Montior

NOVEMBER 24, 2021

These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. Within an organization, the responsibility of monitoring these large distributed systems typically falls on site reliability engineering (SRE) teams. Types of Distributed Systems.

Systems 74

Systems Monitoring Hardware Network 74

Alex Podelko

OCTOBER 20, 2016

The answer to this challenge is service virtualization, which allows simulating real services during testing without actual access. Cloud and virtualization triggered appearance dynamic, auto-scaling architectures, which significantly impact getting and analyzing feedback. Traditionally monitoring was on the system level.

Performance Testing 100

Performance Testing Architecture Testing Performance 100

Brendan Gregg

MARCH 16, 2024

It was also a virtual machine that lacked low-level hardware profiling capabilities, so I wasn't able to do cycle analysis to confirm that the 10% was entirely frame pointer-based. and we may have been flying close to the edge of hardware cache warmth, where adding a bit more instructions caused a big drop.

Java 145

Java Cache Google Hardware 145

Percona

JULY 7, 2023

HA in PostgreSQL databases delivers virtually continuous availability, fault tolerance, and disaster recovery. Also, in general terms, a high availability PostgreSQL solution must cover four key areas: Infrastructure: This is the physical or virtual hardware database systems rely on to run. Chaos engineering is another option.

Availability 82

Availability Open Source Architecture Database 82

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object). But I'm not completely sure.

Speed 126

Speed Java AWS Virtualization 126

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. From this data, it can be argued that HammerDB is a better candidate to test MySQL database engine and CPU performance. cpu_utilization_%_in_kernel_mode 29.70

Performance 54

Performance Benchmarking Cache Storage 54

Alex Russell

APRIL 29, 2021

Apple forces developers of competing browsers to use their engine for all browsers on iOS , restricting their ability to deliver a better version of the web platform. They are, pound for pound, some of the best engine developers globally and genuinely want good things for the web. So is speedy resolution and agreement.

Media 145

Media Games Education Engineering 145

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Percona

SEPTEMBER 1, 2023

Vertical scaling is also often discussed, which involves increasing the resources of a single server, which can have limitations in hardware capabilities and become costly as demands grow. 2) Hardware limitations Disk and memory are inexpensive nowadays. An example is running MongoDB on Mesos.

Best Practices 70

Best Practices Traffic Database Servers 70

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

O'Reilly

NOVEMBER 28, 2023

That pricing won’t be sustainable, particularly as hardware shortages drive up the cost of building infrastructure. These models are typically smaller (7 to 14 billion parameters) and easier to fine-tune, and they can run on very limited hardware; many can run on laptops, cell phones, or nanocomputers such as the Raspberry Pi.

Open Source 106

Open Source Artificial Intelligence Google Infrastructure 106

Dotcom-Montior

DECEMBER 8, 2021

In the world of a site reliability engineer (SRE) , failure is not only an option, but also expected. In a different article, we talked about chaos engineering and how SRE teams proactively seek out and test for failures to prevent the worst from happening. You cannot virtualize everything…yet. It is an unavoidable fact.

Social Media 90

Social Media Monitoring Latency DevOps 90

ACM Sigarch

FEBRUARY 23, 2018

Engineers, like economists, deal with large amounts of data and pride ourselves on our clinical ability to analyze and solve complex problems. One of the premises expounded upon ( link ) is that engineering/computer science does not appeal to young women and they choose other careers. Hence the lack of women in our field.

Architecture 47

Architecture Cache Hardware Virtualization 47

Adrian Cockcroft

JUNE 21, 2022

So in 1988 I joined the Sun sales force and became a Systems Engineer (nowadays we would say Solutions Architect). I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Morning Paper

FEBRUARY 18, 2020

Many of the software engineering discipline and controls need to be brought over into an ML context. Inference (scoring) engines will be deployed everywhere, and ML scoring will be deeply integrated into the DBMS "as a foundational extension of relational algebra, and an integral part of SQL query optimizers and runtimes."

Government 95

Government Software Engineering Storage Database 95

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . driver: intel_pstate CPUs which run at the same hardware frequency: 0 .

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Performance

JULY 3, 2019

As we started to dig into the issues being experienced, it became clear that from a SQL Server standpoint, the problem revolved around sessions in a Sleeping status that were holding locks inside of the Engine. So, we had to dig in further. Understanding Session Status.

Servers 64

Servers Hardware Code Virtualization 64

SQL Server According to Bob

DECEMBER 18, 2018

Microsoft SQL Server Database Engine Input/Output Requirements. Linux may need similar utilities to control various hardware cache installations. product: Virtual Disk. Msft Virtual Disk 1.0 Be sure to deploy SQL Server 2017 CU6 or newer for best data durability and performance results. “. The Back Story. Device Flush.

Servers 90

Servers Media Cache Storage 90

O'Reilly

JULY 15, 2020

Software engineers comprise the survey audience’s single largest cluster, over one quarter (27%) of respondents (Figure 1). Adding architects and engineers, we see that roughly 55% of the respondents are directly involved in software development. Technical roles dominate, but management roles are represented, too.

Database 134

Database Architecture Education Systems 134

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. As a Xen guest, this profile was gathered using perf(1) and the kernel's software cpu-clock soft interrupts, not the hardware NMI. Note that Ubuntu also has a frame to show entry into vDSO (virtual dynamic shared object).

Speed 52

Speed Java AWS Virtualization 52

Tasktop

OCTOBER 26, 2021

Another example: The “Custom Ticket” type, where you’ll have versions to support different requests, such as IT Help, VM Request, Hardware Request and Refund Request. . They share the same schema and their fields are virtually identical. At Tasktop, we call these “affinity artifacts”, as they resemble each other very closely.

Hardware 52

Hardware Virtualization Testing Tools Speed 52

Brendan Gregg

SEPTEMBER 5, 2017

This includes many great engineers who I'm sure will excel in whatever they choose to work on next. Linux has been adding tracing technologies over the years: kprobes (kernel dynamic tracing), uprobes (user-level dynamic tracing), tracepoints (static tracing), and perf_events (profiling and hardware counters).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Percona

AUGUST 15, 2023

Since I’ve been working on the Solution Engineering team, I’ve noticed that – although information is plentiful – replication is often misunderstood or incompletely understood. It’s a rather new plugin build for virtual synchronous replication. What is MySQL Replication?

Servers 52

Servers Database Availability Traffic 52

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Not everyone is operating at Netflix or Spotify scale data engineering function. A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

Brendan Gregg

AUGUST 18, 2019

bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. hardware Hardware counter-based instrumentation. On, say, the network engineering team, they have been using BCC to develop an agent for their needs. tracepoint Kernel static instrumentation points.

Latency 68

Latency C++ Cache Programming 68

Abhishek Tiwari

DECEMBER 27, 2017

Kubernetes has emerged as go to container orchestration platform for data engineering teams. Containerized data workloads running on Kubernetes offer several advantages over traditional virtual machine/bare metal based data workloads including but not limited to. Kubernetes has a massive community support and momentum behind it.

Big Data 63

Big Data Storage Benchmarking Hardware 63