Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) joins) during query processing. Tenant isolation is achieved by provisioning a separate virtual warehouse (VW) for each tenant. Workload characteristics.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

JANUARY 26, 2021

Traditional computing models rely on virtual or physical machines, where each instance includes a complete operating system, CPU cycles, and memory. VMware commercialized the idea of virtual machines, and cloud providers embraced the same concept with services like Amazon EC2, Google Compute, and Azure virtual machines.

Serverless 244

Serverless Efficiency Lambda Azure 244

Dotcom-Montior

DECEMBER 8, 2021

Now that we have talked about what an incident is, incident management is the process by which teams resolve these events and bring systems and services back to normal operation. ITSM is the policies, processes, and structure behind the lifecycle of IT services. You cannot virtualize everything…yet. Service Desk.

Social Media 90

Social Media Monitoring Latency DevOps 90

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Testsigma

JULY 3, 2021

More control: While performing on-premise testing, organizations have more control over configurations, setup, hardware, and software. It involves setting up a data center that meets security compliances and other factors like physical components, virtual elements, storage management, physical infrastructure, etc. The takeaway.

Cloud 57

Cloud Testing Storage DevOps 57

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 111

Virtualization AWS Hardware Storage 111

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This process effectively duplicates essential parts of information to safeguard against potential loss.

Storage 130

Storage Systems Big Data Azure 130

Dotcom-Montior

NOVEMBER 27, 2018

LoadView – Best Practices and Process. The scripts can be uploaded into the LoadView platform and replayed by a virtually unlimited number of simultaneous users, giving you actual performance from real browsers. Distribute user load by geographical testing locations, simulating your customer base.

Performance Testing 40

Performance Testing Strategy Testing Performance 40

All Things Distributed

SEPTEMBER 4, 2017

Both concepts are virtually omnipresent and at the top of most buzzword rankings. And thirdly, an "algorithmic revolution" has taken place, meaning it is now possible to train trillions of algorithms simultaneously, making the whole machine learning process much faster.

Artificial Intelligence 147

Artificial Intelligence Transportation Education Airlines 147

All Things Distributed

DECEMBER 20, 2017

Take the example of industrial manufacturing: in prototyping, drafts for technologically complex products are no longer physically produced; rather, their characteristics can be tested in a purely virtual fashion at every location across the globe by using simulations. The German startup SimScale makes use of this trend.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

The Agile Manager

JUNE 30, 2015

Virtual data centers, real-time algorithmic pricing, and new media are simply larger versions of that same phenomenon. But skills, capabilities, processes and culture all wilt in the face of an overbearing capital structure. Is every company destined to be a software company?

Software 40

Software Software Innovation Hardware 40

KeyCDN

JULY 2, 2020

There were no pictures and even the formatting of the text could make it difficult to process. This language would have to exist regardless of hardware, location, culture, political beliefs, etc. While it was good for exchanging information, it was neither visually stimulating nor interesting to the common person.

Internet 56

Internet Internet Best Practices Website 56

Abhishek Tiwari

JULY 12, 2018

These data pipelines can process data at petabytes scale and to some extent, their success can be attributed to an army of engineers devoted to build and maintain internal data pipelines. Depending on frameworks, data processing units (a.k.a A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The traditional view is that there is a choice between virtualization with strong security and high overhead, and container technologies with weaker security and minimal overhead.

Serverless 101

Serverless Virtualization Lambda AWS 101

Dynatrace

NOVEMBER 3, 2022

The containerization craze has continued for enterprises, with benefits such as portability, efficiency, and scalability. With the significant growth of container management software and services, enterprises need to find ways to simplify the process. Instead, enterprises manage individual containers on virtual machines (VMs).

Serverless 218

Serverless Azure Hardware Transportation 218

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance.

Virtualization 40

Virtualization AWS Hardware Storage 40

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. These technologies can answer questions, provide customer support, or even complete transactions.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Why HammerDB was developed. Cached vs Scaled Workloads.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

DECEMBER 10, 2019

This is a companion paper to the " persistent problem " piece that we looked at earlier this week, going a little deeper into the object pointer representation choices and the mapping of a virtual object space into physical address spaces. Both abstractions must be implemented in a way that is efficient using existing hardware.

Hardware 52

Hardware Virtualization Operating System Programming 52

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Without enough infrastructure (physical or virtualized servers, networking, etc.),

Availability 107

Availability Database Open Source Hardware 107

All Things Distributed

MARCH 11, 2016

This is a given, whether you are using the highest quality hardware or lowest cost components. This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. Primitives not frameworks.

AWS 144

AWS Hardware Retail Virtualization 144

HammerDB

FEBRUARY 25, 2021

To benchmark a database we introduce the concept of a Virtual User. Top 10 Processes. However, having the application logic in the client is even worse because you are sacrificing key database efficiencies of prepared statements. Basic Benchmarking Concepts. Glue language. The Python GIL.

Programming 67

Programming Benchmarking Virtualization C++ 67

O'Reilly

NOVEMBER 28, 2023

Users and Nonusers AI adoption is in the process of becoming widespread, but it’s still not universal. Until AI reaches 100%, it’s still in the process of adoption. Automating the process of building complex prompts has become common, with patterns like retrieval-augmented generation (RAG) and tools like LangChain.

Open Source 108

Open Source Artificial Intelligence Google Infrastructure 108

Percona

AUGUST 15, 2023

MySQL replication is a process in which data from a primary MySQL database is copied and sent to one or more secondary databases, known as replicas. Start the replica server’s replication process. If the primary server experiences a failure, the entire replication process could be disrupted. What is MySQL Replication?

Servers 52

Servers Database Availability Traffic 52

Percona

SEPTEMBER 1, 2023

To address these challenges, architects must design robust and scalable MongoDB databases and adopt appropriate sharding strategies that can efficiently handle increasing workloads while ensuring continuous availability. It’s essential to select an appropriate shard key to ensure even data distribution and efficient querying.

Best Practices 71

Best Practices Traffic Database Servers 71

Dotcom-Montior

NOVEMBER 24, 2021

These systems can include physical servers, containers, virtual machines, or even a device, or node, that connects and communicates with the network. Each process has its own independent memory that it works with. Software and hardware components are autonomous and execute tasks concurrently. No Shared Memory. Concurrency.

Systems 74

Systems Monitoring Hardware Network 74

Alex Russell

APRIL 29, 2021

Now in development in WebKit after years of radio silence, WebXR APIs provide Augmented Reality and Virtual Reality input and scene information to web applications. Efficiently enables new styles of drawing content on the web , removing many hard tradeoffs between visual richness , accessibility, and performance. CSS Custom Paint.

Media 145

Media Games Education Engineering 145

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Brendan Gregg

SEPTEMBER 5, 2017

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). I wrote a page on it: [perf]. - **eBPF**: tracing features completed in 2016, this provides efficient programmatic tracing to existing kernel frameworks.

Virtualization 76

Virtualization AWS Engineering Hardware 76

Percona

AUGUST 27, 2018

Essentially, you can assign a thread to a specific virtual CPU. assigning to a specific CPU) is a manageable resource, represented by the concept of “virtual CPU” as a term that includes CPU cores, hyperthreads, hardware threads, and so forth. MySQL determines, at startup, how many virtual CPUs are available. Master App2.

Tuning 44

Tuning Virtualization Testing Servers 44

SQL Server According to Bob

JANUARY 11, 2020

Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies. Most manufacturers' implementations immediately flush pending writes to physical disk during the restart operations.

Servers 40

Servers Cache Media Hardware 40

Dynatrace

AUGUST 5, 2019

Before starting any migration project, you must have a good overview of all your hosts, processes, services and technologies. Step 2: Understand your Dependencies: No Host or Process left alone! How much traffic is sent between two processes hosting a certain service? Also accessible through the Smartscape API.

Cloud 31

Cloud Traffic Database Network 31

SQL Server According to Bob

JANUARY 11, 2020

DBCC Page Auditing DBCC page auditing is the process of executing common DBCC consistency checks as pages are read from disk. KB ​​ boundaries efficiently. ​​ Obtain assistance from your I/O vendor ​​ if you ​​ encounter retries. ​​ This creates 8?KB

Servers 40

Servers Cache Database Media 40

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. Intel Quick Assist Technology (QAT) was the focus of the QZFS paper which used this new hardware device to speed up file system compression.

Architecture 12

Architecture Hardware Cache Storage 12

Smashing Magazine

JANUARY 11, 2021

Micro-optimizations are great for keeping performance on track, but it’s critical to have clearly defined targets in mind — measurable goals that would influence any decisions made throughout the process. Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Media Metrics 145