Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are on [slideshare] or as a [PDF]: I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 140

Performance Latency Hardware Storage 140

Testlodge

APRIL 14, 2021

A software tester’s work life includes making sure that systems that have been designed to achieve specific results behave exactly as they should. These systems are a combination of different hardware and software which have been configured to perform the desired task. Types of Configuration Testing. Configuration Testing Objectives.

Testing 89

Testing Hardware Virtualization Operating System 89

Percona

MARCH 28, 2023

” This acts as a step to ensure durability by recovering lost data from the same journal files in case of crashes, power, and hardware failures between the checkpoints (see below) Here’s what the process looks like. Journal, on the one hand, is an append-only operation in a journal file, AKA transaction log file present on disk.

Hardware 87

Hardware C++ Storage Cache 87

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. In addition to the disaster recovery site, this design includes an external layer of nodes.

Availability 107

Availability Database Open Source Hardware 107

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. These models both offer advantages, while also presenting their unique challenges.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Randon ASCII

JANUARY 12, 2022

That meant I started having regular meetings with the hardware engineers who were working with IBM on the CPU which gave me even more expertise on this CPU, which was critical in helping me discover a design flaw in one of its instructions , and in helping game developers master this finicky beast. Standard stuff. That said, 5.5

Cache 126

Cache Latency Benchmarking Hardware 126

ACM Sigarch

JULY 17, 2023

We then discuss defects observed, the role of test and design to address this problem, and identify research opportunities. An example of a specification is the correct operation of the hardware of a microprocessor. While testing is important, exhaustive testing is challenging given the sheer size of modern processor designs.

Energy 52

Energy Hardware Best Practices Architecture 52

ACM Sigarch

MAY 31, 2023

However, building and utilizing HCM presents challenges, including interconnecting various memory technologies (e.g., There are three common mechanisms to access remote memory: modifying applications, modifying virtual memory, and hardware-level cache coherence support. About CXL hardware availability with academia.

Latency 52

Latency Hardware Cache Architecture 52

The Netflix TechBlog

NOVEMBER 9, 2021

AV1 playback on TV platforms relies on hardware solutions, which generally take longer to be deployed. Throughout 2020 the industry made impressive progress on AV1 hardware solutions. This allows us to present the content exactly as creatively envisioned on devices and plans which support such high resolution and frame-rate playback.

Media 246

Media Open Source Efficiency Software Engineering 246

Percona

AUGUST 30, 2023

In general terms, here are potential trouble spots: Hardware failure: Manufacturing defects, wear and tear, physical damage, and other factors can cause hardware to fail. heat) can damage hardware components and prompt data loss. Human mistakes: Incorrect configuration is an all-too-common cause of hardware and software failure.

Database 87

Database Hardware Open Source Strategy 87

ACM Sigarch

APRIL 26, 2018

BPU: Brain Processing Unit is the design of the AI chips by Horizon Robotics. With its modular architecture, DLA is scalable, highly configurable, and designed to simplify integration and portability. HPU: Holographic Processing Unit (HPU) is the specific hardware of Microsoft’s Hololens.

Hardware 99

Hardware Artificial Intelligence Architecture Google 99

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Where a high availability design once worked well, it can no longer keep up with more complex requirements.

Availability 83

Availability Open Source Architecture Database 83

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality.

Metrics 130

Metrics Monitoring Latency Cache 130

Smashing Magazine

OCTOBER 27, 2021

If you are designing an app or a website, you can test how easy and intuitive it is to complete a specific task, fill out a form, find certain information, or buy a product. Before those studies, web pages were designed as printed media, with columns and big blocks of text. Eye-Tracking Evolution. Source: Oculid) ( Large preview ).

Mobile 111

Mobile Website Hardware Social Media 111

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. Amazon Elastic Block Store (EBS) is your good-to-go option for disk space.

Cloud 118

Cloud Serverless AWS Storage 118

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge The “wal_level” is set at logical. Redundancy can potentially decrease overall performance. Download Percona Distribution for PostgreSQL Today!

Database 104

Database Benchmarking Latency C++ 104

Smashing Magazine

OCTOBER 11, 2022

All industries have a part to play, and that includes web design and development. Presenting The Case For Sustainability. Being able to present a business case, and demonstrate that the benefits outweigh the costs, will help justify focusing resources in the area of sustainability. The Bigger Picture. More after jump!

Strategy 123

Strategy Development Energy Website 123

The Morning Paper

SEPTEMBER 27, 2020

Furthermore, as hardware and compiler optimisations rapidly evolve, it is challenging even for a knowledgeable developer to keep up. FPSpy is designed to be able to run in production using unmodified application binaries, and is implemented as an LD_PRELOAD shared library on Linux. Together they comprise about 7.5M lines of code.

Benchmarking 101

Benchmarking Hardware Programming Code 101

The Netflix TechBlog

AUGUST 30, 2021

Complementing the hardware is the software on the RAE and in the cloud, and bridging the software on both ends is a bi-directional control plane. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 213

Latency Traffic Transportation Hardware 213

Percona

OCTOBER 18, 2023

Compatibility Open source databases are designed with interoperability at their core, adhering to industry standards and offering support for a wide range of data import and export formats. Evaluating your hardware requirements is another vital aspect of resource allocation. Should I be bringing in external experts to help out?

Open Source 92

Open Source Database Hardware Strategy 92

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We are working on multiple fronts to extend the solution presented here.

Cache 251

Cache Latency Airlines Logistics 251

Percona

JANUARY 17, 2023

In this blog, I have deliberately chosen an index without any internal pages, so that readers may understand that internal pages may not necessarily be present in every B-tree index. The majority of issues are caused by hardware failure or hardware issues, and the following are the most probable reasons. Defective disk or RAM.

Database 118

Database Hardware Storage Programming 118

Percona

MAY 2, 2023

However, it’s important to note that the optimal value may vary depending on your specific workload and hardware configuration. Answer : No, ChatGPT is an AI language model developed by OpenAI and is not designed to replace a MySQL DBA job. 16) and monitoring the server’s performance. So, as for now, we are safe 😀

Social Media 121

Social Media Database Servers Cache 121

Brendan Gregg

JULY 4, 2021

This was a chance to talk about other things I've been working on, such as the present and future of hardware performance. The video is on [youtube]: The slides are [here] or as a [PDF]: first prev next last / permalink/zoom I work on many areas of performance, but recently I've had a lot of demand to talk about BPF.

Performance 52

Performance Latency Hardware Storage 52

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Testsigma

JUNE 3, 2021

A few of the errors which can be faced due to a poorly designed UI are: i. These software errors are usually uncovered during functionality testing, mostly can be present as: Difficult/ confusing functionality: If the user is unable to understand or perform a function on the application, then it should change. Hardware error.

Software 82

Software Software Testing Hardware 82

Brendan Gregg

FEBRUARY 28, 2023

DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

DECEMBER 8, 2019

On the last morning of the conference Daniel Bittman presented some of the work being done in the context of the Twizzler OS project to explore new programming models for NVM. This is left as an exercise for the application developer at present. This means that the overheads of system calls become much more noticeable.

Hardware 56

Hardware Programming Media Storage 56

SQL Performance

JANUARY 23, 2020

The approach was influential in the design of the SQL Sentry performance dashboard, which presents waits flanked by queues (key resource metrics) to deliver a comprehensive view of server performance. Since CPU and IO consumption translate directly to server hardware and cloud spend, this is significant. Most Queries Don't Wait.

Tuning 115

Tuning Servers Monitoring Hardware 115

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs. HotOS’19.

Hardware 58

Hardware Latency Serverless Energy 58

Alex Russell

MARCH 6, 2021

Hardware Past As Performance Prologue. This 2GiB RAM, Android 9 stalwart features the all-too classic lines of a Quad-core A53 (1.4GHz, small mercies) CPU, tastefully presented in a charming 5.5" Chip design choices and silicon economics are the defining feature of the still-growing Performance Inequality Gap. " package.

Performance 124

Performance Network Cache Metrics 124

Alex Russell

APRIL 29, 2021

Apple's policy against browser engine choice adds years of delays beyond the (expected) delay of design iteration, specification authoring, and browser feature development. Helps developers present better, more contextual options and prompts, reducing user annoyance and "prompt spam" Screen Wakelock. Permissions API.

Media 145

Media Games Education Engineering 145

The Morning Paper

MAY 28, 2019

The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Race logic has four primary operations that are easy to implement in hardware: MAX, MIN, ADD-CONSTANT, and INHIBIT. One efficient way of doing that in analog hardware is the use of current-starved inverters.

Energy 52

Energy Hardware Efficiency Architecture 52

KeyCDN

JULY 2, 2020

Web standards are best defined as guidelines developed by the World Wide Web Consortium W3C to promote consistency in design code which makes up a web page. For instance, when creating a website in the early 1990s, a designer would create each site to fit the browser for which it was intended.

Internet 56

Internet Internet Best Practices Website 56

Percona

JUNE 20, 2023

In order to overcome these issues, the concept of paging and segmentation was introduced, where physical address space and virtual address space were designed. Paging This was designed to allow non-contiguous space allocation to processes. At present, this is in the development phase.

Programming 83

Programming C++ Database Virtualization 83

ACM Sigarch

APRIL 8, 2019

Below we present some thoughts on the why and one solution to address the issue. This is arguably a fundamentally hard problem for computer architecture, but efforts towards open source hardware (eg. Her current work focuses on hardware/software co-design for extremely large-scale deep learning training. Why is that?

Architecture 74

Architecture Open Source Hardware Software Engineering 74

The Morning Paper

MARCH 17, 2020

Based on these findings, the authors present four guidelines to get the best performance out of this memory today. Optane DIMMs have lower latency and higher bandwidth than storage devices connected over PCIe (including Optane SSDs), and present a memory address-based interface as opposed to a block-based NVMe interface.

Scalability 59

Scalability Latency Cache Media 59