Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Testsigma

JUNE 3, 2021

He may think that the software got stuck and a system restart is needed. Hardware error. We focus on software so much that we forget about the hardware failures. If the hardware gets disconnected or stops working then we cannot expect correct output from the software. Hardware issues. Caching errors.

Software 82

Software Software Testing Hardware 82

Percona

MAY 2, 2023

ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. If we expand the cache concept more, the buffer pool could be even less if the working set (hot data) is smaller. Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. How large my InnoDB buffer pool needs to be?

Social Media 122

Social Media Database Servers Cache 122

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. Distributed tracing and instrumentation.

Big Data 45

Big Data Cloud Performance Hardware 45

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

AUGUST 18, 2019

BPF has been extended (aka eBPF) in recent years for providing a safe way to extend kernel functionality, and has become a hot topic in systems engineering, with at least 24 talks on BPF at the last Linux Plumber's conference. hardware Hardware counter-based instrumentation. system(".") BEGIN Start of bpftrace.

Latency 68

Latency C++ Cache Programming 68

CSS - Tricks

JULY 25, 2019

Cache-Headers missing? Lighthouse uses Chrome’s Remote Debugging Protocol to read network request information, measure JavaScript performance, observe accessibility standards and measure user-focused timing metrics like First Contentful Paint , Time to Interactive or Speed Index. After that, it’ll be mitigated by cache.

Google 71

Google Engineering Speed Mobile 71

Smashing Magazine

JANUARY 15, 2019

This includes the work done by the server, the client and the intermediary communications networks that transmit data between the two. how much data does the browser have to download to display your website) and resource usage of the hardware serving and receiving the website. Reduce Network Requests. Large preview ).

Website Performance 73

Website Performance Website Energy Performance 73

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. More importantly, if this works out well, this could lead to a radical improvement in performance by leveraging hardware trends such as GPUs and TPUs.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Scalegrid

DECEMBER 21, 2023

With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation. This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Dynatrace

AUGUST 30, 2019

She was speaking about how her team is providing Visibility as a Service (VaaS) in order to continuously monitor and optimize their systems running across private and public cloud environments. Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. You may ask: How is this possible?

Cache 195

Cache Architecture Database Government 195

The Netflix TechBlog

NOVEMBER 15, 2022

But it’s not easy: to pull this off, VFX studios need to build and operate serious technical infrastructure (compute, storage, networking, and software licensing), otherwise known as a “ render farm.” Additionally, Conductor supports render management systems?—?including including AWS Thinkbox Deadline and Pixar’s Tractor.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Highly Scalable

AUGUST 20, 2013

In recent years, this idea got a lot of traction and a whole bunch of solutions like Twitter’s Storm, Yahoo’s S4, Cloudera’s Impala, Apache Spark, and Apache Tez appeared and joined the army of Big Data and NoSQL systems. The system should deliver performance of tens of thousands messages per second even on clusters of minimal size.

Big Data 154

Big Data Processing Lambda Database 154

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 110

Availability Database Open Source Hardware 110

The Morning Paper

JUNE 25, 2019

There’s another emerging option that we didn’t talk about there: the use of far-memory , memory attached to the network that can be remotely accessed without mediation by a local processor. Processor caches can help to hide local accesses too, but not remote accesses. Clients cache the entire tree, but not the hash tables.

Design 80

Design Cache Hardware Scalability 80

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Delayed five years. Gamepad API.

Media 145

Media Games Education Engineering 145

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

The Morning Paper

APRIL 14, 2019

Just as today’s systems offer memory protection, they call this time protection. The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. There are also stateless interconnects including buses and on-chip networks.

Hardware 44

Hardware Cache Latency Speed 44

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. Complying with all applicable copyright laws is the responsibility of the user.

Servers 40

Servers Cache Media Hardware 40

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

The Morning Paper

SEPTEMBER 19, 2019

.” Crusher is a Google system for automatically discovering email templates (e.g. Could it be Analyzing efficient stream processing on modern hardware ? On one of the themes that captures my imagination, how changing hardware platform influence system design: Rethinking database high availability with RDMA networks.

Blockchain 46

Blockchain Hardware Google Analytics 46

The Morning Paper

FEBRUARY 20, 2020

Raven is the system that Microsoft built to explore this question, and answer it with a resounding yes. NN translation optimisations replace classical ML operators and data ‘featurizers’ with neural networks that can be executed directly in e.g. ONNX Runtime, PyTorch, or TensorFlow. " " Query execution.

Processing 72

Processing Hardware Database Azure 72

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

AUGUST 22, 2021

As we will see, QUIC and HTTP/3 indeed have great web performance potential, but mainly for users on slow networks. If your average visitor is on a fast cabled or cellular network, they probably won’t benefit from the new protocols all that much. An often used metaphor is that of a pipe used to transport water. Congestion Control.

Performance 105

Performance Network Latency Servers 105

Highly Scalable

APRIL 2, 2012

In particular, we built this system on top of Oracle Coherence and designed our own data structures and indexes. The first piece of functionality is structural or hierarchical navigation through categories and products, which are the main business entities of the system. System Properties and Major Technical Requirements.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

The Morning Paper

APRIL 2, 2019

Root of trust (RoT) establishment on an untrusted system ensures that a system state comprises all and only content chosen by the user, and the user’s code begins execution in that state. In this context it means there are no external dependencies on e.g. secrets, trusted hardware modules, or special instructions (e.g.

Software 40

Software Software Programming Hardware 40

Abhishek Tiwari

DECEMBER 27, 2017

A unified data management (UDM) system combines the best of data warehouses, data lakes, and streaming without expensive and error-prone ETL. It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Highly Scalable

SEPTEMBER 18, 2012

As such, it encompasses distributed system coordination, failover, resource management and many other capabilities. These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. System Coordination. Scalability is one of the main drivers of the NoSQL movement.

Database 213

Database Latency C++ Scalability 213

The Morning Paper

NOVEMBER 14, 2019

It’s another networking paper to close out the week (and our coverage of SOSP’19), but whereas Snap looked at traffic routing within the datacenter, Taiji is concerned with routing traffic from the edge to a datacenter. Sharing is caring caching. For example, balance utilisation across all data centers, or optimise for network latency.

Traffic 42

Traffic Internet Internet Latency 42

Alex Russell

OCTOBER 22, 2017

We constrain ourselves to a real-world baseline device + network configuration to measure progress. Budgets are scaled to a benchmark network & device. Tools and CI systems help them monitor progress & prevent regressions. The median user is on a slow network. Global Ground-Truth. Where to start?

Performance 68

Performance Benchmarking Network Mobile 68

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40