Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 8, 2016

The solution, which leverages Amazon Kinesis, Amazon DynamoDB, and Amazon EMR to collect, store, and process the data, as well as AWS CloudFormation and AWS OpsWorks to support the Globe's DevOps environment, was deployed in three months—less than half the time it would have taken had the newspaper built it on-premises.

AWS 155

AWS Cloud Lambda Innovation 155

SQL Performance

MAY 1, 2020

In a recent tip , I described a scenario where a SQL Server 2016 instance seemed to be struggling with checkpoint times. I was a bit perplexed by this issue, since the system was certainly no slouch — plenty of cores, 3TB of memory, and XtremIO storage. SQL 2016 – It Just Runs Faster: Indirect Checkpoint Default.

C++ 58

C++ Database Servers Storage 58

SQL Server According to Bob

NOVEMBER 8, 2016

SQL Server 2016 Service Pack 1 (all SKUs) , in combination with Windows Server 2016 (All SKUs) or Windows 10 Client introduces non-volatile memory support for the tail of the log file (LDF) which can significantly increase transaction throughput. Block storage is what you think of today as disk access. Tail Of Log Caching.

Cache 40

Cache Servers Media Storage 40

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. Efficient data processing and indexing, making it optimal for executing queries and handling large datasets. GA 23 February 2016 5.7.10-3

Open Source 52

Open Source Servers Storage Scalability 52

Scalegrid

JULY 17, 2020

JSON is faster to ingest vs. JSONB – however, if you do any further processing, JSONB will be faster. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint. whitespace) and ordering of the keys.

Storage 321

Storage Database Efficiency Processing 321

Smashing Magazine

JANUARY 15, 2019

An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu. These include data transfer (i.e. In Conclusion.

Website Performance 74

Website Performance Website Energy Performance 74

All Things Distributed

DECEMBER 13, 2016

In just this past month we've had HSBC , ARM , Missguided , and most recently at re:Invent 2016 , Trainline , talking with us about how they are using AWS to transform and scale their businesses. Take GoSquared , a UK startup that runs all its development and production processes on AWS, as an example.

AWS 166

AWS Cloud Artificial Intelligence IoT 166

CSS Wizardry

MARCH 3, 2019

We’ve talked a lot so far about revalidation: the process of the browser making the trip back to the server to check whether a fresher file might be available. Tip: There are a number of directives that Clear-Site-Data will accept: "cookies" , "storage" , "executionContexts" , and "*" (which, naturally, means ‘all of the above’).

Cache 264

Cache Latency Strategy Servers 264

Percona

JANUARY 24, 2023

Some of the built-in features ( wal_compression ) have been there since 2016, and almost all backup tools do the WAL compression before taking it to the backup repository. Individual processes generate WAL records, and latency is very crucial for transactions. The actual benefit of compression depends on many factors.

Database 115

Database Benchmarking Open Source Latency 115

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. AWS EC2 uses a different image type and boot process for PV and HVM, as described on the [Linux AMI Virtualization Types] page.

Virtualization 111

Virtualization AWS Hardware Storage 111

Percona

AUGUST 18, 2023

And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. 10) starting as process 20477 2023-07-10T05:26:52.094196Z 0 [Warning] [MY-010068] [Server] CA certificate ca.pem is self signed. 10-Linux.x86_64.ssl101.tar.gz

Programming 84

Programming Servers Database Hardware 84

SQL Server According to Bob

DECEMBER 18, 2018

Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. Neal, Matt, and others from Windows Storage, Windows Azure Storage, Windows Hyper-V, … validating Windows behaviors. · Any storage device that can survive a power outage. Starting with the Linux 4.18

Servers 90

Servers Media Cache Storage 90

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

FEBRUARY 8, 2022

In 2016, I released the first version of the tool, then called not Statoscope, but Webpack Runtime Analyzer. This is all part of Webpack’s optimization process, in order to reduce the size of output assets. Webpack provides Statoscope with information about all the modules, chunks and assets that it encounters during the build process.

Storage 81

Storage Code Metrics C++ 81

SQL Performance

SEPTEMBER 5, 2019

You will need SQL Server 2016 (or later) and Developer Edition (or equivalent) to reproduce the results shown here. This table uses columnstore for its primary storage to produce batch mode execution later on. You might call this arrangement "off-row" or "out-of-batch" storage. DROP TABLE IF EXISTS #T ; GO. c1 = @Start + N.

Performance 81

Performance C++ Storage Servers 81

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. AWS EC2 uses a different image type and boot process for PV and HVM, as described on the [Linux AMI Virtualization Types] page.

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

SEPTEMBER 5, 2017

LTS (April 2016). There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). I wrote about it in a previous post, [DTrace for Linux 2016]. Both of those should be easy fixes. It's the official profiler.

Virtualization 76

Virtualization AWS Engineering Hardware 76

SQL Performance

APRIL 23, 2019

This eliminated unnecessary row-mode processing, and removed the need for an exchange. SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. Columnstore storage. Value encoding can reduce the number of bits required for storage by translating raw values using a base offset and magnitude modifier.

Servers 67

Servers Testing Metrics Storage 67

SQL Performance

AUGUST 23, 2019

This difference between row mode and batch mode execution makes it less easy to see if a bitmap is being created, but it does more accurately reflect the underlying process: In row-mode execution, the Bitmap operator populates the bitmap as rows flow through it, one at a time, before reaching the hash join build input.

Servers 75

Servers Engineering Efficiency Retail 75

Particular Software

OCTOBER 3, 2017

This article was originally published on the NDC 2016 Blog. These events can then be used to trigger other downstream business processes. In this model, the software system follows the natural business process. Repeat this process until you've captured all the important actions as events your monolith is performing.

Architecture 49

Architecture Database Code Systems 49

Alex Russell

APRIL 29, 2021

At the time of the last Confluence run, the gap had stretched to nearly 1000 APIs, doubling since 2016. Chrome has missed several APIs for 3+ years: Storage Access API. Helps media apps on the web save battery when doing video processing. But perhaps counting APIs gives a distorted view? Some relatively minor additions (e.g.

Media 145

Media Games Education Engineering 145

Alex Russell

OCTOBER 22, 2017

Answering it requires an understanding of how browsers process resources (which differs by type) and the concept of the critical path. This input processing happens on document’s main thread , where JavaScript runs. Processing input (including scrolling w/ active touch listeners). ” A good question!

Performance 68

Performance Benchmarking Network Mobile 68

Testsigma

FEBRUARY 12, 2021

The implementation of emerging technologies has helped improve the process of software development, testing, design and deployment. With all of these processes in place, cost optimization is also a high concern for organizations worldwide. billion in 2016. Dominance of Robotic Process Automation. Hyperautomation.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Percona

JANUARY 14, 2019

Processed 4.15 Processed 4.15 Processed 8.19 Processed 8.19 Processed 4.15 In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Processed 3.05 Processed 8.19

Database 40

Database Analytics Blockchain Healthcare 40