The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. Linux to the rescue?

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. Existing cache and main memory compression techniques compress data in small fixed-size blocks, typically cache lines. Hotpads is a hardware-managed hierarchy of scratchpad-like memories called pads.

Cache 61

Cache Benchmarking Hardware Java 61

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Using a low-code visual workflow approach, organizations can orchestrate key services, automate critical processes, and create new serverless applications.

Serverless 280

Serverless AWS Lambda Storage 280

Percona

JUNE 22, 2023

We will also discuss related configuration variables to consider that can impact these KPIs, helping you gain a comprehensive understanding of your MySQL server’s performance and efficiency. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution.

Performance 107

Performance Monitoring Traffic Database 107

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Dynatrace

AUGUST 30, 2019

Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Missing caching layers, e.g. provide a read-only cache for static data. Missing retry and failover implementations.

Cache 198

Cache Architecture Database Government 198

The Morning Paper

DECEMBER 1, 2019

Efficient lock-free durable sets Zuriel et al., Memory might be durable, but… …it is expected that caches and registers will remain volatile. One bit is used to mark a node as invalid while it is in the process of being inserted into the list, and the other bit is used as a logical deletion marker. OOPSLA’19.

Efficiency 60

Efficiency Cache C++ Performance 60

Randon ASCII

SEPTEMBER 30, 2022

A twenty-second delay for recording a forty-second clip is a pretty bad efficiency ratio. Modern software loves to use additional processes so I wasn’t surprised when the busiest process wasn’t SoundRec.exe , but the verbosely named “RuntimeBroker.exe <Microsoft.WindowsSoundRecorder>”.

Software 130

Software Software Cache Hardware 130

Percona

AUGUST 8, 2023

Hardware considerations The first thing we have to consider here is the resources that the underlying host provides to the database. Global caches like the InnoDB buffer pool and MyISAM key cache and session-level caches like the sort buffer, join buffer, random read buffer, etc. Do these queries use more caches?

Traffic 90

Traffic Cache Monitoring Database 90

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Cached vs Scaled Workloads.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

The Morning Paper

JUNE 25, 2019

Far memory brings many potential benefits over near memory: higher memory capacity through disaggregation, separate scaling between processing and far memory, better availability due to separate fault domains for far memory, and better shareability among processors. Clients cache the entire tree, but not the hash tables.

Design 80

Design Cache Hardware Scalability 80

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Morning Paper

NOVEMBER 5, 2019

Breaking that assumption allowed Ceph to introduce a new storage backend called BlueStore with much better performance and predictability, and the ability to support the changing storage hardware landscape. Readers of this blog properly have a pretty good idea what ‘efficient transactions’ and ‘fast metadata operations’ are all about.

Storage 64

Storage Systems Hardware Efficiency 64

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. If a primary server fails, a backup server can take over and continue to serve requests.

Availability 111

Availability Database Open Source Hardware 111

ACM Sigarch

JULY 17, 2023

An example of a specification is the correct operation of the hardware of a microprocessor. An SDC is the worst possible outcome of a fault, as it can have an arbitrary impact on the correctness of software running on the hardware. Background A fault is a condition that causes the inability to meet a specification.

Energy 52

Energy Hardware Best Practices Architecture 52

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

SQL Server According to Bob

JANUARY 11, 2020

Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well. Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

Highly Scalable

APRIL 2, 2012

Categories can contain thousands of products and user cannot efficiently search though this array without powerful tools. The rationale behind these methods is that frontend should be able to fetch transient information very efficiently and separately from fetching of heavy-weight domain entities because this information cannot be cached.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. In fact, choosing the right metric is a process without obvious winners.

Performance 145

Performance Cache Media Metrics 145

Alex Russell

APRIL 29, 2021

Efficiently enables new styles of drawing content on the web , removing many hard tradeoffs between visual richness , accessibility, and performance. These TransformStream types help applications efficiently deal with large amounts of binary data. Helps media apps on the web save battery when doing video processing.

Media 145

Media Games Education Engineering 145

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

SEPTEMBER 19, 2019

It handles an order of magnitude more throughput than a prototype built on a stream processing engine. Could it be Analyzing efficient stream processing on modern hardware ? .” Crusher is a Google system for automatically discovering email templates (e.g. for machine generated emails sent to humans).

Blockchain 46

Blockchain Hardware Google Analytics 46

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Network Metrics 145

Percona

APRIL 17, 2023

Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache. Unfortunately, MongoDB is not NUMA-aware, and because of this, MongoDB can allocate memory unevenly, leading to the swap issue even with memory available. 25.84 - Total 21.04 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Smashing Magazine

JANUARY 7, 2019

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 103

Performance Cache Metrics Network 103

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Read/Write requests are processes with a minimal latency. Read/Write latency.

Database 213

Database Latency C++ Scalability 213

KeyCDN

JULY 11, 2019

When it comes to optimizing your website, images are generally the most important asset you should spend time on figuring out how to reduce in size and deliver in a more efficient way. Image Processing Service We offer an image processing service that is fully integrated into our existing network. Mbps ( Opensignal ).

Speed 52

Speed Website Mobile Latency 52

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. GAIA proposed to expand the OS page cache into accelerator memory. ATC ’19 was refreshingly different. Heterogeneous ISA.

Architecture 12

Architecture Hardware Cache Storage 12

SQL Server According to Bob

JANUARY 11, 2020

DBCC Page Auditing DBCC page auditing is the process of executing common DBCC consistency checks as pages are read from disk. Time of Last Access The time of last access is a caching ​​ algorithm ​​ that enables ​​ cache ​​ entries to be ordered by their ​​ access times.

Servers 40

Servers Cache Database Media 40

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation. This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Alex Russell

OCTOBER 22, 2017

Answering it requires an understanding of how browsers process resources (which differs by type) and the concept of the critical path. This input processing happens on document’s main thread , where JavaScript runs. Processing input (including scrolling w/ active touch listeners). ” A good question!

Performance 68

Performance Benchmarking Network Mobile 68

Smashing Magazine

JANUARY 15, 2019

how much data does the browser have to download to display your website) and resource usage of the hardware serving and receiving the website. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

SQL Performance

MARCH 8, 2021

. ( MAXDOP 1 , USE HINT ( 'DISABLE_BATCH_MODE_ADAPTIVE_JOINS' ) ) ; The execution plan is ( click to enlarge ): Every operator in this plan runs in batch mode, thanks to the batch mode on rowstore Intelligent Query Processing feature in SQL Server 2019 (no columnstore index needed). hash table).

Servers 95

Servers Tuning Architecture Processing 95

Smashing Magazine

AUGUST 15, 2021

Cache Merril. In an Agile approach, a technology roadmap feeds the sprint and grooming processes, providing insight into how the product will travel from start to finish. How A Technology Roadmap Feeds The Agile Sprint And Grooming Processes. How To Develop Your Business’ Technology Roadmap. 2021-08-16T06:55:00+00:00.

Technology 139

Technology Technology Development Strategy 139

Smashing Magazine

APRIL 29, 2021

Use srcset + efficient modern image formats. Device Pixel Ratio (DPR) represents how a CSS pixel is translated to physical pixels on a hardware screen. will optimize images dynamically upon request and store them in a local cache. Avoid wasting pixels (compress, don’t serve overly high DPR images). Large preview ). Note: Next.js

Media 145

Media Network Metrics Mobile 145