The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. Linux to the rescue?

Cache 251

Cache Latency Airlines Logistics 251

Scalegrid

DECEMBER 21, 2023

To achieve optimal tracking results it is important to choose wisely among available tools like Prometheus or Grafana, which offer deeper insights into understanding your Redis® instances for better performance optimization. Setting Up RedisInsight Getting RedisInsight up and running is a simple process.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Using a low-code visual workflow approach, organizations can orchestrate key services, automate critical processes, and create new serverless applications.

Serverless 276

Serverless AWS Lambda Storage 276

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. A finely tuned database processes queries more efficiently, leading to swifter results. MySQL relies heavily on the availability of hardware resources to perform at its best.

Tuning 52

Tuning Database Performance Hardware 52

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Refer to innodb_redo_log_capacity below.

Performance 127

Performance Hardware Tuning Storage 127

Percona

JANUARY 3, 2024

ProxySQL is a high-performance SQL proxy that runs as a daemon watched by a monitoring process. The process monitors the daemon and restarts it in case of a crash to minimize downtime. The daemon accepts incoming traffic from MySQL clients and forwards it to backend MySQL servers.

Traffic 111

Traffic Hardware Cache Servers 111

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., It’s a pretty impressive effort to pull together and make available in open source (not yet available as I write this) such a suite, and I’m sure explains much of the long list of 24 authors on this paper.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

AUGUST 30, 2019

Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. We have several YouTube Tutorials and blog posts available that show how you can use Dynatrace RUM data for Web Performance & User Experience Optimization. Missing caching layers, e.g. provide a read-only cache for static data.

Cache 195

Cache Architecture Database Government 195

Scalegrid

JANUARY 5, 2024

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. It provides tools for organizing and retrieving data efficiently.

Efficiency 147

Efficiency Storage Database Scalability 147

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. error_log: Specifies the location of the MySQL error log.

Performance 106

Performance Monitoring Traffic Database 106

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

John McCalpin

SEPTEMBER 17, 2018

Most Intel microprocessors support “HyperThreading” (Intel’s trademark for their implementation of “simultaneous multithreading”) — which allows the hardware to support (typically) two “Logical Processors” for each physical core. leaving half of the Logical Processors idle).

Hardware 40

Hardware Performance Cache Programming 40

Testsigma

JUNE 3, 2021

Example: An e-commerce website is unable to process the payment part. On-screen information for users: The information which is required by the user should be available on the application screen itself. Otherwise, it may result in the processing of garbage data and erroneous results. Hardware error. Hardware issues.

Software 82

Software Software Testing Hardware 82

Percona

MAY 1, 2023

Key areas include: Configuration parameter tuning : This tuning involves altering variables such as memory allocation, disk I/O settings, and concurrent connections based on specific hardware and requirements. Throughput: The throughput of an application is directly influenced by the speed at which the database can process and serve queries.

Tuning 52

Tuning Efficiency Database Performance 52

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Cached vs Scaled Workloads. Supported Databases.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

MAY 2, 2023

Let’s look at some questions I did that a MySQL DBA usually needs to answer in an interview process. ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. A commonly recommended value for the buffer pool size is between 50% to 75% of the available memory.

Social Media 122

Social Media Database Servers Cache 122

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

The Morning Paper

JUNE 25, 2019

Far memory brings many potential benefits over near memory: higher memory capacity through disaggregation, separate scaling between processing and far memory, better availability due to separate fault domains for far memory, and better shareability among processors. Clients cache the entire tree, but not the hash tables.

Design 80

Design Cache Hardware Scalability 80

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. cache) can be partitioned across domains; for those that are instead time-multiplexed, we have to flush them during domain switches. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

ACM Sigarch

JULY 17, 2023

An example of a specification is the correct operation of the hardware of a microprocessor. An SDC is the worst possible outcome of a fault, as it can have an arbitrary impact on the correctness of software running on the hardware. Background A fault is a condition that causes the inability to meet a specification.

Energy 52

Energy Hardware Best Practices Architecture 52

SQL Server According to Bob

JANUARY 11, 2020

Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well. Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. In fact, choosing the right metric is a process without obvious winners.

Performance 145

Performance Cache Media Metrics 145

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. BTW, the "i" in the Standard_E64is_v3 naming means that the instance is isolated to hardware dedicated to a single customer.

Azure 72

Azure Virtualization Servers Storage 72

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. The information it captures is, however, available going back somewhat further, providing a fuller picture of the trend lines of engine completeness. Count of APIs available from JavaScript by Web Confluence.

Media 145

Media Games Education Engineering 145

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Smashing Magazine

JANUARY 6, 2020

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Network Metrics 145

Brendan Gregg

AUGUST 18, 2019

This example instrumented one of many thousands of available events. bpftrace uses BPF (Berkeley Packet Filter), an in-kernel execution engine that processes a virtual instruction set. hardware Hardware counter-based instrumentation. pid process ID. comm Process or command name. kstack Kernel stack trace.

Latency 68

Latency C++ Cache Programming 68

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Modern network performance and availability. Advances in browser content processing. Hardware Past As Performance Prologue. The Moto G4 , for example. Content Is Dead, Long Live Content.

Performance 124

Performance Network Cache Metrics 124

KeyCDN

JANUARY 23, 2020

These acronyms, which stand for real user monitoring and application performance monitoring, are software monitoring processes essential to measuring and evaluating applications in many different areas. This process should not be confused with synthetic monitoring which gathers data through synthetic transactions such as pinging a service.

Strategy 72

Strategy Metrics Monitoring Servers 72

Smashing Magazine

JANUARY 7, 2019

So, if we created an overview of all the things we have to keep in mind when improving performance — from the very start of the process until the final release of the website — what would that list look like? Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 103

Performance Cache Metrics Network 103

The Morning Paper

OCTOBER 4, 2020

Emerging architectures that shorten the path length, e.g. edge caching and computing, may also confine the latency. The bulk of this latency comes from on-device frame processing, not network transmission delay. Application performance. In a web browsing test, 5G only reduced page loading times (PLT) by about 5% compared to 4G.

Energy 130

Energy Latency Performance Network 130

Highly Scalable

APRIL 2, 2012

Besides this, each product has some transient information like in-stock availability that is a subject of frequent updates (every 5 minutes or so). It is important that this style of navigation assumes high interactivity – each selection leads to recomputing of all available facets, their cardinalities, and products in a result set.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

The Morning Paper

SEPTEMBER 19, 2019

It handles an order of magnitude more throughput than a prototype built on a stream processing engine. Could it be Analyzing efficient stream processing on modern hardware ? .” Crusher is a Google system for automatically discovering email templates (e.g. for machine generated emails sent to humans). What’s their secret???

Blockchain 46

Blockchain Hardware Google Analytics 46

SQL Server According to Bob

DECEMBER 18, 2018

Device level flushing may have an impact on your I/O caching, read ahead or other behaviors of the storage system. FILE_FLAG_NO_BUFFERING is the Win32, CreateFile API flags and attributes setting to bypass file system cache. FILE_FLAG_NO_BUFFERING is the Win32, CreateFile API flags and attributes setting to bypass file system cache.

Servers 90

Servers Media Cache Storage 90

ScaleOut Software

JULY 27, 2018

Hosted on commodity clusters or cloud infrastructures, IMDGs harness the power of distributed computing to deliver scalable storage capacity and access throughput, along with integrated high availability. Looking beyond distributed caching, it’s their ability to perform data-parallel analysis that gives IMDGs such exciting capabilities.

Scalability 40

Scalability Cache Airlines Healthcare 40