The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

The Netflix TechBlog

MARCH 8, 2021

They need specialized hardware, access to petabytes of images, and digital content creation applications with controlled licenses. Instead, we created a service to take the most popular configurations and cache them. We needed a system that could manage hundreds to one-day thousands of workstations. How did we get here?

Entertainment 306

Entertainment Storage Hardware Open Source 306

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. Existing cache and main memory compression techniques compress data in small fixed-size blocks, typically cache lines. Hotpads is a hardware-managed hierarchy of scratchpad-like memories called pads.

Cache 61

Cache Benchmarking Hardware Java 61

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. A distributed file system provides a unified view over aggregated storage from multiple physical machines.

Storage 64

Storage Systems Hardware Efficiency 64

Percona

JUNE 22, 2023

We will also discuss related configuration variables to consider that can impact these KPIs, helping you gain a comprehensive understanding of your MySQL server’s performance and efficiency. Query performance Query performance is a key performance indicator (KPI) in MySQL, as it measures the efficiency and speed of query execution.

Performance 102

Performance Monitoring Traffic Database 102

Dynatrace

AUGUST 30, 2019

She was speaking about how her team is providing Visibility as a Service (VaaS) in order to continuously monitor and optimize their systems running across private and public cloud environments. Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. You may ask: How is this possible?

Cache 201

Cache Architecture Database Government 201

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Simplicity. Data Store.

Serverless 286

Serverless AWS Lambda Storage 286

Percona

AUGUST 8, 2023

As such, one of the more common questions I get from my clients is whether or not their system will be able to endure an anticipated load increase. Hardware considerations The first thing we have to consider here is the resources that the underlying host provides to the database. Let’s take a look at each common resource.

Traffic 87

Traffic Cache Monitoring Database 87

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 105

Availability Database Open Source Hardware 105

ACM Sigarch

OCTOBER 12, 2020

To be clear, these languages were not designed to be fast or space-efficient, but for ease of use. Unfortunately, languages like Python have proven resistant to efficient implementation, partly because of their design, and partly because of limitations imposed by the need to interop with C code. Are caches large enough for this code?

C++ 108

C++ Benchmarking Hardware Architecture 108

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. Cached vs Scaled Workloads. HammerDB is a software application for database benchmarking. HammerDB Licensing.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

JUNE 25, 2019

Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. This paper is all about the design of efficient data structures for far-memory, which turns out to have consequences reaching all the way down to the hardware.

Design 80

Design Cache Hardware Scalability 80

ACM Sigarch

JULY 17, 2023

An example of a specification is the correct operation of the hardware of a microprocessor. An SDC is the worst possible outcome of a fault, as it can have an arbitrary impact on the correctness of software running on the hardware. Background A fault is a condition that causes the inability to meet a specification.

Energy 52

Energy Hardware Best Practices Architecture 52

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Applications and files systems access App Direct memory using CPU instructions offering a variety of options for controlling the ordering of store operations: cache-line flush, cache-line write back, and non-temporal stores (bypassing the cache hierarchy).

Scalability 59

Scalability Latency Cache Media 59

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Form-associated Web Components.

Media 145

Media Games Education Engineering 145

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. Distributed tracing and instrumentation.

Big Data 45

Big Data Cloud Performance Hardware 45

Smashing Magazine

AUGUST 15, 2021

Cache Merril. Companies can use technology roadmaps to review their internal IT , DevOps, infrastructure, architecture, software, internal system, and hardware procurement policies and procedures with innovation and efficiency in mind. What gaps in systems and capabilities need to be filled to succeed?

Technology 139

Technology Technology Development Strategy 139

Highly Scalable

APRIL 2, 2012

In particular, we built this system on top of Oracle Coherence and designed our own data structures and indexes. The first piece of functionality is structural or hierarchical navigation through categories and products, which are the main business entities of the system. Business Logic: Hierarchical and Faceted Navigation.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

The Morning Paper

SEPTEMBER 19, 2019

.” Crusher is a Google system for automatically discovering email templates (e.g. Could it be Analyzing efficient stream processing on modern hardware ? On one of the themes that captures my imagination, how changing hardware platform influence system design: Rethinking database high availability with RDMA networks.

Blockchain 46

Blockchain Hardware Google Analytics 46

Abhishek Tiwari

DECEMBER 27, 2017

A unified data management (UDM) system combines the best of data warehouses, data lakes, and streaming without expensive and error-prone ETL. It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. This improves page load time and caching during navigations.

Performance 145

Performance Cache Media Metrics 145

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Smashing Magazine

JANUARY 6, 2020

On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). In exchange, your team gains maintainability and developer efficiency, of course. From Fast By Default: Modern loading best practices by Addy Osmani (Slide 19).

Performance 145

Performance Cache Network Metrics 145

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. Our only option was to roll up our sleeves and build basic cloud file system components such as object store ourselves. Edge caching. Nginx for disk based caching. Java used to power core file system code. Introduction.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 7, 2019

On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). In exchange, your team gains maintainability and developer efficiency, of course. But this consideration needs to be deliberate. Image credit: Addy Osmani ) ( Large preview ).

Performance 104

Performance Cache Network Metrics 104

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. Apart from indexes, super efficient sorting and join operations are some major areas come to my mind with immediate benefits of using learned data structure. For instance, one can practically fit an entire learned index into the GPU’s memory.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Highly Scalable

SEPTEMBER 18, 2012

As such, it encompasses distributed system coordination, failover, resource management and many other capabilities. These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. System Coordination. Scalability is one of the main drivers of the NoSQL movement.

Database 213

Database Latency C++ Scalability 213

The Morning Paper

SEPTEMBER 12, 2019

If you think about a system like Procella that’s combining transactional and analytic workloads on top of a cloud-native architecture, extensions to SQL for streaming , dataflow based materialized views (see e.g. It would be a bold departure from the current imperative high-level DSL based approach to deep learning taken by TensorFlow et al.,

Network 44

Network Database Programming Hardware 44