ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. A distributed file system provides a unified view over aggregated storage from multiple physical machines.

Storage 64

Storage Systems Hardware Efficiency 64

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130

Storage Systems Big Data Azure 130

The Morning Paper

MARCH 8, 2020

This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) have altered the many assumptions that guided the design and optimization of the Snowflake system. From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MAY 14, 2019

Last time around we looked at the DeathStarBench suite of microservices-based benchmark applications and learned that microservices systems can be especially latency sensitive, and that hotspots can propagate through a microservices architecture in interesting ways. Distributed tracing and instrumentation.

Big Data 45

Big Data Cloud Performance Hardware 45

Scalegrid

DECEMBER 21, 2023

With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

Abhishek Tiwari

DECEMBER 13, 2017

This has far-reaching implications how future data systems and algorithms will be designed. Apart from indexes, super efficient sorting and join operations are some major areas come to my mind with immediate benefits of using learned data structure. For instance, one can practically fit an entire learned index into the GPU’s memory.

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Highly Scalable

AUGUST 20, 2013

In recent years, this idea got a lot of traction and a whole bunch of solutions like Twitter’s Storm, Yahoo’s S4, Cloudera’s Impala, Apache Spark, and Apache Tez appeared and joined the army of Big Data and NoSQL systems. The system should deliver performance of tens of thousands messages per second even on clusters of minimal size.

Big Data 154

Big Data Processing Lambda Database 154

DZone

AUGUST 16, 2019

Application scalability is the potential of an application to grow in time, being able to efficiently handle more and more requests per minute (RPM). It’s not just a simple tweak you can turn on/off; it’s a long-time process that touches almost every single item in your stack, including both hardware and software sides of the system.

Scalability 145

Scalability Efficiency Hardware Software 145

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation. This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Dynatrace

AUGUST 30, 2019

She was speaking about how her team is providing Visibility as a Service (VaaS) in order to continuously monitor and optimize their systems running across private and public cloud environments. Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. You may ask: How is this possible?

Cache 195

Cache Architecture Database Government 195

Smashing Magazine

JANUARY 15, 2019

how much data does the browser have to download to display your website) and resource usage of the hardware serving and receiving the website. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

Percona

AUGUST 8, 2023

As such, one of the more common questions I get from my clients is whether or not their system will be able to endure an anticipated load increase. Hardware considerations The first thing we have to consider here is the resources that the underlying host provides to the database. Let’s take a look at each common resource.

Traffic 92

Traffic Cache Monitoring Database 92

The Netflix TechBlog

MARCH 8, 2021

They need specialized hardware, access to petabytes of images, and digital content creation applications with controlled licenses. Instead, we created a service to take the most popular configurations and cache them. We needed a system that could manage hundreds to one-day thousands of workstations. How did we get here?

Entertainment 306

Entertainment Storage Hardware Open Source 306

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Simplicity. Data Store.

Serverless 276

Serverless AWS Lambda Storage 276

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. Cached vs Scaled Workloads. HammerDB is a software application for database benchmarking. HammerDB Licensing.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

ACM Sigarch

OCTOBER 12, 2020

To be clear, these languages were not designed to be fast or space-efficient, but for ease of use. Unfortunately, languages like Python have proven resistant to efficient implementation, partly because of their design, and partly because of limitations imposed by the need to interop with C code. Are caches large enough for this code?

C++ 108

C++ Benchmarking Hardware Architecture 108

The Morning Paper

JUNE 25, 2019

Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. This paper is all about the design of efficient data structures for far-memory, which turns out to have consequences reaching all the way down to the hardware.

Design 80

Design Cache Hardware Scalability 80

Alex Russell

APRIL 29, 2021

After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Consistent improvement is the name of the game, and it can still have positive impacts, particularly as users lean on the system more heavily over time. Form-associated Web Components.

Media 145

Media Games Education Engineering 145

Smashing Magazine

AUGUST 15, 2021

Cache Merril. Companies can use technology roadmaps to review their internal IT , DevOps, infrastructure, architecture, software, internal system, and hardware procurement policies and procedures with innovation and efficiency in mind. What gaps in systems and capabilities need to be filled to succeed?

Technology 139

Technology Technology Development Strategy 139

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 112

Availability Database Open Source Hardware 112

ACM Sigarch

JULY 17, 2023

An example of a specification is the correct operation of the hardware of a microprocessor. An SDC is the worst possible outcome of a fault, as it can have an arbitrary impact on the correctness of software running on the hardware. Background A fault is a condition that causes the inability to meet a specification.

Energy 52

Energy Hardware Best Practices Architecture 52

The Morning Paper

DECEMBER 10, 2019

. …software operating on persistent data structures requires "global" pointers that remain valid after a process terminates, while hardware requires that a diverse set of devices all have the same mappings they need for bulk transfers to and from memory, and that they be able to do so for a potentially heterogeneous memory system.

Hardware 52

Hardware Virtualization Operating System Programming 52

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach.

Database 167

Database Lambda AWS IoT 167

SQL Server According to Bob

JANUARY 11, 2020

This will help you increase system performance and avoid I/O environment errors. Important When planning, deploying, and maintaining a Microsoft SQL Server installation, ensure that the I/O system supports all the factors outlined in this article. The modifications persist even in the event of a system failure.

Servers 40

Servers Cache Media Hardware 40

Highly Scalable

APRIL 2, 2012

In particular, we built this system on top of Oracle Coherence and designed our own data structures and indexes. The first piece of functionality is structural or hierarchical navigation through categories and products, which are the main business entities of the system. Business Logic: Hierarchical and Faceted Navigation.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

The Morning Paper

MARCH 17, 2020

most recently ‘ Efficient lock-free durable sets ‘). Applications and files systems access App Direct memory using CPU instructions offering a variety of options for controlling the ordering of store operations: cache-line flush, cache-line write back, and non-temporal stores (bypassing the cache hierarchy).

Scalability 59

Scalability Latency Cache Media 59

The Morning Paper

SEPTEMBER 19, 2019

.” Crusher is a Google system for automatically discovering email templates (e.g. Could it be Analyzing efficient stream processing on modern hardware ? On one of the themes that captures my imagination, how changing hardware platform influence system design: Rethinking database high availability with RDMA networks.

Blockchain 46

Blockchain Hardware Google Analytics 46

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Abhishek Tiwari

DECEMBER 27, 2017

A unified data management (UDM) system combines the best of data warehouses, data lakes, and streaming without expensive and error-prone ETL. It offers reliability and performance of a data warehouse, real-time and low-latency characteristics of a streaming system, and scale and cost-efficiency of a data lake.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

Highly Scalable

SEPTEMBER 18, 2012

As such, it encompasses distributed system coordination, failover, resource management and many other capabilities. These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. System Coordination. Scalability is one of the main drivers of the NoSQL movement.

Database 213

Database Latency C++ Scalability 213

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

The Morning Paper

SEPTEMBER 12, 2019

If you think about a system like Procella that’s combining transactional and analytic workloads on top of a cloud-native architecture, extensions to SQL for streaming , dataflow based materialized views (see e.g. It would be a bold departure from the current imperative high-level DSL based approach to deep learning taken by TensorFlow et al.,

Network 44

Network Database Programming Hardware 44