The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Last time out we looked at some of the trade-offs between RInKs and LInKs , and the advantages of local in-memory data structures. For many data center applications this looks to me like it could be a compelling future choice. HotOS’19.

Design 80

Design Cache Hardware Scalability 80

Dynatrace

AUGUST 30, 2019

Reducing CPU Utilization to now only consume 15% of initially provisioned hardware. We have several YouTube Tutorials and blog posts available that show how you can use Dynatrace RUM data for Web Performance & User Experience Optimization. Here are two I would start with: Web Performance Optimization with Dynatrace.

Cache 198

Cache Database Architecture Government 198

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. You can set this by adding the following lines to the /etc/sysctl.conf : vm.dirty_ratio = 15 vm.dirty_background_ratio = 5 Filesystems mount options MongoDB recommends the XFS filesystem for on-disk database data.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. Fault tolerance aims for zero downtime and data loss. Data replication : Data is continually copied from one database to another to ensure that the system remains operational even if one database fails.

Availability 111

Availability Database Open Source Hardware 111

Percona

JUNE 22, 2023

Database uptime and availability Monitoring database uptime and availability is crucial as it directly impacts the availability of critical data and the performance of applications or websites that rely on the MySQL database. Disk space usage Monitor the disk space usage of MySQL data files, log files, and temporary files.

Performance 107

Performance Monitoring Traffic Database 107

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For the network, we can use Iperf to assess the network bandwidth between the client and the database server to ensure it will be enough to meet our peak requirement.

Performance 54

Performance Benchmarking Cache Storage 54

Testsigma

JUNE 3, 2021

Otherwise, it may result in the processing of garbage data and erroneous results. Hardware error. We focus on software so much that we forget about the hardware failures. If the hardware gets disconnected or stops working then we cannot expect correct output from the software. Data handling errors. Hardware issues.

Software 82

Software Software Testing Hardware 82

Scalegrid

APRIL 16, 2020

Since our BYOC plans are hosted through your own AWS or Azure account, all cloud instances, backups and data transfer costs are paid directly through your cloud provider. While this is a good way to get a rough estimate, your monthly cloud costs will indeed vary based on the amount of backups performed and your data transfer activity.

Cloud 242

Cloud Azure AWS Database 242

CSS Wizardry

AUGUST 7, 2019

TTFB isn’t just time spent on the server, it is also the time spent getting from our device to the sever and back again (carrying, that’s right, the first byte of data!). The reason is because mobile networks are, as a rule, high latency connections. only to find that the resource they’re requesting isn’t in that PoP ’s cache.

Latency 269

Latency Ecommerce Servers Mobile 269

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., When a QoS violation is predicted to occur and a culprit microservice located, Seer uses a lower level tracing infrastructure with hardware monitoring primitives to identify the reason behind the QoS violation.

Big Data 45

Big Data Cloud Performance Hardware 45

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

ScaleOut Software

JULY 27, 2018

For more than a decade, in-memory data grids (IMDGs) have proven their usefulness for storing fast-changing data in enterprise applications. Whether it’s ecommerce shopping carts, financial trading data, IoT telemetry, or airline reservations, these data sets need fast, reliable access for large, mission-critical workloads.

Scalability 40

Scalability Cache Airlines Healthcare 40

ScaleOut Software

JULY 27, 2018

For more than a decade, in-memory data grids (IMDGs) have proven their usefulness for storing fast-changing data in enterprise applications. Whether it’s ecommerce shopping carts, financial trading data, IoT telemetry, or airline reservations, these data sets need fast, reliable access for large, mission-critical workloads.

Scalability 40

Scalability Cache Airlines Healthcare 40

Smashing Magazine

JANUARY 11, 2021

Build Optimizations JavaScript modules, module/nomodule pattern, tree-shaking, code-splitting, scope-hoisting, Webpack, differential serving, web worker, WebAssembly, JavaScript bundles, React, SPA, partial hydration, import on interaction, 3rd-parties, cache. It will help you build up a company-tailored case study with real data.

Performance 145

Performance Cache Media Metrics 145

Percona

MAY 2, 2023

Questions Q: I have a MySQL server with 500 GB of RAM; my data set is 100 GB. ChatGPT: The InnoDB buffer pool is used by MySQL to cache frequently accessed data in memory. Since my data set is 100GB, I would like to see ChatGPT explicitly mention that a good starting point would be 100GB. What could it be?

Social Media 124

Social Media Database Servers Cache 124

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

The Morning Paper

OCTOBER 4, 2020

The first 5G networks are now deployed and operational. The study is based on one of the world’s first commercial 5G network deployments (launched in April 2019), a 0.5 The 5G network is operating at 3.5GHz). The maximum physical layer bit-rate for the 5G network is 1200.98 The short answer is no.

Energy 130

Energy Latency Performance Network 130

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

Abhishek Tiwari

DECEMBER 13, 2017

Can machine learning-based data structures i.e. learned data structures replace traditional data structures? The initial results show that learned data structures can outperform existing data structures. This has far-reaching implications how future data systems and algorithms will be designed. p = F(Key) ?

Artificial Intelligence 40

Artificial Intelligence Hardware Google Benchmarking 40

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs.

Big Data 154

Big Data Processing Lambda Database 154

The Morning Paper

APRIL 14, 2019

The paper sets out what we can do in software given today’s hardware, and along the way also highlights areas where cooperation from hardware will be needed in the future. There are also stateless interconnects including buses and on-chip networks. Microarchitectural channels. Threat scenarios.

Hardware 44

Hardware Cache Latency Speed 44

Smashing Magazine

JANUARY 6, 2020

It will help you build up a company-tailored case study with real data. Furthermore, using data from case studies and experiments published on WPO Stats will help increase sensitivity for business about why performance matters, and what impact it has on user experience and business metrics. Large preview ). Large preview ).

Performance 145

Performance Cache Network Metrics 145

SQL Performance

APRIL 27, 2020

Many of the newer features we have in SQL Server were initially launched in Azure SQL Database, including (but not limited to) Always Encrypted, Dynamic Data Masking, Row Level Security, and Query Store. Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. DTU Pricing Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

Smashing Magazine

JANUARY 7, 2019

It will help you build up a company-tailored case study with real data. Furthermore, using data from case studies and experiments published on WPO Stats will help increase sensitivity for business about why performance matters, and what impact it has on user experience and business metrics.

Performance 103

Performance Cache Metrics Network 103

John McCalpin

AUGUST 1, 2018

According to Dr. Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? The user environment defines the mapping of MPI ranks to hardware resources (cores, sockets, nodes). The MPI runtime library. in ways that are seldom transparent.

Hardware 40

Hardware Transportation Performance Latency 40

SQL Server According to Bob

JANUARY 11, 2020

To ensure data integrity for our customers who are running SQL Server, it is important that I/O environments provide appropriate functionality. Atomicity A transaction must be an atomic unit of work; either all of its data modifications are performed or none of them are performed.

Servers 40

Servers Cache Media Hardware 40

Sutter's Mill

FEBRUARY 13, 2017

” This contains updated and new material that reflects the latest C++ standards and compilers, with a focus to using modern C++11/14/17 effectively on modern hardware and memory architectures. On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.”

Latency 51

Latency C++ Hardware Performance 51

The Morning Paper

DECEMBER 8, 2019

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. Therefore any programming abstraction must be low latency and the kernel needs to be kept off the path of persistent data access as much as possible.

Hardware 56

Hardware Programming Media Storage 56

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. This data set is derived by walking a subset of web platform features exposed to JavaScript and, as such, may not capture the full richness of a particular browser. Steve & Tim's Close-up Magic. Converging Views.

Media 145

Media Games Education Engineering 145

The Morning Paper

FEBRUARY 20, 2020

Given the desire to keep enterprise data within the database, and to treat models as data also, the question is can we do inference in the database with acceptable performance? A cross-optimiser then looks for opportunities to optimise the data operator parts of the query given the ML model, and vice-versa (e.g., pruning).

Processing 72

Processing Hardware Database Azure 72

The Morning Paper

SEPTEMBER 19, 2019

Their dataset has about 7B edges… Meanwhile, AnalyticDB is Alibaba’s real-time OLAP RDBMS handling 10PB of data (in excess of 100 trillion rows!). Could it be Analyzing efficient stream processing on modern hardware ? What if the network was no longer the bottleneck?

Blockchain 46

Blockchain Hardware Google Analytics 46

Smashing Magazine

JANUARY 21, 2021

Plus a service worker that caches all static assets and serves them for repeat views, along with cached versions of articles that a reader has already visited. The reasons for it are numerous, but the most important one is a huge difference in network conditions and device hardware across the world. Data from CrUX.

Performance 145

Performance Cache Mobile Network 145

The Morning Paper

NOVEMBER 14, 2019

It’s another networking paper to close out the week (and our coverage of SOSP’19), but whereas Snap looked at traffic routing within the datacenter, Taiji is concerned with routing traffic from the edge to a datacenter. Sharing is caring caching. SOSP’19. It’s been in production deployment at Facebook for the past four years.

Traffic 42

Traffic Internet Internet Latency 42

CSS - Tricks

JULY 25, 2019

Google wrote: Faster sites don’t just improve user experience; recent data shows that improving site speed also reduces operating costs. Cache-Headers missing? Following the algorithm and reference data used to calculate Time to Interactive , we can see that if a page managed to become "interactive" in 2.1

Google 71

Google Engineering Speed Mobile 71

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

AUGUST 18, 2019

hardware Hardware counter-based instrumentation. There are also two modes visible, one between 1 and 2 milliseconds, and another between 8 and 16 milliseconds: this sounds like cache hits and cache misses. There are often two modes, one for device cache hits and one for cache misses, which can be shown by this tool.

Latency 68

Latency C++ Cache Programming 68