All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. I am pretty sure some if not all of these papers deserved to be elected to the hall of fame of best papers in distributed systems. Feb 11 - A Survey of Rollback-Recovery Protocols in Message-Passing Systems , E. All Things Distributed. Comments ().

Operating System 144

Operating System Cache AWS Scalability 144

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

Randon ASCII

SEPTEMBER 8, 2019

The fact that this shows up as CPU time suggests that the reads were all hitting in the system cache and the CPU time was the kernel overhead (note ntoskrnl.exe on the first sampled call stack) of grabbing data from the cache. Now that we suspect file I/O it’s necessary to go to Graph Explorer-> Storage-> File I/O.

Latency 79

Latency Cache Programming Operating System 79

The Morning Paper

NOVEMBER 19, 2019

On the other hand we have good old-fashioned native apps that you install on your operating system (a dying breed? With a traditional OS app 2 you have much more control over the data (the files on your file system at least, which if you’re lucky might even be in an open format). Google Docs, Trello, …).

Cloud 83

Cloud Software Software Internet 83

Scalegrid

DECEMBER 21, 2023

With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

APRIL 24, 2023

The urge to create more and more indexes is found to be causing severe damage in many systems. Many times, removing indexes is what we should be doing first before considering any new indexes for the benefit of the entire system. This post is about PostgreSQL, but most of the problems also apply to other database systems.

Tuning 124

Tuning Cache Storage Database 124

The Netflix TechBlog

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. From chunk encoding to assembly and packaging, the result of each previous processing step must be uploaded to cloud storage and then downloaded by the next processing step.

Cloud 237

Cloud Media Storage Cache 237

Percona

MARCH 23, 2023

By caching hot datasets, indexes, and ongoing changes, InnoDB can provide faster response times and utilize disk IO in a much more optimal way. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Setting oom_score_adj to -800.

Performance 124

Performance Hardware Tuning Storage 124

The Netflix TechBlog

MARCH 8, 2021

They could need a GPU when doing graphics-intensive work or extra large storage to handle file management. Instead, we created a service to take the most popular configurations and cache them. We needed a system that could manage hundreds to one-day thousands of workstations. Artists need many components to be customized.

Entertainment 306

Entertainment Storage Hardware Open Source 306

Smashing Magazine

JANUARY 15, 2019

An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. For the more adventurous/technical, the top (table of processes) command provides similar metrics on most Unix-like operating systems such as macOS and Ubuntu. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

SQL Server According to Bob

DECEMBER 18, 2018

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. For example, if a flight booking reports that a seat has successfully been booked, then the seat will remain booked even if the system crashes.” – [link]. The Back Story.

Servers 90

Servers Media Cache Storage 90

Tim Kadlec

JUNE 2, 2010

There’s been an ongoing debate in the world of mobile development as to how mobile apps should be distributed, via an open system or a closed system, and consequently, how one should approach mobile development. There are benefits in a controlled system, among which are an assurance of quality and security.

Mobile 40

Mobile Cache Operating System Storage 40

HammerDB

JUNE 27, 2022

HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. An important concept was to simulate database users called Virtual Users in parallel (rather than concurrently) to accurately simulate a real database workload with multiple users running from separate systems. HammerDB Licensing.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

DECEMBER 8, 2019

At the start of November I was privileged to attend HPTS (the High Performance Transaction Systems) conference in Asilomar. Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. PLOS’19.

Hardware 56

Hardware Programming Media Storage 56

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

SQL Server According to Bob

JANUARY 11, 2020

​​ Without limiting the rights under copyright, no part of this document may be reproduced, stored in or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Microsoft Corporation.

Servers 40

Servers Cache Database Media 40

All Things Distributed

OCTOBER 2, 2017

About 20 percent would return a set of rows, but still operate on only a single table. The success of our early results with the Dynamo database encouraged us to write Amazon's Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit.

Internet 128

Internet Internet AWS Performance 128

SQL Server According to Bob

MAY 19, 2019

For example, Azure SQL Database Edge can already use TSQL Predict Machine Learning (ML) and Column Storage. Partitioning allows SQL Server to scale to the largest systems with record-setting performance. When promoted to a super-latch on a 64 CPU system the memory requirement becomes 32 + (32 *64) = 2080 bytes. Lock Manager.

IoT 61

IoT Servers Development Cache 61

Abhishek Tiwari

SEPTEMBER 10, 2017

Your version control system triggers continuous integration pipeline. As we are dealing with Docker images, I assume you have downloaded and installed Docker for your operating system. For other operating systems please see detailed documentation on how to install kubectl. I use Docker for Mac. VirtualBox.

Development 49

Development Operating System Virtualization Code 49

ACM Sigarch

NOVEMBER 1, 2019

This blog post gives a glimpse of the computer systems research papers presented at the USENIX Annual Technical Conference (ATC) 2019, with an emphasis on systems that use new hardware architectures. USENIX ATC is a top-tier venue with a broad range of systems research papers from both industry and academia. Heterogeneous ISA.

Architecture 12

Architecture Hardware Cache Storage 12

High Scalability

NOVEMBER 25, 2019

He and his colleagues spend their productive hours scaling large distributed file systems. It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Edge caching. Optimize on prem cold storage cost. Introduction.

Architecture 52

Architecture Cache Azure Storage 52

Smashing Magazine

JANUARY 7, 2019

You could go as far as evaluating a framework (or any JavaScript library) on Sacha Greif’s 12-point scale scoring system by exploring features, accessibility, stability, performance, package ecosystem, community, learning curve, documentation, tooling, track record, team, compatibility, security for example. Other options are available , too.

Performance 104

Performance Cache Metrics Network 104