High Scalability

DECEMBER 16, 2022

Cloud computing is a model of computing that delivers computing services over the internet, including storage, data processing, and networking. It allows users to access and use shared computing resources, such as servers, storage, and applications, on demand and without the need to manage the underlying infrastructure.

Cloud 201

Cloud Serverless Internet Internet 201

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Scalegrid

NOVEMBER 29, 2023

The advantages of DBaaS Businesses can use their database services without having to purchase new hardware or set it up. A DBaaS automates several processes, such as using, erasing, and spinning up storage without interventions from IT staff. You don’t need to purchase additional storage when you have a self-managed cloud database.

Healthcare 130

Healthcare Hardware Database Scalability 130

Percona

NOVEMBER 2, 2023

Kubernetes performance is heavily influenced by the underlying hardware. Running a database on a Kubernetes cluster should deliver similar performance, with less than a 1% difference when compared to running it on standalone hardware. However, Kubernetes does introduce additional layers, particularly in storage and networking.

Open Source 85

Open Source Hardware Storage Database 85

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

The Polyglot Developer

FEBRUARY 10, 2017

So I was researching object storage and I came across the open source distributed object storage software, Minio. After all they are both object storage solutions. The difference here is that Minio can be deployed on your own hardware.

Storage 72

Storage Hardware Open Source Architecture 72

Dynatrace

DECEMBER 15, 2022

Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure. Although modern cloud systems simplify tasks, such as deploying apps and provisioning new hardware and servers, hybrid cloud and multicloud environments are often complex.

Artificial Intelligence 204

Artificial Intelligence DevOps Hardware Virtualization 204

Percona

MAY 1, 2023

This message is normally a side effect of a storage subsystem that is not capable of keeping up with the number of writes (e.g., The innodb_io_capacity_max parameter was set to 2000, so the hardware should be able to deliver that many IOPS without major issues. The settings might not be optimal. flushed=140, during the time.)

AWS 119

AWS Hardware Storage Tuning 119

Dynatrace

AUGUST 26, 2020

There’s no other competing software that can provide this level of value with minimum effort and optimal hardware utilization that can scale up to web-scale! I’d like to stress the lean approach to hardware that our customers require for running Dynatrace Managed. Optimal metric storage management strategy.

Performance 150

Performance Hardware Java Storage 150

Dynatrace

MAY 14, 2020

A Dynatrace Managed cluster may lack the necessary hardware to process all the additional incoming data. This means that you’ll receive better answers from Dynatrace Davis and capture even more high-fidelity data as your hardware will be used optimally based on the newly improved ALR algorithm. Impact on disk space.

Processing 155

Processing Hardware Traffic Storage 155

Scalegrid

JANUARY 5, 2024

The DBMS is key to maintaining these aspects by offering a storage system that allows users to perform operations such as data insertion, deletion, and selection, thereby promoting enhanced data integration across diverse applications and platforms. This is significant for modern business environments. <p>The </p>

Efficiency 147

Efficiency Storage Database Scalability 147

All Things Distributed

JANUARY 23, 2012

Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? With the launch of the AWS Storage Gateway our customers can now integrate their on-premises IT environment with AWSâ??s

Storage 116

Storage AWS Virtualization Cloud 116

All Things Distributed

SEPTEMBER 20, 2013

Not everybody agreed that the "N-ary Storage Model" (NSM) was the best approach for all workloads but it stayed dominant until hardware constraints, especially on caches, forced the community to revisit some of the alternatives. A Decomposition Storage Model , George P. Copeland and Setrag N.

Storage 90

Storage Hardware Cache C++ 90

DZone

AUGUST 14, 2019

Network agility is represented by the volume of change in the network over a period of time and is defined as the capability for software and hardware component’s to automatically configure and control itself in a complex networking ecosystem. Organizations are in search of improving network agility, but what exactly does this mean?

Network 182

Network Innovation Hardware DevOps 182

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

The Polyglot Developer

MARCH 5, 2017

Not too long ago I wrote about an open source object storage software called Minio and how I was using it on my Raspberry Pi for backups. The great thing about Minio is it shares the same APIs as AWS S3, but can be deployed to your own hardware, eliminating Amazon as a dependency. And Multer appeared first on The Polyglot Developer.

Storage 40

Storage Cloud Hardware Open Source 40

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. This not only enhances performance but also enables you to make more efficient use of your hardware resources, potentially resulting in cost savings on infrastructure.

Tuning 52

Tuning Database Performance Hardware 52

Dynatrace

JANUARY 16, 2023

On-premises data centers invest in higher capacity servers since they provide more flexibility in the long run, while the procurement price of hardware is only one of many cost factors. Redis is an in-memory key-value store and cache that simplifies processing, storage, and interaction with data in Kubernetes environments.

Open Source 344

Open Source Java Operating System Programming 344

ACM Sigarch

AUGUST 3, 2023

Embodied carbon is due to Scope 3, e.g., manufacturing IT hardware and datacenter construction. Hence, significant additional investments into capacity and energy storage would be needed to match a fab’s daily load. Chien’s Arguments Against Embodied Carbon Prof.

Energy 98

Energy Architecture Hardware Metrics 98

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. In this scenario, message queues coordinate large numbers of microservices, which operate autonomously without the need to provision virtual machines or allocate hardware resources.

Monitoring 201

Monitoring Serverless Programming Speed 201

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. In this scenario, message queues coordinate large numbers of microservices, which operate autonomously without the need to provision virtual machines or allocate hardware resources.

Monitoring 201

Monitoring Serverless Programming Speed 201

Percona

JUNE 30, 2023

In addition to that: Run up to four pgBackrest repositories Bootstrap the cluster from the existing backup through Custom Resource Azure Blob Storage support Operations Deploying complex topologies in Kubernetes is not possible without affinity and anti-affinity rules. In version 1.x,

Availability 93

Availability Open Source Azure Hardware 93

Percona

JUNE 22, 2023

Another related variable, innodb_buffer_pool_instances, determines the number of buffer pool instances for the InnoDB storage engine, which can improve the performance of multi-core systems by reducing contention on the buffer pool latch. Monitoring these metrics helps ensure data protection, minimize downtime, and ensure business continuity.

Performance 104

Performance Monitoring Traffic Database 104

ACM Sigarch

OCTOBER 4, 2018

This is the first post in a series of posts on different approaches to systems security especially as they apply to hardware and architectural security. The class of techniques described in this blog post, which we broadly refer to as applied hardware and architecture cryptography, apply proven cryptographic techniques to strengthen systems.

Systems 47

Systems Hardware Storage Healthcare 47

Percona

JANUARY 17, 2023

In terms of storage, internal pages are no different than the root page; they also store pointers to other internal pages. The majority of issues are caused by hardware failure or hardware issues, and the following are the most probable reasons. If this page is corrupted or inaccessible, it is impossible to access the index.

Database 117

Database Hardware Storage Programming 117

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Storage: The system has a SATA drive for the operating system and one NVMe (Intel SSD D7-P5510 (3.84 Database: MySQL 8.0.31

Performance 54

Performance Benchmarking Cache Storage 54

Percona

JANUARY 4, 2024

Managing storage and performance efficiently in your MySQL database is crucial, and general tablespaces offer flexibility in achieving this. In contrast to the single system tablespace that holds system tables by default, general tablespaces are user-defined storage containers for multiple InnoDB tables.

Storage 88

Storage Engineering Database Hardware 88

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Smashing Magazine

JUNE 18, 2020

More specifically, we’re going to talk about storage and UI differences, which are the ones that most often cause confusion to developers when writing Flutter code that they want to be cross-platform. Example 1: Storage. Secure Storage On Mobile. The situation when it comes to mobile apps is completely different.

Storage 93

Storage Mobile Website Java 93

Dynatrace

MARCH 23, 2020

A decade ago, while working for a large hosting provider, I led a team that was thrown into turmoil over the purchasing of server and storage hardware in preparation for a multi-million dollar super-bowl ad campaign. Dynatrace news.

Google 194

Google Engineering Metrics Hardware 194

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

AUGUST 24, 2012

The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 In 1997 Jim revisted his caculations with the help of Goetz Graefe , and it details the impact of 10 years of hardware and pricing progress. . | Permalink. Comments (). per GB/month.

Storage 110

Storage Hardware AWS Data Engineering 110

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. MyRocks is shipped in Percona Server for MySQL.

Open Source 88

Open Source Storage Database Big Data 88

Percona

DECEMBER 27, 2023

It comprises numerous organizations from various sectors, including software, hardware, nonprofit, public, and academic. Well, here we are – with storage autoscaling for databases in Kubernetes, slated for release in Q1, 2024 after a year of hard work. You mentioned ‘More Simple Kubernetes’?

Cloud 80

Cloud Open Source Strategy Best Practices 80

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. Different hardware architectures (CPUs, GPUs, TPUs, FPGAs, ASICs, …) offer different performance and cost trade-offs.

Hardware 58

Hardware Latency Serverless Energy 58

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). Using default scheduler's node affinity feature you can ensure that certain pods only schedule on nodes with specialized hardware like GPU, memory-optimised, I/O optimised etc. Storage provisioning. But Kubernetes storage is evolving quite quickly.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Scalegrid

JANUARY 25, 2024

It’s important to note that recommended throughput levels may vary depending on factors such as operating system type, network bandwidth availability, and hardware quality. Furthermore, the wise utilization of different types Redis offers, such as strings, lists, sets , and sorted sets , allows efficient storage management.

Metrics 130

Metrics Monitoring Latency Cache 130