Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. However, data loss is always possible due to hardware malfunction, software defects, or other unforeseen circumstances, just like with any computer system.

Best Practices 130

Best Practices Storage Strategy Database 130

Percona

JUNE 22, 2023

Defining high availability In general terms, high availability refers to the continuous operation of a system with little to no interruption to end users in the event of hardware or software failures, power outages, or other disruptions. Some disruption might occur, but it will be minimal. More in the following sub-section.)

Availability 112

Availability Database Open Source Hardware 112

Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. High availability does not guarantee 100% uptime, but an HA system enables you to minimize downtime to the point you’re almost there.

Availability 82

Availability Hardware Open Source Database 82

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Setting oom_score_adj to -800.

Performance 129

Performance Hardware Tuning Storage 129

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Message queue software options to consider.

Monitoring 196

Monitoring Serverless Programming Speed 196

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. A message queue enables the smooth flow of information to make complex systems work. Message queue software options to consider.

Monitoring 195

Monitoring Serverless Programming Speed 195

Percona

DECEMBER 27, 2023

We want adopters of our technology to be able to deploy their critical open source databases and applications across any public or private cloud environment. Creating repositories for memory-safe patterns in cloud systems to improve overall security. You mentioned ‘More Simple Kubernetes’?

Cloud 83

Cloud Open Source Strategy Best Practices 83

Percona

MARCH 28, 2023

Every database system has to ensure durability and reliability. ” This acts as a step to ensure durability by recovering lost data from the same journal files in case of crashes, power, and hardware failures between the checkpoints (see below) Here’s what the process looks like.

Hardware 92

Hardware C++ Storage Cache 92

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Therefore, DBAs must take a piecemeal approach to achieve HA with PostgreSQL, bringing together open source extensions and tools from multiple sources. there cannot be high availability.

Availability 87

Availability Open Source Architecture Database 87

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. It is advisable to have a dedicated production MySQL Server that can independently claim the system resources as needed.

Performance 108

Performance Monitoring Traffic Database 108

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. With cloud-based infrastructure, organizations can easily scale their web applications to handle increased traffic or demand without the need for expensive hardware upgrades.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

HammerDB

APRIL 19, 2023

Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

Percona

NOVEMBER 1, 2023

MySQL backups play a pivotal role in safeguarding the integrity of your data, providing defense against various unforeseen calamities, hardware malfunctions, data loss, corruption, and inadvertent deletions. The key question related to RTO is, “How quickly must the data on this system be restored?”

Best Practices 80

Best Practices Storage Strategy Database 80

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 108

Database Benchmarking Latency C++ 108

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. HammerDB has graphical and command line interfaces for the Windows and Linux operating systems. HammerDB is open source software licensed under the. Why HammerDB was developed. Adoption by the TPC.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Percona

AUGUST 18, 2023

The original motivation for FB was due to different hardware generations, especially between regions/data centers. And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. AFAIK Facebook does this.

Programming 88

Programming Servers Database Hardware 88

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. It also supports auto-scaling of compute and storage resources, dynamically adjusting capacity based on chosen utilization thresholds to optimize performance and costs.

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. At hardware reset the boot code is granted maximally permissive architectural capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Testsigma

MAY 3, 2021

From operating systems to versions to hardware specs, mobile devices stand unique even after being billions in number. But testing this is essential too because data communication over the network cannot be eliminated by putting all the files into the device storage. This challenge is the easiest to tackle among all the others.

Mobile 77

Mobile Testing Operating System Hardware 77

Percona

MAY 1, 2023

It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. What is PostgreSQL performance tuning?

Tuning 52

Tuning Efficiency Database Performance 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set. MongoDB is popular with developers as it is easy to get started with.

Database 83

Database Servers Storage Strategy 83

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The goal is to produce a low-energy hardware classifier for embedded applications doing local processing of sensor data. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). A good example will be something like Pachyderm [8] [9] - a relatively young project which implements a distributed Pachyderm File System (PFS) and a data-aware scheduler Pachyderm Pipeline System (PPS) on top of Kubernetes. Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 83

C++ Database Storage Testing 83

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. I.e. if system A generated 1.5X

C++ 40

C++ Benchmarking Virtualization Open Source 40

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Chrome has missed several APIs for 3+ years: Storage Access API. Media Session API.

Media 145

Media Games Education Engineering 145

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. Let’s now look at the operating system level. In other words, whether the workload is dominated by reads or writes.

Benchmarking 48

Benchmarking Database Operating System Architecture 48

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Netflix TechBlog

MARCH 8, 2021

They need specialized hardware, access to petabytes of images, and digital content creation applications with controlled licenses. Machine Configuration: Spinnaker Starting at the left of the chart, Spinnaker is an open-source platform that controls the creation of workstation pools. How did we get here?

Entertainment 306

Entertainment Storage Hardware Open Source 306

Abhishek Tiwari

JULY 12, 2018

These nodes and edges require a good amount of compute and storage which is typically distributed across a large number servers either running in the cloud or your own data center. In a nutshell, a data pipeline is a distributed system. A data pipeline is a software which runs on hardware.

Latency 63

Latency Analytics Scalability Engineering 63

ACM Sigarch

NOVEMBER 4, 2019

Krste Asanovic from UC Berkeley kicked off the main program sharing his experience on “ Rejuvenating Computer Architecture Research with Open-Source Hardware ”. He ended the keynote with a call to action for open hardware and tools to start the next wave of computing innovation.

Hardware 18

Hardware Architecture Programming Innovation 18

Adrian Cockcroft

NOVEMBER 11, 2019

A resilient system continues to operate successfully in the presence of failures. The system needs to maintain a safety margin that is capable of absorbing failure via defense in depth, and failure modes need to be prioritized to take care of the most likely and highest impact risks. The first technique is the most generally useful.

Latency 52

Latency Engineering Systems Hardware 52