Percona

AUGUST 22, 2023

We’ll wrap it up by suggesting high availability open source solutions, and we’ll introduce you to support options for ensuring continuous high performance from your systems. Connection management — This is the software management related specifically to the networking and connectivity aspect of the database.

Availability 82

Availability Hardware Open Source Database 82

Percona

DECEMBER 27, 2023

At Percona, we observe a growing trend among companies utilizing Kubernetes as a means to offer services to their teams, fostering expedited software delivery and driving business growth. The newly formed Open Source AI Alliance , led by META and IBM, promises to support open-source AI.

Cloud 82

Cloud Open Source Strategy Best Practices 82

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 202

Monitoring Serverless Programming Speed 202

Dynatrace

AUGUST 5, 2022

A message queue is a form of middleware used in software development to enable communications between services, programs, and dissimilar components, such as operating systems and communication protocols. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 201

Monitoring Serverless Programming Speed 201

The Polyglot Developer

FEBRUARY 10, 2017

So I was researching object storage and I came across the open source distributed object storage software, Minio. This lightweight software was written with Golang and accomplishes similar things to that of Amazon S3. After all they are both object storage solutions.

Storage 72

Storage Hardware Open Source Architecture 72

Percona

JUNE 30, 2023

Percona, a leading provider of open-source database software and services, announced the general availability of Percona Operator for PostgreSQL version 2. The solution is 100% open source and automates the deployment and management of PostgreSQL clusters on Kubernetes. In version 1.x,

Availability 97

Availability Open Source Azure Hardware 97

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. PostgreSQL software supports synchronous streaming replication, asynchronous streaming replication, and logical replication.

Availability 87

Availability Open Source Architecture Database 87

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

The Polyglot Developer

MARCH 5, 2017

Not too long ago I wrote about an open source object storage software called Minio and how I was using it on my Raspberry Pi for backups. The great thing about Minio is it shares the same APIs as AWS S3, but can be deployed to your own hardware, eliminating Amazon as a dependency.

Storage 40

Storage Cloud Hardware Open Source 40

Percona

JUNE 22, 2023

A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance. They include backup success rate, backup duration, recovery time objective (RTO), recovery point objective (RPO), and backup storage utilization.

Performance 107

Performance Monitoring Traffic Database 107

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The HammerDB name.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

FEBRUARY 24, 2023

Benefits of Graviton2 Processors Best price performance for a broad range of workloads Extensive software support Enhanced security for cloud applications Available with managed AWS services Best performance per watt of energy used in Amazon EC2 Storage Continuing with the AWS example, choosing the right storage option will be key to performance.

Cloud 122

Cloud Serverless AWS Storage 122

Percona

NOVEMBER 1, 2023

MySQL backups play a pivotal role in safeguarding the integrity of your data, providing defense against various unforeseen calamities, hardware malfunctions, data loss, corruption, and inadvertent deletions. Encryption Backups have sensitive data, so it’s highly recommended to encrypt, especially for offsite storage.

Best Practices 79

Best Practices Storage Strategy Database 79

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

AUGUST 18, 2023

The original motivation for FB was due to different hardware generations, especially between regions/data centers. And I agree that in the modern age of cloud and huge flash storage, the vast majority of companies will never need to consider doing this in prod, but there is always a chance of its need. AFAIK Facebook does this.

Programming 88

Programming Servers Database Hardware 88

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. It supports native sharding being transparent for the application.

Open Source 91

Open Source Storage Database Big Data 91

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Percona

JULY 1, 2023

Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. It also supports auto-scaling of compute and storage resources, dynamically adjusting capacity based on chosen utilization thresholds to optimize performance and costs.

AWS 52

AWS Database Serverless Storage 52

Testsigma

MAY 3, 2021

We love it so much that we devise new ways all the time to incorporate automation in each and every field of software development. Mobile devices are the most fragmented thing you will ever work with while developing software. Test automation in conventional software is straightforward. We, engineers, love automation!

Mobile 77

Mobile Testing Operating System Hardware 77

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The protections are hardware implemented and cannot be forged in software. At hardware reset the boot code is granted maximally permissive architectural capabilities.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. It is recommended to upgrade your stack as soon as possible to take advantage of improvements and any security-related software updates. Having indexes that will never be used is a waste of storage and will slow down write operations.

Database 83

Database Servers Storage Strategy 83

Abhishek Tiwari

DECEMBER 27, 2017

Over last few years, we have seen several attempts to run data workload in the containers especially distributed big data frameworks like Apache Hadoop, Apache Storm [3] , and Apache Spark [4] [5] without any software modifications. faster access to external storage and data locality (I/O, bandwidth). Storage provisioning.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Alex Russell

APRIL 29, 2021

Apple Corporate is at fault, not Open Source engineers or the line managers who support them. Chrome has missed several APIs for 3+ years: Storage Access API. is access to hardware devices. This allows customisation and use of specialised features without custom, proprietary software for niche hardware.

Media 145

Media Games Education Engineering 145

HammerDB

DECEMBER 5, 2020

Additionally both commercial and open source tools based on the specifications also continued to use TPC-C and TPC-H to describe these workloads. A full understanding of why this is important requires some knowledge of the evolution of database hardware and software. But why is this important?

C++ 40

C++ Benchmarking Virtualization Open Source 40

Percona

APRIL 17, 2023

Since MongoDB usually works with a replica set, it is possible to increase this parameter to get better performance: # edit /etc/mongod.conf storage: journal: enabled: true commitIntervalMs: 300 WiredTiger cache For dedicated servers, it is possible to increase the WiredTiger(WT) cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

SEPTEMBER 6, 2013

Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands. Tom Tom – Founded in 1991, TomTom is a leading provider of navigation and location-based products and services.

Cloud 129

Cloud Energy AWS Healthcare 129

Percona

AUGUST 30, 2018

Because recognizing if the workload is read intensive or write intensive will impact your hardware choices, database configuration as well as what techniques you can apply for performance optimization and scalability. In other words, whether the workload is dominated by reads or writes. Why should you care?

Benchmarking 48

Benchmarking Database Operating System Architecture 48

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Netflix TechBlog

MARCH 8, 2021

Artists like to work at places where they can create groundbreaking entertainment instead of worrying about getting access to the software or source files they need. They need specialized hardware, access to petabytes of images, and digital content creation applications with controlled licenses. How did we get here?

Entertainment 306

Entertainment Storage Hardware Open Source 306

Abhishek Tiwari

JULY 12, 2018

Data Pipeline A data pipeline is a software that ingests data from multiple sources, transforms it and finally makes it available to internal or external products. A data pipeline is a software which runs on hardware. The software is error-prone and hardware failures are inevitable.

Latency 63

Latency Analytics Scalability Engineering 63

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

In the same way that we have moved from a few big software releases a year to continuous delivery of many small changes, we need to move from annual disaster recover tests or suffering when things actually break, to continuously tested resilience. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Engineering Systems Hardware 53

High Scalability

OCTOBER 24, 2022

Limit the cloud services a cloud provider can offer and you limit the quality of the software we can build. Each cloud-native evolution is about using the hardware more efficiently. Building software is not moving freight. It would make the job of building quality software even harder and slower and more expensive.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Large preview ).

Performance 145

Performance Cache Network Metrics 145