Scalegrid

JANUARY 25, 2024

This blog post lists the important database metrics to monitor. Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Make sure the drives are mounted with noatime and also if the drives are behind a RAID controller with appropriate battery-backed cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

The Netflix TechBlog

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. The solution which we present in this blog is not limited to annotations and can be used for any other domain which uses ES and Cassandra as well.

Media 264

Media Latency Architecture Database 264

Percona

JULY 25, 2023

In this blog post, we will describe the improvements to Percona XtraBackup 8.0.33-28 After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Initializing a DD engine and the cache adds complexity and other server dependencies.

Cache 86

Cache Benchmarking Servers Design 86

Percona

MARCH 28, 2023

In this blog post, we will dive deep into WiredTiger’s Logging and Checkpoint mechanism. The same data, in the form of pages inside the Wiredtiger cache, are also marked dirty. Every database system has to ensure durability and reliability. MongoDB uses classic Write-Ahead-Logging (WAL) using Journals and Checkpoints.

Hardware 88

Hardware C++ Storage Cache 88

HammerDB

APRIL 19, 2023

In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

MARCH 17, 2023

These updates are designed to keep databases running at peak performance and simplify database operations. PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. VictoriaMetrics maintains an in-memory cache for mapping active time series into internal series IDs. Virtual Memory utilization was averaging 48 GB of RAM.

Monitoring 99

Monitoring Scalability Cache Database 99

Dynatrace

DECEMBER 20, 2021

Conversely, if users encounter functional issues or poor UI design that frustrate common actions, replays provide clear evidence. Streamlined asset caching: Asset caching is critical for creating accurate replays. Tools that feature client-side compression can help reduce total data transfer volumes and storage footprints.

Mobile 253

Mobile Website Analytics Cache 253

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. Storing frequently accessed data in faster storage, usually in-memory caching, improves data retrieval speed and overall system performance. Beyond

AWS 256

AWS Efficiency Azure Cloud 256

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40

Percona

APRIL 3, 2023

In this blog, we will upgrade PG10, which has tables with OID columns and some extensions to PG13, as an example, using the native pg_upgrade utility. Pg_dump and pg_restore: We can refer to PostgreSQL Upgrade Using pg_dump/pg_restore on dump/restore methods. Running this script will delete the old cluster's data files: /delete_old_cluster.sh

C++ 102

C++ Cache Database Storage 102

SQL Server According to Bob

NOVEMBER 8, 2016

Note: We received feedback that there was some confusion on us calling this functionality “tail of the log caching” because our documentation and prior history has referred to the tail of the log as the portion of the hardened log that has not been backed up. Block storage is what you think of today as disk access.

Cache 40

Cache Servers Media Storage 40

Percona

MAY 1, 2023

This blog was originally published in August 2018 and was updated in May 2023. In this blog post, we will delve into the world of PostgreSQL performance tuning and establish some basic guidelines for setting database parameters to enhance the performance of your PostgreSQL database, based on the workload.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

JULY 17, 2023

In this blog, we’ll examine the reasons why people would seek an alternative to MongoDB Enterprise, and we’ll identify some of the most popular NoSQL alternatives. First, some stage-setting for this blog article. Storing large datasets can be a challenge, as Redis’ storage capacity is limited by available RAM.

Open Source 76

Open Source Database Scalability Software 76

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. blog comments powered by Disqus.

Cloud 117

Cloud Cache AWS Storage 117

Smashing Magazine

JUNE 18, 2020

More specifically, we’re going to talk about storage and UI differences, which are the ones that most often cause confusion to developers when writing Flutter code that they want to be cross-platform. Example 1: Storage. Secure Storage On Mobile. The situation when it comes to mobile apps is completely different.

Storage 93

Storage Mobile Website Java 93

High Scalability

NOVEMBER 25, 2019

It is limited by the disk space; it can’t expand storage elastically; it chokes if you run few I/O intensive processes or try collaborating with 100 other users. Over time, costs for S3 and GCS became reasonable and with Egnyte’s storage plugin architecture, our customers can now bring in any storage backend of their choice.

Architecture 52

Architecture Cache Azure Storage 52

All Things Distributed

DECEMBER 18, 2012

Do not expect too many blog posts or twitter updates. It was not until later in the year that I started to recording the readings here on the blog, so I hope this is indeed the complete list. Jul 4 - Leases: An efficient fault-tolerant mechanism for distributed file cache consistency , Gray, Cary, and David Cheriton, Vol.

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. But I really want a setup that allows me to thinker with the blog where ever I am (e.g. at 30,000 feet). Jekyll also is a static website generator.

Servers 126

Servers Social Media AWS Website 126

Percona

MAY 2, 2023

This blog was originally published in September 2020 and was updated in May 2023. In this blog, we will be discussing different MongoDB database backup strategies and their use cases, along with pros and cons and a few other useful tips. In today’s data-driven world, losing critical data can be catastrophic for any organization.

Best Practices 52

Best Practices Database Storage Servers 52

Percona

JUNE 4, 2023

This blog post was originally published in November 2017 and was updated in June 2023. In this blog, we’ll provide a comparison between MariaDB vs. MySQL (including Percona Server for MySQL ). Discover the crucial MySQL setting that can optimize your database performance – check out our blog now !

Open Source 52

Open Source Servers Storage Scalability 52

Percona

JULY 5, 2023

This blog post will discuss fragmentation and its impact on InnoDB. The principle of locality While the principle of locality is usually related to processors and cache access patterns, it also applies to data access in general. One of the effects of this design is that there is no fragmentation due to unordered data.

Open Source 126

Open Source Database Efficiency Testing 126

All Things Distributed

APRIL 27, 2011

Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. blog comments powered by Disqus. Syndication.

Technology 151

Technology Technology AWS Storage 151

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails. This flexibility can be crucial in designing a scalable architecture.

Availability 108

Availability Database Open Source Hardware 108

Smashing Magazine

SEPTEMBER 20, 2021

Web scraping can be used to harvest marketing data, such as identifying good keywords for advertising campaigns, identifying trending topics for blog posts, or identifying influencers in important blogs and news sites. Meet Adam Silver’s Form Design Patterns , a practical guide to designing and building forms for the web.

Website 89

Website Analytics Google Cache 89

Smashing Magazine

JANUARY 11, 2021

Performance isn’t just a technical concern: it affects everything from accessibility to usability to search engine optimization, and when baking it into the workflow, design decisions have to be informed by their performance implications. Looking back now, things seem to have changed quite significantly.

Performance 145

Performance Cache Media Metrics 145

CSS - Tricks

JUNE 5, 2020

The HBO sitcom Silicon Valley hilariously followed Pied Piper, a team of developers with startup dreams to create a compression algorithm so powerful that high-quality streaming and file storage concerns would become a thing of the past. In 2015, Google published a blog post announcing Brotli and released its source code on GitHub.

Cache 79

Cache Website Servers Open Source 79

All Things Distributed

DECEMBER 5, 2010

There are two main types of DNS servers: authoritative servers and caching resolvers. But the real robustness of the DNS system comes through the way lookups are handled, which is what caching resolvers do. Caching techniques ensure that the DNS system doesnt get overloaded with queries. blog comments powered by Disqus.

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

JUNE 21, 2018

Further, with the growth and scale of Amazon.com, boundless horizontal scale needed to be a key design point--scaling up simply wasn't an option. This consistent performance is a big part of why the Snapchat Stories feature , which includes Snapchat's largest storage write workload, moved to DynamoDB. Purpose-built databases.

Database 167

Database AWS Games Latency 167

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB â?? By Werner Vogels on 18 January 2012 07:00 AM. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

NOVEMBER 6, 2023

Obviously, there are ways to monitor the backup through storage monitoring or Pod status, but why bother if the Operator already provides this information? Please find the code and recipes from this blog post in this GitHub repository. The solution Kube-state-metrics is designed to be extendable for capturing custom resource metrics.

Metrics 70

Metrics Monitoring Database Cache 70

All Things Distributed

MARCH 5, 2012

Amazon ElastiCache customers will see their prices drop by up to 10%, depending on their cache node types. We continuously apply all our innovative skills to the design of datacenters, servers, storage, network, etc. blog comments powered by Disqus. he posts material that doesnt belong on this blog or on twitter.

AWS 110

AWS Innovation Scalability Cache 110

Alex Russell

MAY 4, 2016

But doesn’t AppCache let you cache documents you might want offline? ” , you say, “doesn’t AppCache also allow you to put documents in the cache directly, bypassing all of that?” The legacy web, however, can take as long as the TCP timeout (2 minutes in many devices) to end in failure.

Performance 43

Performance Cache Google Network 43

Enprowess

JANUARY 12, 2022

To make it easier for you, in this blog, we will discuss the latest web development trends that will evolve in 2022. So it is convenient for all to use irrespective of internet speed and it works offline using cached data. Its visual design pattern became a mainstream trend in web app development. Famous PWA Use Examples.

Blockchain 59

Blockchain IoT Development Serverless 59

Smashing Magazine

JANUARY 15, 2019

In 2013, A List Apart published Sustainable Web Design by James Christie. An obvious metric here is CPU usage, but memory usage and other forms of data storage also play their part. Sustainable Web Design. In 2016, O’Reilly published “ Designing For Sustainability ” by Tim Frick. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

ACM Sigarch

DECEMBER 6, 2018

Such innovation in AI algorithms and approaches results in an increase in model size, exponential growth in the compute needs, caching of temporal states, and multiple models to run simultaneously. Such compression is designed to replicate the data such that the reconstruction losses are imperceptible to the human eye.

Wireless 54

Wireless IoT Analytics Architecture 54