Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out.

Database 107

Database Benchmarking Latency C++ 107

High Scalability

JANUARY 11, 2022

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. After that, the various services (e.g.

Design 334

Design Media Storage Logistics 334

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases.

Storage 288

Storage Cache Metrics Database 288

Scalegrid

DECEMBER 21, 2023

In today’s data-driven world, the ability to effectively monitor and manage data is of paramount importance. Redis®, a powerful in-memory data store, is no exception. Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring.

Strategy 130

Strategy Monitoring Latency DevOps 130

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. Redis returns a big list of database metrics when you run the info command on the Redis shell. This blog post lists the important database metrics to monitor.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

OCTOBER 23, 2023

Hyper-V plays a vital role in ensuring the reliable operations of data centers that are based on Microsoft platforms. Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. What is Microsoft Hyper-V?

Efficiency 214

Efficiency Virtualization Hardware Performance 214

The Morning Paper

JANUARY 28, 2020

Narrowing the gap between serverless and its state with storage functions , Zhang et al., In databases you probably know it as stored procedures. Shredder is " a low-latency multi-tenant cloud store that allows small units of computation to be performed directly within storage nodes. " SoCC’19. "Narrowing

Serverless 99

Serverless Storage Latency Cloud 99

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. These include popular technologies such as web servers and web applications, along with advanced solutions like distributed data stores and containerized microservices.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. In this blog, we will discuss both data and network-level compression offered in MongoDB.

Storage 111

Storage Network Open Source Latency 111

Percona

DECEMBER 11, 2023

Here, we will discuss a notable new feature in Amazon RDS, the Dedicated Log Volume (DLV), that has been introduced to boost database performance. A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables.

AWS 100

AWS Benchmarking Performance Traffic 100

Percona

MAY 2, 2023

In today’s data-driven world, losing critical data can be catastrophic for any organization. As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Why are MongoDB database backups important? Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? What we should really compare is the MySQL and Aurora database engines provided by Amazon RDS. How do I choose which one to use?

AWS 52

AWS Database Serverless Storage 52

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. Data loading patterns are an essential part of your application as they will determine which parts of your application are directly usable by visitors. But isn’t waiting for the data the point?

Performance 125

Performance Cache Servers Social Media 125

SQL Performance

APRIL 27, 2020

Azure SQL Database is Microsoft's database-as-a-service offering that provides a tremendous amount of flexibility. Microsoft is continually working on improving their products and Azure SQL Database is no different. The basic tier provides up to 5 DTUs with standard storage. HyperScale Database. DTU Pricing Tier.

Azure 55

Azure Database Serverless Hardware 55

Percona

SEPTEMBER 1, 2023

MySQL performance tuning offers several significant advantages for effective database management and optimization. Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Scalegrid

MARCH 14, 2024

Implementing a hybrid cloud solution involves careful decision-making regarding application and data placement, migration strategies, and choosing compatible cloud service providers while ensuring seamless integration and addressing security and compliance challenges. We will examine each of these elements in more detail.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Morning Paper

MARCH 3, 2020

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Larger cells have better tolerance of tail latency (e.g.

Database 106

Database AWS Network Design 106

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 8, 2024

AI-driven cloud solutions like ScaleGrid offer a diverse range of database hosting options, robust infrastructure optimized for scalability and security, and enable significant cost reductions, supporting businesses in efficient growth and improved ROI. These services are tailored to meet various business requirements.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Highly Scalable

SEPTEMBER 18, 2012

Although it can hardly be said that NoSQL movement brought fundamentally new techniques into distributed data processing, it triggered an avalanche of practical studies and real-life trials of different combinations of protocols and algorithms. Data Placement. Data Consistency. System Coordination.

Database 213

Database Latency C++ Scalability 213

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability.

Performance 128

Performance Hardware Tuning Storage 128

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. It’s a cross-platform document-oriented database that uses JSON-like documents with schema, and is leveraged broadly across startup apps up to enterprise-level businesses developing modern apps. DigitalOcean Droplets. minutes of downtime in one year.

Azure 187

Azure AWS Latency Database 187

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 106

Performance Monitoring Traffic Database 106

Dynatrace

DECEMBER 22, 2021

Observability gives developers and system operators real-time awareness of a highly distributed system’s current state based on the data it generates. Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage.

Artificial Intelligence 178

Artificial Intelligence Metrics Architecture DevOps 178

The Morning Paper

SEPTEMBER 10, 2019

Procella: unifying serving and analytical data at YouTube Chattopadhyay et al., Anchored in the primary use case of supporting Google’s YouTube business, what we’re looking at here could well be the future of data processing at Google. Because they had too many data processing systems! ;). VLDB’19. are divided.

Analytics 75

Analytics Latency Cache Google 75

Percona

DECEMBER 26, 2023

This PoC demonstrates how to install and configure pg_stat_monitor in order to extract useful and actionable metrics from a PostgreSQL database and display them on a Grafana dashboard. Grafana database backend: Prometheus version 2.15.2+d The collected data is aggregated and presented in a single view.

Benchmarking 125

Benchmarking Metrics C++ Database 125

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Randon ASCII

SEPTEMBER 8, 2019

The fact that this shows up as CPU time suggests that the reads were all hitting in the system cache and the CPU time was the kernel overhead (note ntoskrnl.exe on the first sampled call stack) of grabbing data from the cache. Now that we suspect file I/O it’s necessary to go to Graph Explorer-> Storage-> File I/O.

Latency 79

Latency Cache Programming Operating System 79

O'Reilly Software

JUNE 12, 2018

The benefits of modeling data as events as a mechanism to evolve our software systems. For as long as we’ve been talking about microservices, we’ve been talking about data. Data is all-important—vital for the continued success of our businesses—but has also been seen as a massive constraint in how we design and evolve our systems.

Database 72

Database Cache Architecture Latency 72

Percona

JULY 17, 2023

MongoDB Community Edition software might set the stage for achieving your high-volume database goals, but you quickly learn that its features fall short of your enterprise needs. The popularity of MongoDB MongoDB has emerged as a popular database platform. 5 among all database management systems and No. It ranks No.

Open Source 78

Open Source Database Scalability Software 78

The Morning Paper

NOVEMBER 8, 2020

If you think of this a bit like mapping memory addresses to data in memory, then another parallel comes to mind: the virtual address space. replacing Paxos with Raft), or they could be shims over external storage systems. replacing Paxos with Raft), or they could be shims over external storage systems. The NativeLoglet.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. That’s a heritage of the LAMP model when the same server would host both the database and the web server.

Tuning 138

Tuning Cache Servers Benchmarking 138

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs.

Big Data 154

Big Data Processing Lambda Database 154

Particular Software

AUGUST 16, 2021

which provides saga and outbox storage for NServiceBus endpoints that is transactionally consistent with the business data you store in Cosmos DB. How do I model data with Cosmos DB? Cosmos DB is the primary database service provided by Azure. But what does it mean for a NoSQL database to have an SQL API?

Azure 52

Azure Serverless Storage Database 52