2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use

Scalegrid

Wondering which databases are trending in 2019? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year.

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes. What is an MPP Database? What is Greenplum Database?

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

TiDB Dashboard: Easier Troubleshooting for Distributed Databases

DZone

It's challenging to troubleshoot issues in a distributed database because the information about the system is scattered in different machines. TiDB is an open-source, distributed SQL database that supports Hybrid Transactional/Analytical Processing (HTAP) workloads. it could be difficult to efficiently troubleshoot TiDB's system problems. open source database performance cloud-native database administration htap

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

High Scalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use

High Scalability

Wondering which databases are trending in 2019 ? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year.

How to Setup a WordPress MySQL Database in the Cloud

Scalegrid

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. As any WordPress developer knows, each installation requires a database in the backend, and MySQL is the database of choice for storing and retrieving your WordPress data. Unlimited Databases. Here’s how you can set this up: Create a New MySQL Database.

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

Scalegrid

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. 2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combos & Top Reasons Used Click To Tweet.

Explore secrets of the SQL Server tempdb database

SQL Shack

In this article, we will uncover some secrets about the SQL Server tempdb database. Tempdb is a system database and it is used for various internal and user operations. Besides this, the tempdb has many unique characteristics, unlike the other databases. General database design PerformanceWhen we take into account all of these features of the tempdb, there is […].

Optimizing Database Performance and Efficiency

DZone

It's easy for modern, distributed, high-scale applications to hide database performance and efficiency problems. Optimizing performance of such complex systems at scale requires some skill, but more importantly it requires a sound strategy and good observability, because you can't optimize what you can't measure. database performance video distributed database cost optimization uers experience

Towards multiverse databases

The Morning Paper

Towards multiverse databases Marzoev et al., The central idea behind multiverse databases is to push the data access and privacy rules into the database itself. The database takes on responsibility for authorization and transformation, and the application retains responsibility only for authentication and correct delegation of the authenticated principal on a database call. These ideas make an efficient multiverse database possible.

Follower Clusters – 3 Major Use Cases for Syncing SQL & NoSQL Deployments

Scalegrid

Follower clusters are a ScaleGrid feature that allows you to keep two independent database systems (of the same type) in sync. Here are a few critical ways in which it differs from replication: You can control how frequently the destination system syncs from source – once a week, once a day, or even less frequently. This helps reduce the load on the source system. Since they are two independent systems, you have much more flexibility over the data that is synced.

Oracle database insights Early Adopter Release

Dynatrace

With OneAgent installed on an application server, Davis, the Dynatrace AI causation engine, continuously analyzes all database statements within the context of your applications. Now, with Oracle database insights, we’re going even deeper, giving you visibility into what’s going on in the database layer. Resolve performance problems rooted in the Oracle database layer. Chatty database requests – requests that invoke too many database statements.

Importing Performance Monitor data into SQL databases

SQL Shack

In this article, we will learn how we can write Perfmon counter data to a SQL database through the ODBC connection. Perfmon is a monitoring tool that helps to track resource usage and system performance metrics in real-time and it also allows us […].

Intro to Redis Cluster Sharding – Advantages, Limitations, Deploying & Client Connections

High Scalability

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

Understanding, detecting and localizing partial failures in large system software

The Morning Paper

Understanding, detecting and localizing partial failures in large system software , Lou et al., Partial failures ( gray failures ) occur when some but not all of the functionalities of a system are broken. It contains a study of partial failure causes, and a novel approach to fault detection using system-specific, auto-generated watchdogs. Here are the key findings: Partial failures appear throughout the release history of each system, 54% within the last three years.

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

Scalegrid

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Or, considering adding a new database to your application and want to see which combinations are most popular? Polyglot Persistence Trends : Number of Databases Used & Top Combinations. 2019 Top Databases Used.

Benchmarking spreadsheet systems

The Morning Paper

Benchmarking spreadsheet systems Rahman et al., They often freeze during computation, and are unable to import datasets well below the size limits posed by current spreadsheet systems. While a database is barely getting started at 20,000 rows, a spreadsheet could be hanging. What learnings from the database community could help improve spreadsheet performance? The other systems avoid this recomputation, but are slower than Excel for value-only datasets.

Checksums in Storage Systems and Why the Enterprise Should Care

DZone

Let’s assume for a moment that your data survives its many passes through a system’s DRAM and emerges intact. That data must then be safely transported over a network to the storage system where it is written to disk. performance storage database checksum data corruption data safetyRandom bit flips are far more common than most people, even IT professionals, think.

Distributed Algorithms in NoSQL Databases

Highly Scalable

As such, it encompasses distributed system coordination, failover, resource management and many other capabilities. These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases. System Coordination. A database can offer at least two solutions: Conflict prevention.

Bandwidth-friendly Query Profiling for Azure SQL Database

SQL Performance

SQL Server has always provided the ability to capture actual queries in an easily-consumable rowset format – first with legacy SQL Server Profiler, later via Extended Events, and now with a combination of those two concepts in Azure SQL Database. Azure SQL Database is not supported by legacy Profiler, and Microsoft disabled the XEvents streaming provider for reliability reasons, so you can't watch live data with SSMS. ALTER EVENT SESSION [ ADS_Standard_Azure ] ON DATABASE.

Azure 64

PostgreSQL Connection Pooling: Part 1 – Pros & Cons

Scalegrid

In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice. It would be a shame if your database crashed, after all. It is difficult to fault their argument – as it’s absolutely true that: Each client having its own process prevents a poorly behaving client from crashing the entire database.

Updating graph databases with Cypher

The Morning Paper

Updating graph databases with Cypher Green et al., Our understanding of updates in the popular graph database model… is still very rudimentary. Violations of atomicity and non-deterministic update behaviour certainly don’t sound like the kind of things you want in a database!! VLDB’19. This is the story of a great collaboration between academia, industry, and users of the Cypher graph querying language as created by Neo4j.

Aligning superhuman AI with human behaviour: chess as a model system

The Morning Paper

Aligning superhuman AI with human behavior: chess as a model system , McIlroy-Young et al., we also have large databases of human games available though, we have a recognised method of assessing player skill levels (rating points). This could be an important factor for many systems.

Games 81

MySQL High Availability Framework Explained – Part III: Failover Scenarios

High Scalability

Thus, whenever a master MySQL goes down (whether due to a MySQL crash, OS crash, system reboot, etc.), This ensures that the system continues to be available to the applications. This is a classical problem in any distributed system where each node thinks the other nodes are down, while in reality, only the network communication between the nodes is broken.

Database Resolutions for 2018

VoltDB

So, in the spirit of things, we’ve laid out a few New Year’s resolutions that all database professionals can take into account as they look to turn over a new leaf in 2018 and build on their successes. ” One of the suggested benefits of eventual consistency systems is that they support high availability across multiple data centers.But the biggest downside ? These systems are fundamentally non-transactional (they lack ACID compliance).

Database Resolutions for 2018

VoltDB

So, in the spirit of things, we’ve laid out a few New Year’s resolutions that all database professionals can take into account as they look to turn over a new leaf in 2018 and build on their successes. ” One of the suggested benefits of eventual consistency systems is that they support high availability across multiple data centers.But the biggest downside ? These systems are fundamentally non-transactional (they lack ACID compliance).

Tuning PostgreSQL Database Parameters to Optimize Performance

Percona

It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. In this blog, we will establish basic guidelines for setting PostgreSQL database parameters to improve database performance according to workload. It is important to pay attention to performance when writing database queries.

Building an Automated Testing Framework Based on Chaos Mesh and Argo

DZone

Although it provides rich capabilities to simulate abnormal system conditions, it still only solves a fraction of the Chaos Engineering puzzle. tutorial performance cloud native database performance distributed system chaos engineering

Bring Your Own Cloud (BYOC) vs. Dedicated Hosting at ScaleGrid

Scalegrid

Where you decide to host your cloud databases is a huge decision. But, if you’re considering leveraging a managed databases provider, you have another decision to make – are you able to host in your own cloud account or are you required to host through your managed service provider? At ScaleGrid, we offer a unique model called the Bring Your Own Cloud (BYOC) plan which allows you to actually host your database clusters through your own cloud account. Database Trends.

Cloud 145

Optimizing Database Performance and Efficiency

Baron Schwartz

It’s easy for modern, distributed, high-scale applications to hide database performance and efficiency problems. Optimizing performance of such complex systems at scale requires some skill, but more importantly it requires a sound strategy and good observability, because you can’t optimize what you can’t measure.

Best Practice for Creating Indexes on your MySQL Tables

Scalegrid

During this time, you are also likely to experience a degraded performance of queries as your system resources are busy in index-creation work as well. There will be a short duration (tens of seconds) during which you will lose connectivity to your database due to the failover, but this can be overcome by having application-level retries. In the UI above, you can select your Database and Table name, and ‘Add Index’ as the Alter Table Operation.

Database Technology in a Blockchain World

VoltDB

At first glance, it may seem like a new type of database. However, a closer look shows that blockchain and translytical databases are better together. Blockchain as a Database Isn’t Enough for the Enterprise. Freedom to transfer assets without reliance on a central system. However, the Bitcoin-iteration of this technology also shows why blockchain isn’t a direct replacement for your enterprise databases. NewSQL Databases for Blockchain Innovation.

Follower Clusters – 3 Major Use Cases for Syncing SQL & NoSQL Deployments

High Scalability

Follower clusters are a ScaleGrid feature that allows you to keep two independent database systems (of the same type) in sync. Unlike cloning or replication, this allows you to maintain an active, point-in-time copy of your production data. This extra cluster, known as a follower cluster, can be leveraged for multiple use cases, including for analyzing, optimizing and testing your application performance for MongoDB , MySQL and PostgreSQL.

Overview of the Shrink TempDB database in SQL Server

SQL Shack

This article explores the usage of TempDB and different ways to shrink the TempDB database in SQL Server Each instance of Microsoft SQL Server has a system database TempDB. Let’s review the TempDB database and its usage with ways to shrink the TempDB database in the […]. It is a backbone for the SQL Server instance. Installation, setup and configuration Monitoring

Monitoring SQL Server deadlocks using the system_health extended event

SQL Shack

You should ensure that the database performance is optimal all the time without any impact on the databases. Performance issues act like an open stage, and you need to look at every aspect such as CPU, RAM, server performance, database performance, indexes, blocking, […]. Performance monitoring is a must to do the task for a DBA.

Increasing access to blockchain and ledger databases

All Things Distributed

A major component to the system that HARA created is blockchain. Last year, I spent some time in Jakarta visiting HARA , an AWS customer. They've created a way to connect small farms in developing nations to banks and distributers of goods, like seeds, fertilizer, and tools. Traditionally, rural farms have been ignored by the financial world, because they don't normally have the information required to open an account or apply for credit.

Database Technology in a Blockchain World

VoltDB

At first glance, it may seem like a new type of database. However, a closer look shows that blockchain and translytical databases are better together. Blockchain as a Database Isn’t Enough for the Enterprise. Freedom to transfer assets without reliance on a central system. However, the Bitcoin-iteration of this technology also shows why blockchain isn’t a direct replacement for your enterprise databases. NewSQL Databases for Blockchain Innovation.

Redis Transactions & Long-Running Lua Scripts

Scalegrid

In this post, we will explain the Redis transactional property of scripts, what this error is about, and why we must be extra careful about it on Sentinel-managed systems that can failover. Behavior on Sentinel-Monitored High Availability Systems. Sentinel -managed high availability systems add a new wrinkle to this. We set up a sensitive high availability system to demonstrate this failover behavior. Get To Know the Redis Database: Iterating Over Keys.

Microservices, events, and upside-down databases

O'Reilly Software

The benefits of modeling data as events as a mechanism to evolve our software systems. Data is all-important—vital for the continued success of our businesses—but has also been seen as a massive constraint in how we design and evolve our systems. Back then, the most common pattern I saw for service-based systems was sharing a database among multiple services. So, the pattern is a bit like a shared database—there is a shared data set that everyone can use.

Amazon Aurora development team wins the 2019 ACM SIGMOD Systems Award

All Things Distributed

A few months ago, I wrote the post " Amazon Aurora ascendant: How we designed acloud-native relational database ," and now I'm excited to share some news about the people behind the service. This week, the developers of Amazon Aurora have won the 2019 Association for Computing Machinery's (ACM) Special Interest Group on Management of Data (SIGMOD) Systems Award.

Setting MySQL Configuration Variables – MySQL 5.7 vs MySQL 8.0

Scalegrid

MySQL configuration variables are a set of server system variables used to configure the operation and behavior of the server. In this blog post, we will explain the differences in managing the configuration variables between MySQL 5.7 and MySQL 8.0.

Fine-grained, secure and efficient data provenance on blockchain systems

The Morning Paper

Fine-grained, secure and efficient data provenance on blockchain systems Ruan et al., That’s hard to do in today’s blockchain systems for two reasons: Provenance can only be determined by querying and replaying all on-chain transactions, which is inefficient and an offline activity. They demonstrate that provenance queries are efficient, and the system incurs small storage overhead. VLDB’19.

SQL Server: OS Error 665 (File System Limitation) and Linux

SQL Server According to Bob

I have previously tested and blogged about the NTFS, sparse, file system limitation error 665: [link] when running DBCC or using Snapshot databases with SQL Server. Recently a customer asked me if they would encounter the same limitation if they moved to Linux. The answer is not the same limitation and for EXT and XFS my testing and research confirm that a sparse file on Linux may be able to accommodate more fragments than on NTFS.