DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. Traditionally, this process involved manual configuration, leading to potential inconsistencies, human errors, and time-consuming deployments.

Data Engineering 141

Data Engineering Infrastructure Engineering Code 141

Dynatrace

MAY 14, 2020

The world’s most scalable, automatic distributed tracing pushes the boundary once again with enhanced Adaptive Load Management. Dynatrace PurePath technology captures and analyzes transactions end to end across every tier of your application technology stack, from the browser all the way down to the code and database level.

Processing 155

Processing Hardware Traffic Storage 155

Dynatrace

OCTOBER 23, 2023

Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. Firstly, managing virtual networks can be complex as networking in a virtual environment differs significantly from traditional networking.

Efficiency 216

Efficiency Virtualization Hardware Performance 216

Dynatrace

JUNE 9, 2023

Data volumes are growing all the time, making it harder to orchestrate, process, and analyze to turn information into insight. DevOps maturity is a model that measures the completeness and effectiveness of an organization’s processes for software development, delivery, operations, and monitoring. What is DevOps maturity?

DevOps 186

DevOps Analytics Storage Metrics 186

Percona

SEPTEMBER 1, 2023

MySQL performance tuning offers several significant advantages for effective database management and optimization. Enhanced Database Efficiency By adjusting configuration settings, you can markedly enhance the overall efficiency of your MySQL database. Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. The process started with manual pull of member account information that was part of the session.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

JANUARY 16, 2023

The strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Java, Go, and Node.js

Open Source 345

Open Source Java Operating System Programming 345

Scalegrid

JANUARY 9, 2024

The selection process for a suitable cloud provider is crucial as it involves aligning business objectives, regulatory requirements, and current technological infrastructure with strong cloud security measures. This process involves converting regular data into a coded form, which helps to protect its privacy and guard against cyber threats.

Strategy 130

Strategy Cloud Best Practices Government 130

Percona

OCTOBER 10, 2023

Databases are different from a lot of software. This is not a general rule, but as databases are responsible for a core layer of any IT system – data storage and processing — they require reliability. introduces is the limitation of the downgrade process. Why choose Percona Server for MongoDB?

Availability 102

Availability Servers Database Open Source 102

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Percona

OCTOBER 13, 2023

When MySQL generates a core file, the VS code simplifies the process of debugging. Once the debug process starts, we can find the debug toolbar at the top center and threading information on the CALL STACK view. storage/innobase/./././mysql-8.0.34/storage/innobase/row/row0sel.cc': storage/innobase/./././mysql-8.0.34/":

Code 104

Code C++ Storage Programming 104

Percona

MAY 1, 2023

It has default settings for all of the database parameters. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. The performance of a PostgreSQL database has a significant impact on the overall effectiveness of an application.

Tuning 52

Tuning Efficiency Database Performance 52

Dynatrace

AUGUST 9, 2023

As a result, not only can you understand, for example, that someone accessed a database, but also from where they came, exactly what they accessed, and to where they exported the data–to the level that we know the exact database query statement.

Analytics 220

Analytics Metrics Database Storage 220

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. This covers the infrastructure, processes, and the application stack, including tracing, profiling, and logs.

Metrics 180

Metrics Engineering Energy Tuning 180

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 202

Monitoring Serverless Programming Speed 202

Dynatrace

AUGUST 5, 2022

In a distributed processing environment, message queuing is similar, although the speed and volume of messages are much greater. A producer creates the message, and a consumer processes it. Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them.

Monitoring 201

Monitoring Serverless Programming Speed 201

VoltDB

JULY 10, 2018

But that fully self sufficient nature means that each of these services have their own end-to-end full stack of technology, including database. If the data is common between multiple services, the database layer gets extricated out of microservices in favor of the creation of a common shared data layer. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

VoltDB

JULY 10, 2018

But that fully self sufficient nature means that each of these services have their own end-to-end full stack of technology, including database. If the data is common between multiple services, the database layer gets extricated out of microservices in favor of the creation of a common shared data layer. Problem solved, right?

Architecture 40

Architecture Scalability Ecommerce Latency 40

Percona

MARCH 21, 2023

The replica doesn’t have checking capabilities when processing replicated transactions as of MySQL 8.0.18. In that situation, implementing the upstream changes in a more constrained security context is beneficial to organizations needing privilege-controlled aggregate data from multiple separate databases.

Storage 89

Storage Open Source Database Engineering 89

Percona

AUGUST 7, 2023

Both logs are crucial in the ACID (Atomicity, Consistency, Isolation, Durability) properties of database systems. InnoDB Undo Log The undo log, also known as the rollback segment, is a crucial part of the InnoDB storage engine. In a database system, rollback segments are used to temporarily store undo data during transactions.

Database 97

Database Tuning Storage Open Source 97

Percona

JUNE 4, 2023

Introduction: MariaDB vs. MySQL The goal of this blog post is to evaluate, at a higher level, MariaDB vs. MySQL vs. Percona Server for MySQL side-by-side to better inform the decision making process. It is largely an unofficial response to published comments from the MariaDB Corporation. What is MariaDB? Contact us to learn more!

Open Source 52

Open Source Servers Storage Scalability 52

Percona

AUGUST 1, 2023

In the world of database management, ALTER TABLE operations are a crucial part of modifying database structures. MySQL, a popular database management system, offers online operations since version 5.6, After changing the VARCHAR column size to 200, the following is the storage requirement. However, there are caveats.

Storage 82

Storage Database Open Source Engineering 82

Percona

AUGUST 17, 2023

PostgreSQL is open source relational database management software. Most recently, in StackOverflow’s 2022 Stack Developer Survey , PostgreSQL took a slight lead over MySQL (46.48% to 45.68%) as the most popular database platform among professional developers. What is PostgreSQL used for? Is PostgreSQL enterprise-ready?

Open Source 81

Open Source Healthcare Social Media Database 81

O'Reilly Software

JUNE 12, 2018

Back then, the most common pattern I saw for service-based systems was sharing a database among multiple services. The rationale was simple: the data I need is already in this other database, and accessing a database is easy, so I’ll just reach in and grab what I need. And data was at the heart of the problem.

Database 72

Database Cache Architecture Latency 72

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

NOVEMBER 23, 2020

While speeding up development processes and reducing complexity does make the lives of Kubernetes operators easier, the inherent abstraction and automation can lead to new types of errors that are difficult to find, troubleshoot, and prevent. Configuring storage in Kubernetes is more complex than using a file system on your host.

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

Percona

DECEMBER 27, 2023

of respondents are currently utilizing databases in Kubernetes (k8s). These indicators suggest that the adoption of databases on k8s is in its early stages and is likely to continue growing in the future. According to the Dynatrace Kubernetes in the Wild 2023 report , a significant 71% (with 48% year-over-year growth!)

Cloud 81

Cloud Open Source Strategy Best Practices 81

Percona

AUGUST 18, 2023

This blog will explore the hurdles encountered during the upgrade process and the innovative solution that saved the day. 2023-05-12T08:10:39.374389Z 1 [ERROR] [MY-011013] [Server] Failed to initialize DD Storage Engine. It also shows the importance of thorough testing in complex database upgrades. to MySQL 8.0,

Open Source 68

Open Source Database Storage Engineering 68

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT 78

IoT Analytics Big Data Architecture 78

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. On the other hand, these optimizations themselves need to be sufficiently inexpensive to justify their own processing cost over the gains they bring.

Storage 203

Storage Latency Efficiency Data Engineering 203

Scalegrid

DECEMBER 6, 2023

The choice of self-managed cloud databases vs DBaaS is a common debate among those who are looking for the best option that will cater to their particular needs. Database as a Service (DBaaS) and managed databases offer distinct advantages along with certain challenges.

Database 130

Database Cloud Hardware Storage 130

SQL Server According to Bob

SEPTEMBER 9, 2019

Acquiring shared access requires only the local partition be acquired (lightweight scalability). A handful of lock types (Database, Metadata, LOGIN_STATS, …) are eligible for lock partitioning. For example: When ‘use database’ takes place the session acquires a shared lock on database.

Servers 103

Servers Database Scalability Tuning 103

Percona

JULY 13, 2023

With the rise of globalization, the need to store and process multilingual data has become essential. MySQL, one of the most popular relational database management systems, recognizes this need and has introduced utf8mb4 in its 8.0 The emoji will be stored correctly in the database because the utf8mb4 character set can store emojis.

Database 94

Database Games Open Source Engineering 94

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. What is an MPP Database?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

The Netflix TechBlog

MAY 21, 2019

Partners across the globe leverage Netflix device certification process on a continual basis to ensure that quality products and experiences are delivered to their customers. The certification process involves the verification of partner’s implementation of features provided by the Netflix SDK. We also provide an API client in Python.

Testing 163

Testing AWS Lambda Network 163

ScaleOut Software

JUNE 22, 2020

In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52