article thumbnail

A New Era Has Come, and So Must Your Database Observability

DZone

Previously, our application was using one database; developers knew how it worked, and the deployment rarely happened. A single database administrator was capable of maintaining the database, optimizing the queries, and making sure things worked as expected. The complexity of the software increased significantly.

Database 288
article thumbnail

Using a GPU Boosts TiDB Analytics Performance from 10 to 150

DZone

Fei Xu (Software Engineer at PingCAP). TiDB is a Hybrid Transaction/Analytical Processing (HTAP) database that can efficiently process analytical queries. Authors: Ruoxi Sun (Tech Lead of Analytical Computing Team at PingCAP).

Analytics 223
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Automating Success: Building a better developer experience with platform engineering

Dynatrace

When it comes to platform engineering, not only does observability play a vital role in the success of organizations’ transformation journeys—it’s key to successful platform engineering initiatives. With observability, organizations can easily detect any performance bottlenecks, bugs, or security vulnerabilities earlier.

article thumbnail

How to Trace Linux System Calls in Production (Without Breaking Performance)

DZone

According to a performance test conducted by Arnaldo Carvalho de Melo, a senior software engineer at Red Hat, the process traced using strace ran 173 times slower, which is disastrous for a production environment. However, if you're running a trace in a production environment, strace is NOT a good choice.

Systems 171
article thumbnail

Millions of tiny databases

The Morning Paper

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Engineering decisions involve making lots of trade-offs.

Database 106
article thumbnail

Designing Instagram

High Scalability

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. Sample Queries supported by Graph Database.

Design 334
article thumbnail

Conducting log analysis with an observability platform and full data context

Dynatrace

Causal AI—which brings AI-enabled actionable insights to IT operations—and a data lakehouse, such as Dynatrace Grail , can help break down silos among ITOps, DevSecOps, site reliability engineering, and business analytics teams. ” In many cases, indexed databases only provide access to a sample of statistical data summaries.

Analytics 187