O'Reilly Software

JUNE 12, 2018

The benefits of modeling data as events as a mechanism to evolve our software systems. In fact, before we even had the word microservices in our lexicon, back when it was just good old-fashioned service-oriented architecture, we were talking about data: how to access it, where it lives, who “owns” it.

Database 72

Database Cache Architecture Latency 72

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Percona

AUGUST 30, 2023

Data powers everything, and unlike coal and coal combustion, data and databases aren’t going away. Any organization that uses personal and other sensitive data must have a firm, proven plan for business continuity in the event of a disaster or cyberattack. It’s suitable for databases with moderate change rates.

Database 86

Database Hardware Open Source Strategy 86

Dynatrace

OCTOBER 7, 2021

To get a better understanding of AWS serverless, we’ll first explore the basics of serverless architectures, review AWS serverless offerings, and explore common use cases. Serverless architecture: A primer. Serverless architecture shifts application hosting functions away from local servers onto those managed by providers.

Serverless 289

Serverless AWS Lambda Storage 289

The Netflix TechBlog

APRIL 27, 2023

Ruchir Jha , Brian Harrington , Yingwu Zhao TL;DR Streaming alert evaluation scales much better than the traditional approach of polling time-series databases. It allows us to overcome high dimensionality/cardinality limitations of the time-series database. It opens doors to support more exciting use-cases. OK, Results?

Storage 288

Storage Cache Metrics Database 288

Dynatrace

OCTOBER 2, 2023

Transforming an application from monolith to microservices-based architecture can be daunting, and knowing where to start can be difficult. Because monolithic applications combine database, client-side interfaces, and server-side application elements in a single executable, they’re difficult to understand, even for their own administrators.

Architecture 241

Architecture Artificial Intelligence Cloud Open Source 241

All Things Distributed

JULY 14, 2015

I am excited to share with you that today we are expanding DynamoDB with streams, cross-region replication, and database triggers. In traditional database architectures, database engines often run a small search engine or data warehouse engines on the same hardware as the database. DynamoDB Triggers.

Database 167

Database Lambda AWS IoT 167

Scalegrid

MARCH 8, 2024

With MySQL point-in-time recovery , you can restore your database to the moment before the problem occurs. Preparation for PITR is crucial and involves enabling binary logging and creating a full database backup. By harnessing MySQL’s binary logging feature, every event is recorded in real-time.

Database 162

Database Strategy Servers Best Practices 162

SQL Performance

APRIL 15, 2020

SQL Server has always provided the ability to capture actual queries in an easily-consumable rowset format – first with legacy SQL Server Profiler, later via Extended Events, and now with a combination of those two concepts in Azure SQL Database. Legacy Profiler "Standard" trace events.

Azure 96

Azure Database Tuning Network 96

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. However, Redis, with its single-threaded architecture, may encounter bottlenecks with large numbers of concurrent connections.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

APRIL 20, 2023

Logs highlight observability challenges Ingesting, storing, and processing the unprecedented explosion of data from sources such as software as a service, multicloud environments, containers, and serverless architectures can be overwhelming for today’s organizations. Grail enables 100% precision insights into all stored data.

Analytics 196

Analytics Infrastructure Storage Efficiency 196

Strategic Tech

SEPTEMBER 30, 2020

I’ve heard the opinion from many technical leaders that it is reasonable to expect a new hire to take upto 6 months to learn about the code, the domain, and the architecture before they become fully productive. I believe that self-documenting architecture would dramatically reduce one of the big costs in software development.

Architecture 75

Architecture Design Programming Software 75

Dynatrace

FEBRUARY 9, 2022

Cloud vendors such as Amazon Web Services (AWS), Microsoft, and Google provide a wide spectrum of serverless services for compute and event-driven workloads, databases, storage, messaging, and other purposes. AI-powered automation and deep, broad observability for serverless architectures. Dynatrace news. New to Dynatrace?

Serverless 196

Serverless Azure Lambda AWS 196

Dynatrace

JANUARY 31, 2024

Retrieval-augmented generation emerges as the standard architecture for LLM-based applications Given that LLMs can generate factually incorrect or nonsensical responses, retrieval-augmented generation (RAG) has emerged as an industry standard for building GenAI applications.

Cache 212

Cache Azure Infrastructure Monitoring 212

The Netflix TechBlog

APRIL 12, 2022

In a federated graph architecture, how can we answer such a query given that each entity is served by its own service? Sample GraphQL query To keep the index up to date, events are used to trigger a reindexing operation for individual entities when they change. however, application events are also supported when necessary.

Engineering 263

Engineering Architecture Java Infrastructure 263

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Application architectures might not be conducive to rehosting. Reduce the volume of data volumes requested from databases (for example, request all, filter in memory). Is the solution to just move all workloads to the cloud?

Cloud 218

Cloud Energy Best Practices Cache 218

Strategic Tech

JULY 21, 2020

Most organisations go through an architecture modernisation effort at some point as their systems drift into a state of intolerable maintenance costs and they diverge too far from modern technological advances. What architecture will be optimal for enabling that business vision? How are we going to deliver the new architecture?

Architecture 98

Architecture Design Software Architecture Strategy 98

The Netflix TechBlog

AUGUST 1, 2022

As the system evolves to solve more and more use cases, we have expanded its scope to handle not only the CDC use cases but also more general data movement and processing use cases such that: Events can be sourced from more generic applications (not only databases). A pipeline can be created from the UI or via our declarative API.

Processing 272

Processing Transportation Entertainment Tuning 272

Dynatrace

JANUARY 31, 2024

The comprehensive functionality is highly customizable, facilitating a seamless presentation of any SAP metric in the context of SAP systems, business architecture, and all SAP-integrated systems. It can also directly access database tables under the strict control of DBAs. Architectural overview.

Java 198

Java Analytics Best Practices Monitoring 198

Percona

AUGUST 22, 2023

Estimates vary, but most reports put the average cost of unplanned database downtime at approximately $300,000 to $500,000 per hour, or $5,000 to $8,000 per minute. With so much at stake, database high availability and fault tolerance have become must-have items, but many companies just aren’t certain which one they must have.

Availability 78

Availability Hardware Open Source Database 78

Dynatrace

JANUARY 16, 2023

The strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Strongest Kubernetes growth areas are security, databases, and CI/CD technologies. Of the organizations in the Kubernetes survey, 71% run databases and caches in Kubernetes, representing a +48% year-over-year increase. Java, Go, and Node.js

Open Source 349

Open Source Java Operating System Programming 349

Dynatrace

FEBRUARY 8, 2021

Also, these modern, cloud-native architectures produce an immense volume, velocity, and variety of data. Logs and events play an essential role in this mix; they include critical information which can’t be found anywhere else, like details on transactions, processes, users and environment changes.

Cloud 262

Cloud Azure Analytics AWS 262

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. In databases like MySQL and PostgreSQL, transaction logs are the source of CDC events.

Database 197

Database Traffic Transportation Open Source 197

Dynatrace

FEBRUARY 16, 2023

This unified approach enables Grail to vault past the limitations of traditional databases. And without the encumbrances of traditional databases, Grail performs fast. “In In most cases, especially with more complex queries, Grail gives you answers at five to 100 times more speed than any other database you can use right now.”

Analytics 195

Analytics Innovation Metrics Database 195

Dynatrace

FEBRUARY 12, 2024

And that’s where lifecycle events come in. The new observability app for databases from Dynatrace was built to cater to all requirements of database administrators (DBAs), from swiftly assessing database availability and performance to delving into architectural intricacies for efficient troubleshooting.

Engineering 190

Engineering Development Infrastructure Cloud 190

The Netflix TechBlog

DECEMBER 11, 2020

Our Journey so Far Over the past year, we’ve implemented the core infrastructure pieces necessary for a federated GraphQL architecture as described in our previous post: Studio Edge Architecture The first Domain Graph Service (DGS) on the platform was the former GraphQL monolith that we discussed in our first post (Studio API).

Architecture 249

Architecture Best Practices Engineering Open Source 249

High Scalability

JANUARY 11, 2022

Architecture. We will use a graph database such as Neo4j to store the information. Additionally, we can use columnar databases like Cassandra to store information like user feeds, activities, and counters. Sample Queries supported by Graph Database. Sending and receiving messages from other users. High Level Design.

Design 334

Design Media Storage Logistics 334

Dynatrace

JANUARY 26, 2021

Unlike a traditional virtual machine-model where customers must build and manage an entire VM, serverless computing provides the ability to purchase only the CPU cycles and memory needed to support an application using an event-based pay-per-use model. Making use of serverless architecture. Services scale to meet demand.

Serverless 245

Serverless Efficiency Lambda Azure 245

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. This blog highlights considerations for keeping your own PostgreSQL databases highly available and healthy. The same changes made in the primary database are made in the replicas.

Availability 83

Availability Open Source Architecture Database 83

Dynatrace

OCTOBER 4, 2022

Further, these resources support countless Kubernetes clusters and Java-based architectures. They can call on dozens of databases and deliver gigabytes of data across myriad devices. Lining up traces, logs, and metrics based on user events and timestamps provides the most complete picture of full-stack dependencies.

Analytics 230

Analytics Storage Infrastructure Metrics 230

Dynatrace

AUGUST 30, 2019

And while these events are a great opportunity for us Dynatracers to share our thoughts with our users, it’s also an amazing opportunity to for us to learn from our users about how they use Dynatrace to optimize digital experiences and digital operations in both the public and private sector. Dynatrace news. APAC Series.

Cache 203

Cache Architecture Database Government 203

Dynatrace

OCTOBER 4, 2022

Collecting logs, metrics, events, and trace data is great. Systems automatically generate logs, which record events that took place. Log entries usually contain the following: Date and time of event; System or resource name; App name; and. Event severity. An example is improving customer experience. User experience data.

Analytics 200

Analytics Software Software Storage 200

The Netflix TechBlog

JULY 26, 2021

Netflix is known for its loosely coupled microservice architecture and with a global studio footprint, surfacing and connecting the data from microservices into a studio data catalog in real time has become more important than ever. In the initial stage, data consumers set up ETL pipelines directly pulling data from databases.

Big Data 253

Big Data Government Analytics Processing 253

Scalegrid

JANUARY 5, 2024

If you’re considering a database management system, understanding these benefits is crucial. DBMS enhances data security with encryption, implements various access controls, and enables improved data sharing and concurrent access, thus facilitating quick response to changes and maintaining consistent database accuracy.

Efficiency 147

Efficiency Storage Database Scalability 147

Particular Software

JUNE 7, 2017

You can attempt to avoid this bitter fate by using architectural patterns like event-driven architecture. When you build a system of discrete services that communicate via events, you limit the complexity of each service by reducing coupling. What do I mean by event? Often, commands and events come in pairs.

Architecture 68

Architecture Code Processing Systems 68

The Netflix TechBlog

AUGUST 30, 2021

In the Device Management Platform, this is achieved by having device updates be event-sourced through the control plane to the cloud so that NTS will always have the most up-to-date information about the devices available for testing. Upstream event sourcing was fully enabled on the producer side at around 2021–07–15 15:00 PST.

Latency 213

Latency Traffic Transportation Hardware 213