Dynatrace

OCTOBER 6, 2023

Grail: Enterprise-ready data lakehouse Grail, the Dynatrace causational data lakehouse, was explicitly designed for observability and security data, with artificial intelligence integrated into its foundation. Tables are a physical data model, essentially the type of observability data that you can store.

Artificial Intelligence 261

Artificial Intelligence Analytics Metrics Storage 261

Dynatrace

SEPTEMBER 14, 2022

As an industry leader, Dynatrace promotes primarily using software and AI to deal with this complexity at scale instead of just putting data on dashboards. Does that mean that reactive and exploratory data analysis, often done manually and with the help of dashboards, are dead? Why today’s data analytics solutions still fail us.

Metrics 229

Metrics Analytics Monitoring Efficiency 229

Dynatrace

MARCH 15, 2024

As organizations strive for observability and data democratization, OpenTelemetry emerges as a key technology to create and transfer observability data. Understanding OpenTelemetry OpenTelemetry is an open, vendor-neutral standard for creating, collecting, and transferring telemetry data, like traces, metrics, and logs.

Open Source 130

Open Source Best Practices Infrastructure Tuning 130

The Netflix TechBlog

MARCH 10, 2023

This platform has evolved from supporting studio applications to data science applications, machine-learning applications to discover the assets metadata, and build various data facts. Hence we built the data pipeline that can be used to extract the existing assets metadata and process it specifically to each new use case.

Media 237

Media Traffic Processing Design 237

The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. We have also noted a great potential for further improvement by model tuning (see the section of Rollout in Production).

Tuning 210

Tuning Efficiency Big Data Engineering 210

Dynatrace

OCTOBER 4, 2022

Some time ago, at a restaurant near Boston, three Dynatrace colleagues dined and discussed the growing data challenge for enterprises. At its core, this challenge involves a rapid increase in the amount—and complexity—of data collected within a company. Work with different and independent data types. Thus, Grail was born.

Artificial Intelligence 267

Artificial Intelligence Analytics Storage Architecture 267

The Netflix TechBlog

JANUARY 13, 2022

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. As our subscribers grow worldwide and Netflix enters the world of gaming , the number of batch workflows and real-time data pipelines increases rapidly.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

DECEMBER 5, 2023

Streamline privacy requirements with flexible retention periods Data retention is a critical aspect of data handling, and it’s not just about privacy compliance—it’s about having the flexibility to optimize data storage times in Grail for your Dynatrace use cases. Grail buckets function like folders in a file system.

Storage 166

Storage Healthcare Best Practices Speed 166

Percona

OCTOBER 17, 2023

This blog post discusses using the CLONE INSTANCE command with the safety option DATA DIRECTORY when you do not have enough disk space to store two datasets. However, when you clone a replica that already has a huge dataset, you may not have enough space for two datasets: one from the source server and data present on the replica.

Open Source 101

Open Source Servers Database Strategy 101

Dynatrace

FEBRUARY 15, 2023

Now we’re adding Smartscape to DQL and two new data sources to Grail: Metrics on Grail and Traces on Grail. Ensuring observability across these environments requires access to data at a massive scale. You no longer need to split, distribute, or pre-aggregate your data. Grail solves this scalability issue!

Analytics 229

Analytics Social Media Metrics Efficiency 229

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. This feature-packed database provides powerful and rapid analytics on data that scales up to petabyte volumes.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

JANUARY 26, 2024

Securing your data can be a tough task. Unlike some other databases, PostgreSQL does not have a native solution to encrypt data on disk transparently. Percona is developing PG_TDE to encrypt that data using the AES-CTR encryption algorithm.

Testing 112

Testing Database Code Development 112

Dynatrace

SEPTEMBER 7, 2022

Dynatrace and the Dynatrace Intelligent Observability Platform have added support for the newly introduced Amazon VPC Flow Logs to Amazon Kinesis Data Firehose. This support enables customers to define specific endpoint delivery of real-time streaming data to platforms such as Dynatrace. What is VPC Flow Logs? Why Dynatrace?

Traffic 215

Traffic AWS Network Cloud 215

The Netflix TechBlog

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer on the Product Data Science and Engineering team.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Scalegrid

JULY 17, 2020

It is an open standard format which organizes data into key/value pairs and arrays detailed in RFC 7159. JSON is the most common format used by web services to exchange data, store documents, unstructured data, etc. You can also check out our Working with JSON Data in PostgreSQL vs. JSONB Patterns & Antipatterns.

Storage 321

Storage Database Efficiency Processing 321

Percona

JANUARY 29, 2024

PostgreSQL differs from certain other databases as it lacks a native solution to encrypt data on disk transparently. At Percona, we are in the process of developing PG_TDE, a tool designed to encrypt data using the AES-CTR encryption algorithm.

Testing 96

Testing Database Design Code 96

Dynatrace

AUGUST 16, 2022

The data locked in your log files can be a goldmine for your application developers, operations teams, and your enterprise as a whole. However, it can be complicated , expensive , or even impossible to set up robust observability that makes use of this data. Log format inconsistency makes it a challenge to access critical data.

Processing 188

Processing Metrics Monitoring Java 188

Scalegrid

AUGUST 30, 2019

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. Instead, Redis stores data in data structures which makes it very flexible to use. Data Structures in Redis.

Cache 232

Cache Ecommerce Social Media Database 232

Dynatrace

AUGUST 10, 2021

And, they got the chance to do just that at our recent event, DynatraceGo, which I’ll tell you a bit more about in this blog. These two are tied together, because as Yorck puts it, “If we don’t keep our data secure, who would believe in us? Spatial Collapse: The Great Acceleration of Turning Data into an Asset.

DevOps 246

DevOps Innovation Big Data Cloud 246

Dynatrace

JUNE 15, 2021

The path to “Architected for Resiliency” is long, but it clearly pays off in the long run, especially when outages occur, as I want to show you in this blog post. Through the RUM data, Dynatrace’s AI engine, Davis, detected seven users were impacted by the outage when they tried to access the Web Interface.

AWS 189

AWS Traffic Architecture Azure 189

Dynatrace

JULY 29, 2021

Using existing storage resources optimally is key to being able to capture the right data over time. In this blog post, we announce: Compression of transaction data that’s older than three days. Improvements to Adaptive Data Retention. Transaction-data compression for Dynatrace Managed environments.

Storage 198

Storage Virtualization Infrastructure Availability 198

Dynatrace

AUGUST 2, 2021

As objective measurements, they allow us to make data-driven decisions. The Data explorer. With the update to Dynatrace version 1.222, you can now use the new Data explorer interface to interactively build, test, and create your own metric calculations—right on your dashboards. Dynatrace news. Metrics matter. Combine metrics.

Metrics 245

Metrics Analytics Google Code 245

Dynatrace

MARCH 4, 2020

It helps you identify errors, analyze areas of struggle, and provides tons of analytical data for your testing teams. We’ve developed Session Replay with data privacy regulations and laws in mind, including GDPR (in Europe), California Consumer Privacy Act (CCPA), and Brazilian General Data Protection Law (LGPD).

Tuning 228

Tuning Analytics Strategy Website 228

The Netflix TechBlog

OCTOBER 15, 2019

Part I: Overview Andreas Andreakis , Falguni Jhaveri , Ioannis Papapanagiotou , Mark Cho , Poorna Reddy , Tongliang Liu Overview It is a commonly observed pattern for applications to utilize multiple datastores where each is used to serve a specific need such as storing the canonical form of data (MySQL etc.), caching (Memcached etc.),

Transportation 192

Transportation Architecture Processing Storage 192

Dynatrace

SEPTEMBER 9, 2019

I love data. I have spent virtually my entire career looking at data. Synthetic data, network data, system data, and the list goes on. As much as I love data, data is cold, it lacks emotion. As much as I love data, data is cold, it lacks emotion. Often, 4s is too slow.

Big Data 148

Big Data Metrics Virtualization Monitoring 148

Percona

OCTOBER 16, 2023

PG_TDE is an experimental transparent data encryption access method for PostgreSQL 16 and beyond. Transparent Data Encryption (TDE) offers encryption at the file level and solves the problem of protecting data at rest. This software is under active development and at a very early stage of design and implementation. What is TDE?

Open Source 115

Open Source Testing Database Design 115

Percona

OCTOBER 11, 2023

In this blog post, we will discuss how we can migrate data from MongoDB Atlas to self-hosted MongoDB. There are a couple of third-party tools in the market to migrate data from Atlas to Pecona Server for MongoDB (PSMDB), like MongoPush, Hummingbird, and MongoShake. It will ask for load sample data. only copy the data).

Database 90

Database Open Source Testing Servers 90

Dynatrace

APRIL 22, 2022

Although many companies adopt solutions such as OpenTelemetry, Prometheus, and Grafana as part of their observability strategy, they often confront a common data analysis problem: data silos. When teams, tools, and data are siloed, it’s harder for organizations to succeed. This leads to multiple tool-specific dashboards.

Open Source 173

Open Source Metrics Cloud Tuning 173

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. Built-in resiliency ensures data completeness and consistency even if Fluentd or an endpoint service goes down temporarily. All metrics, traces, and real user data are also surfaced in the context of specific events.

Metrics 179

Metrics Analytics Software Architecture Open Source 179

Dynatrace

MARCH 16, 2022

Over the last year, Dynatrace extended its AI-powered log monitoring capabilities by providing support for all log data sources. We added monitoring and analytics for log streams from Kubernetes and multicloud platforms like AWS, GCP, and Azure, as well as the most widely used open-source log data frameworks.

Metrics 214

Metrics Lambda Infrastructure Monitoring 214

Dynatrace

MAY 2, 2024

With the ability to generate new content—such as images, text, audio, and other data—based on patterns and examples taken from existing data, organizations are rushing to capitalize on the AI model. As organizations train generative AI systems with critical data, they must be aware of the security and compliance risks.

Artificial Intelligence 211

Artificial Intelligence Cloud Best Practices DevOps 211

Percona

JULY 7, 2023

Changing the data type on a column in a big table is almost always a pain. It can lock out the entire table for reading and writing because of the exclusive lock acquired by the ALTER TABLE statement that changes the data type. It works for any data type; let’s look at Integer to Big Integer change as an example.

Open Source 90

Open Source Testing Design Code 90

O'Reilly Software

DECEMBER 31, 0001

2020 Apr 6 Off by Two 2019 May 12 f() vs f(void) in C vs C++ 2019 Jan 18 Finding Compiler Bugs With C-Reduce 2018 Oct 24 Booting a Custom Linux Kernel in QEMU and Debugging It With GDB 2018 Jun 2 Speeding Up Linux Kernel Builds With ccache 2017 Sep 5 GCC vs LLVM Q3 2017 Commit Rates and Active Developer Counts 2017 May 31 Running Clang-Tidy (..)

C++ 40

C++ Speed Development 40

Uber Engineering

AUGUST 5, 2021

While growing rapidly, we’re also committed to maintaining data quality, as it can greatly … The post How Uber Achieves Operational Excellence in the Data Quality Experience appeared first on Uber Engineering Blog.

Transportation 145

Transportation Engineering Efficiency Architecture 145

Uber Engineering

NOVEMBER 10, 2021

This generates a large number of financial transactions that need to be stored with provable completeness, consistency, and compliance. … The post How Uber Migrated Financial Data from DynamoDB to Docstore appeared first on Uber Engineering Blog.

Engineering 135

Engineering Systems Architecture 135

Dynatrace

APRIL 23, 2020

But your applications often contain sensitive data that must be kept secure and in compliance with your company’s security policies. To remain compliant, you need to ensure protection for certain types of data and specific attributes that may contain personally identifiable information (PII). Location data masking.

Mobile 183

Mobile Monitoring Code Processing 183

O'Reilly

SEPTEMBER 15, 2021

In June 2021, we asked the recipients of our Data & AI Newsletter to respond to a survey about compensation. The average salary for data and AI professionals who responded to the survey was $146,000. We didn’t use the data from these respondents; in practice, discarding this data had no effect on the results.

Azure 145

Azure Social Media Programming AWS 145