The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. For example, a five-minute outage today is equivalent to a two-hour outage at the time of our last Mantis blog post.

Open Source 148

Open Source Metrics Engineering Processing 148

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. With the latest Data Mesh Platform, data movement in Netflix Studio reaches a new stage.

Big Data 253

Big Data Government Analytics Processing 253

Dynatrace

MARCH 18, 2024

OpenTelemetry standardizes how organizations instrument, generate, and collect telemetry data for analysis and provides community-based support. Because of its flexibility, this open source approach to instrumenting and collecting telemetry data is becoming increasingly important in large-size organizations.

Scalability 251

Scalability Open Source Analytics Innovation 251

Testsigma

FEBRUARY 7, 2022

Open-source software development has grown increasingly popular over the last two decades. Popular OS like Linux and Android; Browsers like Firefox and Chrome; Programming languages like Python and JavaScript; Automation tools like Selenium and Appium; are all Open-Source. Startups are generally budget-challenged.

Open Source 81

Open Source Testing Innovation Speed 81

The Netflix TechBlog

OCTOBER 28, 2021

Data Engineers of Netflix?—?Interview Interview with Pallavi Phadnis This post is part of our “ Data Engineers of Netflix ” series, where our very own data engineers talk about their journeys to Data Engineering @ Netflix. Pallavi Phadnis is a Senior Software Engineer on the Product Data Science and Engineering team.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

Dynatrace

OCTOBER 4, 2022

Some time ago, at a restaurant near Boston, three Dynatrace colleagues dined and discussed the growing data challenge for enterprises. At its core, this challenge involves a rapid increase in the amount—and complexity—of data collected within a company. Work with different and independent data types. Thus, Grail was born.

Artificial Intelligence 257

Artificial Intelligence Analytics Storage Architecture 257

The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. For example, a five-minute outage today is equivalent to a two-hour outage at the time of our last Mantis blog post.

Open Source 101

Open Source Metrics Engineering Processing 101

The Netflix TechBlog

OCTOBER 21, 2019

Where other systems may take over ten minutes to process metrics accurately, Mantis reduces that from tens of minutes down to seconds, effectively reducing our Mean-Time-To-Detect. For example, a five-minute outage today is equivalent to a two-hour outage at the time of our last Mantis blog post.

Open Source 100

Open Source Metrics Engineering Processing 100

Testsigma

FEBRUARY 9, 2022

Open-source projects or open-source software is probably not a new term. In the past decade, open-source software contributions have been on a steady rise resulting in frequent releases, improvements and newer software. This is what open-source is. Testsigma just went open source!

Open Source 52

Open Source Code Software Software 52

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 202

Java Scalability Traffic Architecture 202

DZone

MAY 5, 2023

Apache Kafka and Apache Flink are increasingly joining forces to build innovative real-time stream processing applications. The Tremendous Adoption of Apache Kafka and Apache Flink Apache Kafka became the de facto standard for data streaming.

Open Source 246

Open Source Storage Innovation Engineering 246

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. This way log processing can progress alongside dump processing.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Therefore, dumps are needed to capture the full state of a source. This way log processing can progress alongside dump processing.

Database 197

Database Traffic Transportation Open Source 197

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. It collects, processes, and outputs log files to and from a wide variety of technologies. Processing plugins parse (normalize), filter, enrich (tagging), format, and buffer log streams. Dynatrace news.

Metrics 170

Metrics Analytics Software Architecture Open Source 170

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. Learn about what’s in it: [link] Some selected sessions: OPN201 Change is coming to robotics development: The shift to ROS 2 ??

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

We’re excited to let you know that we have an Open Source track at re:Invent this year! Brendan Gregg tours BPF tracing, with open source tools & examples for EC2 instance analysis. Learn about what’s in it: [link] Some selected sessions: OPN201 Change is coming to robotics development: The shift to ROS 2 ??

Open Source 40

Open Source AWS Lambda Serverless 40

Dynatrace

MAY 2, 2024

With the ability to generate new content—such as images, text, audio, and other data—based on patterns and examples taken from existing data, organizations are rushing to capitalize on the AI model. As organizations train generative AI systems with critical data, they must be aware of the security and compliance risks.

Artificial Intelligence 218

Artificial Intelligence Cloud Best Practices DevOps 218

The Netflix TechBlog

JUNE 25, 2021

By Gim Mahasintunan on behalf of Data Platform Engineering. Supporting a rapidly growing base of engineers of varied backgrounds using different data stores can be challenging in any organization. In this blog post, we are thrilled to share that we are open-sourcing one such tool: the Netflix Data Explorer.

Metrics 152

Metrics Best Practices Strategy Design 152

Dynatrace

JUNE 13, 2022

Open source code, for example, has generated new threat vectors for attackers to exploit. A case in point is Log4Shell, which emerged in late 2021 and exposed open source libraries to exploitation. Cloud operations and observability boost resilience for American Family – blog. Open source software security.

Open Source 211

Open Source DevOps Java Innovation 211

Percona

OCTOBER 11, 2023

In this blog post, we will discuss how we can migrate data from MongoDB Atlas to self-hosted MongoDB. There are a couple of third-party tools in the market to migrate data from Atlas to Pecona Server for MongoDB (PSMDB), like MongoPush, Hummingbird, and MongoShake. It will ask for load sample data. only copy the data).

Database 84

Database Open Source Testing Servers 84

Uber Engineering

OCTOBER 9, 2017

Uber facilitates seamless and more enjoyable user experiences by channeling data from a variety of real-time sources.

Open Source 85

Open Source Analytics Traffic Engineering 85

The Netflix TechBlog

NOVEMBER 29, 2023

As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. A vital aspect of such development is subjective testing with HDR encodes in order to generate training data. Yes, we are committed to supporting the open-source community.

Open Source 252

Open Source Software Engineering Internet Internet 252

Dynatrace

APRIL 8, 2022

Fluentd is an open-source data collector that unifies log collection, processing, and consumption. It collects, processes, and outputs log files to and from a wide variety of technologies. Processing plugins parse (normalize), filter, enrich (tagging), format, and buffer log streams. Dynatrace news.

Metrics 130

Metrics Analytics Software Architecture Open Source 130

Dynatrace

AUGUST 16, 2021

These include spending too much time on manual processes, finger-pointing due to siloed teams, and poor customer experience because of unplanned work. These problems are the drivers behind Dynatrace’s solution offering called Cloud Automation and this two-part blog series shows how to tackle these problems using GitHub Actions.

Software 245

Software Software Open Source Azure 245

Dynatrace

APRIL 11, 2023

Log4Shell required many organizations to take devices and applications offline to prevent malicious attackers from gaining access to IT systems and sensitive data. As a result, organizations need to be vigilant in identifying and addressing vulnerabilities to protect their systems and data. What is vulnerability management?

Cloud 176

Cloud DevOps Open Source Retail 176

Dynatrace

JUNE 15, 2021

The path to “Architected for Resiliency” is long, but it clearly pays off in the long run, especially when outages occur, as I want to show you in this blog post. Through the RUM data, Dynatrace’s AI engine, Davis, detected seven users were impacted by the outage when they tried to access the Web Interface.

AWS 179

AWS Traffic Architecture Azure 179

Percona

JANUARY 29, 2024

PostgreSQL differs from certain other databases as it lacks a native solution to encrypt data on disk transparently. At Percona, we are in the process of developing PG_TDE, a tool designed to encrypt data using the AES-CTR encryption algorithm.

Testing 91

Testing Database Design Code 91

Percona

JULY 7, 2023

Changing the data type on a column in a big table is almost always a pain. It can lock out the entire table for reading and writing because of the exclusive lock acquired by the ALTER TABLE statement that changes the data type. It works for any data type; let’s look at Integer to Big Integer change as an example.

Open Source 84

Open Source Testing Design Code 84

Dynatrace

JULY 29, 2022

Open source vulnerabilities creeping in through the software supply chain are one key reason for this substantial increase. According to one survey, supply chain attacks on open source software increased 650% in 2021. The compromised software can then compromise customer data or IT systems.

Software 179

Software Software Open Source DevOps 179

Dynatrace

OCTOBER 1, 2021

In IT and cloud computing, observability is the ability to measure a system’s current state based on the data it generates, such as logs, metrics, and traces. Organizations usually implement observability using a combination of instrumentation methods including open-source instrumentation tools, such as OpenTelemetry.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Scalegrid

JULY 17, 2020

It is an open standard format which organizes data into key/value pairs and arrays detailed in RFC 7159. JSON is the most common format used by web services to exchange data, store documents, unstructured data, etc. You can also check out our Working with JSON Data in PostgreSQL vs. JSONB Patterns & Antipatterns.

Storage 321

Storage Database Efficiency Processing 321

Dynatrace

FEBRUARY 10, 2023

Data proliferation—as well as a growing need for data analysis—has accelerated. According to recent Dynatrace data, 59% of CIOs say the increasing complexity of their technology stack could soon overload their teams without a more automated approach to IT operations. Digital transformation shows no signs of slowing down.

Efficiency 264

Efficiency Performance Analytics DevOps 264

Dynatrace

MAY 7, 2024

Fluent Bit is a telemetry agent designed to receive data (logs, traces, and metrics), process or modify it, and export it to a destination. Fluent Bit can serve as a proxy before you send data to Dynatrace or similar. However, you can also use Fluent Bit as a processor because you can perform various actions on the data.

Best Practices 231

Best Practices IoT Metrics Storage 231

Dynatrace

SEPTEMBER 29, 2021

Part one also provided an overview of Dynatrace’s Cloud Automation solution, Microsoft’s GitHub Actions , and open-source examples you can use and extend related to deployment and release monitoring. For orientation on the use cases in this blog series, refer to the picture below. Blog series use cases.

Software 189

Software Software Open Source DevOps 189

Dynatrace

JUNE 9, 2021

In this blog, I’ll first cover the basics, explaining what web application security is and why it’s important. Web application security is the process of protecting web applications against various types of threats that are designed to exploit vulnerabilities in an application’s code. Dynatrace news. million Americans, 15.2

Open Source 177

Open Source Entertainment Tuning Internet 177

Dynatrace

JANUARY 31, 2022

According to recent Dynatrace data, some 99% of organizations have adopted cloud architecture. To get a handle on observability, teams often adopt open-source observability tools, such as Prometheus, OpenTelemetry , and StatsD. But between multicloud platforms and open-source tools, teams can also experience data silos.

Serverless 168

Serverless Architecture Open Source Innovation 168

Dynatrace

OCTOBER 7, 2020

At the same time, you can now simply flip a switch to begin ingesting observability data from these tools into the Dynatrace platform, all while retaining your investment and increasing the value you get from Dynatrace. Open-source metric sources automatically map to our Smartscape model for AI analytics.

Open Source 247

Open Source Metrics Analytics Tuning 247