article thumbnail

Open-Sourcing a Monitoring GUI for Metaflow

The Netflix TechBlog

Open-Sourcing a Monitoring GUI for Metaflow, Netflix’s ML Platform tl;dr Today, we are open-sourcing a long-awaited GUI for Metaflow. link] Metaflow is a full-stack framework for data science that we started developing at Netflix over four years ago and which we open-sourced in 2019.

article thumbnail

LinkedIn's Open-Source "iris-message-processor" Achieves 86.6x Faster Escalation Management Speeds

InfoQ

LinkedIn developed a new open-source service called "iris-message-processor" to enhance the performance and reliability of its existing Iris escalation management system. iris-message-processor" significantly improves processing speeds, being ~4.6x faster under average loads and ~86.6x By Eran Stiller

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Pinterest Open-Sources a Production-Ready PubSub Java Client for Kafka, Flink, and MemQ

InfoQ

Pinterest open-sourced its generic PubSub client library, PSC, which has been heavily used in production for a year and a half. The library helped the engineering teams by increasing developer velocity, and the scalability and stability of services using it. Over 90% of Java applications have migrated to PSC with minimal changes.

article thumbnail

Announcing bpftop: Streamlining eBPF performance optimization

The Netflix TechBlog

By Jose Fernandez Today, we are thrilled to announce the release of bpftop , a command-line tool designed to streamline the performance optimization and monitoring of eBPF applications. This tool minimizes overhead by enabling performance statistics only while it is active.

article thumbnail

Turbocharge Your Apache Spark Jobs for Unmatched Performance

DZone

This article delves into various techniques that can be employed to optimize your Apache Spark jobs for maximum performance. Understanding Apache Spark Apache Spark is a unified computing engine designed for large-scale data processing.

Big Data 130
article thumbnail

Why applying chaos engineering to data-intensive applications matters

Dynatrace

This high level of abstraction is provided by industry-grade, open source stream processing frameworks such as Kafka Streams , Apache Flink , and Spark Structured Streaming. Performance is usually a primary concern when using stream processing frameworks. We designed experimental scenarios inspired by chaos engineering.

article thumbnail

JMeter + Pepper-Box Plugin for Kafka Performance Testing to Choose or Not to Choose?

DZone

How to start Kafka performance testing with JMeter + Pepper-Box plugin ? Is it possible to write samplers for JMeter on your own to provide Kafka performance testing? Kafka is an open-source stream ing software platform developed by the Apache Software Foundation, written in Scala and Java. Pros and cons. Conclusion.