The Netflix TechBlog

MARCH 10, 2023

By Meenakshi Jindal Overview At Netflix, we built the asset management platform (AMP) as a centralized service to organize, store and discover the digital media assets created during the movie production. Apache Kafka topic is configured as a message broker. Some of the common supported data reprocessing use cases are listed below.

Media 237

Media Traffic Processing Design 237

Particular Software

JULY 18, 2022

So you don’t just get the next message waiting to be processed. So now we know more about Kafka, but the big question remains, is it a message queue? ?? What are message queues? A message queue or message broker is a highly-optimized database for processing messages.

Transportation 98

Transportation Azure Processing Systems 98

Dynatrace

APRIL 5, 2021

Similar to AWS Lambda , Azure Functions is a serverless compute service by Microsoft that can run code in response to predetermined events or conditions (triggers), such as an order arriving on an IoT system, or a specific queue receiving a new message. It automatically manages all the computing resources those processes require.

Azure 137

Azure Serverless IoT Lambda 137

Dynatrace

APRIL 15, 2019

IBM MQ enables you to connect your monitored applications and services by enabling a secure and reliable message delivery platform. As the importance of enterprise messaging technologies continues to grow, Dynatrace continues to deliver significant new capabilities related to IBM MQ monitoring. Dynatrace news.

Monitoring 103

Monitoring Metrics Technology Technology 103

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 226

Systems Media Cache Open Source 226

Dynatrace

MARCH 17, 2021

The Dynatrace Software Intelligence Platform analyzes data in an automated and scalable manner. A single OneAgent instance can handle the monitoring of many types of entities, including servers, applications, services, databases, and more. For example, what if: Your IBM MQ queue manager is losing messages, and you don’t know why?

Metrics 169

Metrics Monitoring Network Technology 169

Dynatrace

JULY 21, 2020

Although these COBOL applications operate with consistent performance, companies and governments are forced to transform them to new platforms and rewrite them in modern programming languages (like Java) for several reasons. JMS messaging. Transform your mainframe applications into state-of-the-art business services with Dynatrace.

Java 179

Java Government Database Programming 179

Particular Software

AUGUST 18, 2020

You can use a simple but powerful API to consume and dispatch messages, add robust reliability features like delayed retries, an extensible message processing pipeline, and a suite of tools to help you monitor and maintain your message-driven system. NServiceBus makes Azure Functions even better.

Azure 52

Azure Serverless Programming Transportation 52

Particular Software

NOVEMBER 23, 2020

ServicePulse keeps on growing its arsenal of monitoring tools to help you uncover problems in your system and help fix them. we decided to focus on the monitoring views of ServicePulse and make it easier to slice and dice information. We’ve also made some changes to message archiving. In ServicePulse 1.27 Summary ServicePulse 1.27

Monitoring 52

Monitoring Metrics Website Systems 52

ScaleOut Software

JULY 14, 2021

Acting as a switchboard for incoming and outgoing messages, Azure IoT Hub forms the core of these capabilities. It provides support for a range of message protocols, buffering, and scalable message distribution to downstream services. This makes developing streaming analytics code for real-time digital twins fast and easy.

IoT 52

IoT Azure Analytics Serverless 52

All Things Distributed

NOVEMBER 8, 2012

The Amazon Simple Queue Service (SQS) is a highly scalable, reliable and elastic queuing service that just works. For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. Comments ().

Efficiency 104

Efficiency Cloud Games Scalability 104

Particular Software

JULY 18, 2017

Beyond the checklist For a simple little website, that was all the monitoring I needed. But over time, the complexity of the systems that I've deployed and monitored has increased. For some processes (in platform-as-a-service environments), you may not even care about the machine they run on.

Systems 56

Systems Monitoring Website Virtualization 56

Dotcom-Montior

APRIL 23, 2021

While you have limited control over user interaction with your emails, monitoring email infrastructure is in your hands. And to make sure your email infrastructure is in perfect working order, you need to constantly monitor it. A mail transfer agent, or message transfer agent, is a program on a mail server that manages communications.

Infrastructure 98

Infrastructure Monitoring Servers Network 98

Particular Software

MAY 1, 2018

We wrapped up with the importance of system monitoring, and what's next for NServiceBus. If you don't have time to listen to all 48 minutes, here are some timestamps to help you home in on the bits you're most interested in: 05:35 - How do you make sure messages are not lost? 07:01 - Why do you need queues?

Monitoring 40

Monitoring Software Software Systems 40

The Netflix TechBlog

FEBRUARY 18, 2022

Providing a seamless and consistent Netflix experience across various platforms (iOS, Android, smart TVs, Roku, Amazon FireStick, web browser) and various device types (mobile phones, tablets, televisions, computers, set top boxes) requires more than the traditional request-response model.

Systems 334

Systems Traffic Architecture Mobile 334

The Netflix TechBlog

NOVEMBER 2, 2020

Members will see an error message when they hit play if the request fails. The implementation is analogous to a priority queue with a dynamic priority threshold. Service throttling Zuul can sense when a back-end service is in trouble by monitoring the error rates and concurrent requests to that service.

Traffic 252

Traffic Metrics Infrastructure Architecture 252

The Netflix TechBlog

OCTOBER 18, 2022

The scheduler on-call has to closely monitor the system during non-business hours. Introducing Maestro Maestro is the next generation Data Workflow Orchestration platform to meet the current and future needs of Netflix. All the requests are processed via distributed queues for message passing.

Java 202

Java Scalability Traffic Architecture 202

Smashing Magazine

OCTOBER 19, 2021

He’s director of production operations at digital advertising platform Centro, as well as being a public speaker, sharing his DevOps knowledge with audiences all around the globe. Drew: Are there other ways of identifying what should be automated through sort of monitoring your systems and measuring things? This is the culture.

DevOps 83

DevOps Metrics Systems Design 83

High Scalability

NOVEMBER 25, 2019

Egnyte is a Secure Content Platform built specifically for businesses. Egnyte is a secure Content Collaboration and Data Governance platform, founded in 2007 when Google drive wasn't born and AWS S3 was cost-prohibitive. Egnyte Connect Platform. Cloud Platform. Message Queues. Introduction. Google cloud.

Architecture 52

Architecture Cache Azure Storage 52