article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

Future blogs will provide deeper dives into each service, sharing insights and lessons learned from this process. The Netflix video processing pipeline went live with the launch of our streaming service in 2007. The Netflix video processing pipeline went live with the launch of our streaming service in 2007.

article thumbnail

Incremental Processing using Netflix Maestro and Apache Iceberg

The Netflix TechBlog

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Heap Memory In Java Applications Performance Testing

DZone

To completely fine-tune the java performance bottlenecks for high performance my answer is YES. Java memory management is a significant challenge for every performance engineer and Java developer, and a skill that needs to be acquired to have Java applications properly tuned.

Java 305
article thumbnail

Sequential A/B Testing Keeps the World Streaming Netflix Part 1: Continuous Data

The Netflix TechBlog

These observations are from a particular type of A/B test that Netflix runs called a software canary or regression-driven experiment. An example data stream for an A/B test where each observation represents play-delay for the control (left) and treatment (right). Such changes should not be ignored by our testing procedure.

Testing 239
article thumbnail

An approach to index tuning – Part 2

SQL Performance

In my last post , I started to outline the process I go through when tuning queries – specifically when I discover that I need to add a new index, or modify an existing one. Once we have that data, we can move on to the next steps in the process. Once we have that data, we can move on to the next steps in the process.

Tuning 137
article thumbnail

Application Performance Review Process

DZone

Application performance Review (also known as Application Performance Walkthrough or Application Performance Assessment) is the process of review of an existing application (in production) to evaluate its performance and scalability attributes. You may also like: Seven Testing Sins and How To Avoid Them. Performance and Scalability.

article thumbnail

PostgreSQL Performance Tuning: Optimizing Database Parameters for Maximum Efficiency

Percona

Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. It is primarily the responsibility of the database administrator or developer to tune PostgreSQL according to their system’s workload. What is PostgreSQL performance tuning? Why is PostgreSQL performance tuning important?

Tuning 52