The Netflix TechBlog
MAY 26, 2020
Without having network visibility, it’s not possible to improve our reliability, security and capacity posture. Network Availability: The expected continued growth of our ecosystem makes it difficult to understand our network bottlenecks and potential limits we may be reaching. 43416 5001 52.213.180.42
Abhishek Tiwari
DECEMBER 27, 2017
Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. Key challenges.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
The Netflix TechBlog
DECEMBER 21, 2020
Some of the optimizations are prerequisites for a high-performance data warehouse. Sometimes Data Engineers write downstream ETLs on ingested data to optimize the data/metadata layouts to make other ETL processes cheaper and faster. AutoOptimize reduces end to end lag in data processing by optimizing as we go.
The Netflix TechBlog
SEPTEMBER 18, 2020
I bring my breadth of big data tools and technologies while Julie has been building statistical models for the past decade. How does a decision of this scale affect the efficiency of our globally distributed content delivery network, Open Connect ? Is the benefit uniform, or do certain cohorts of members?—?such benefit more?
Abhishek Tiwari
DECEMBER 27, 2017
In 2018, we will see new data integration patterns those rely either on a shared high-performance distributed storage interface ( Alluxio ) or a common data format ( Apache Arrow ) sitting between compute and storage. For instance, Alluxio, originally known as Tachyon, can potentially use Arrow as its in-memory data structure.
Expert insights. Personalized for you.
150 
Let's personalize your content