article thumbnail

Auto-Diagnosis and Remediation in Netflix Data Platform

The Netflix TechBlog

By Vikram Srivastava and Marcelo Mayworm Netflix has one of the most complex data platforms in the cloud on which our data scientists and engineers run batch and streaming workloads. And we can’t discount the productivity impact it causes on data platform users.

Big Data 238
article thumbnail

Moving HPC to the Cloud: A Guide for 2020

High Scalability

This is a guest post by Limor Maayan-Wainstein , a senior technical writer with 10 years of experience writing about cybersecurity, big data, cloud computing, web development, and more. When coupled with the cloud, HPC is made more affordable, accessible, efficient and shareable. What Is HPC?

Cloud 261
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Kubernetes for Big Data Workloads

Abhishek Tiwari

Kubernetes has emerged as go to container orchestration platform for data engineering teams. In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. Organisations are already using Kubernetes for a variety of workloads [1] [2] and data workloads are up next. Key challenges. Performance.

article thumbnail

RSA Guide 2023: Cloud application security remains core challenge for organizations

Dynatrace

Today’s organizations face increasing pressure to keep their cloud-based applications performing and secure. Cloud application security remains challenging because organizations lack end-to-end visibility into cloud architecture. As organizations develop new applications, vulnerabilities will continue to emerge.

Cloud 180
article thumbnail

Scaling for Success: Why Scalability Is the Forefront of Modern Applications

DZone

In short, it is the ability to handle more data, more users, and more demand without sacrificing performance, reliability, or security. The reason is straightforward, today, applications generate enormous amounts of data. It is not uncommon to question why scalability has grabbed the attention of the masses these days.

article thumbnail

What is software automation? Optimize the software lifecycle with intelligent automation

Dynatrace

Software automation is the practice of creating software applications to reduce or eliminate human intervention in repetitive, time-consuming IT tasks and cloud operations. This involves big data analytics and applying advanced AI and machine learning techniques, such as causal AI. What is software automation?

Software 180
article thumbnail

Snowflake Workload Optimization

DZone

In the era of big data, efficient data management and query performance are critical for organizations that want to get the best operational performance from their data investments.

Big Data 130