article thumbnail

Data Engineers of Netflix?—?Interview with Pallavi Phadnis

The Netflix TechBlog

Netflix’s unique work culture and petabyte-scale data problems are what drew me to Netflix. During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. Moreover, its petabyte scale also brings unique engineering challenges.

article thumbnail

What is container orchestration?

Dynatrace

Within every industry, organizations are accelerating efforts to modernize IT capabilities that increase agility, reduce complexity, and foster innovation. Apache Mesos with the Marathon DC/OS is popular for large-scale production clusters running existing workloads on big data systems, such as Hadoop, Kafka, and Spark.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

What is a Distributed Storage System

Scalegrid

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130
article thumbnail

Expanding the AWS Cloud: Introducing the AWS Canada (Central) Region

All Things Distributed

Canada has set forth a bold innovation agenda grounded in entrepreneurship, scientific research, growing small and medium-sized businesses with a focus on environmentally friendly technologies, and the transition to a digital economy. in the coming year. The Canadian opportunity. Rapid time to market. as part of its Box Zones ecosystem.

AWS 155
article thumbnail

Expanding the Cloud: Introducing the AWS Asia Pacific (Mumbai) Region

All Things Distributed

Market innovators and change agents need a comprehensive infrastructure platform that can reliably scale on-demand. AdiMap uses Amazon Kinesis to process real-time streaming online ad data and job feeds, and processes them for storage in petabyte-scale Amazon Redshift. Let’s build groundbreaking innovations together.

AWS 90
article thumbnail

Data lakehouse innovations advance the three pillars of observability for more collaborative analytics

Dynatrace

As teams try to gain insight into this data deluge, they have to balance the need for speed, data fidelity, and scale with capacity constraints and cost. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics 188
article thumbnail

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

Often we think about innovation as going after new unchartered territories, but it is also important to innovate in those existing dimensions that will remain important for customers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics.

AWS 106