article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. For more details, read this page about Metaflow’s integration with AWS. Metaflow removes this cognitive overhead.

article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. For more details, read this page about Metaflow’s integration with AWS. Metaflow removes this cognitive overhead.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

MLOps and DevOps: Why Data Makes It Different

O'Reilly

but to reference concrete tooling used today in order to ground what could otherwise be a somewhat abstract exercise. Today, a number of cloud-based, auto-scaling systems are easily available, such as AWS Batch. Software Development Layers. Software Architecture. Foundational Infrastructure Layers.

DevOps 138
article thumbnail

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. Modern CPUs strongly favor lower latency of operations with clock cycles in the nanoseconds and we have built general purpose software architectures that can exploit these low latencies very well.Â

AWS 136