Remove Design Remove Exercise Remove Scalability Remove Software Architecture
article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both The steps can be arbitrary Python code.

article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both The steps can be arbitrary Python code.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

MLOps and DevOps: Why Data Makes It Different

O'Reilly

Let’s start by considering the job of a non-ML software engineer: writing traditional software deals with well-defined, narrowly-scoped inputs, which the engineer can exhaustively and cleanly model in the code. In effect, the engineer designs and builds the world wherein the software operates. Software Architecture.

DevOps 138
article thumbnail

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

Werner Vogels weblog on building scalable and robust distributed systems. These trade-offs have even impacted the way the lowest level building blocks in our computer architectures have been designed. Configuring kernel execution is not a trivial exercise and requires GPU device specific knowledge. All Things Distributed.

AWS 136