article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much.

article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Why applying chaos engineering to data-intensive applications matters

Dynatrace

Stream processing One approach to such a challenging scenario is stream processing, a computing paradigm and software architectural style for data-intensive software systems that emerged to cope with requirements for near real-time processing of massive amounts of data.

article thumbnail

Up your quality and agility factor – using automation to build “performance-as-a-self-service”

Dynatrace

For software engineering teams, this demand means not only delivering new features faster but ensuring quality, performance, and scalability too. This involves new software delivery models, adapting to complex software architectures, and embracing automation for analysis and testing. Try it today using Keptn .

article thumbnail

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

The Netflix TechBlog

By Chris Wolfe , Joey Schorr , and Victor Roldán Betancort Introduction The authorization team at Netflix recently sponsored work to add Attribute Based Access Control (ABAC) support to AuthZed’s open source Google Zanzibar inspired authorization system, SpiceDB.

Cache 249
article thumbnail

MLOps and DevOps: Why Data Makes It Different

O'Reilly

Cloud-based data warehouses, such as Snowflake , AWS’ portfolio of databases like RDS, Redshift or Aurora , or an S3-based data lake , are a great match to ML use cases since they tend to be much more scalable than traditional databases, both in terms of the data set sizes as well as query patterns. Software Architecture.

DevOps 137
article thumbnail

How architecture evolves into strategy

O'Reilly Software

It's a given that we must design a system, including a local software architecture, that actually runs, that is "solid." The ones I focus on most are scalability, availability, maintainability, manageability, monitorability, extensibility, interoperability, portability, security, and performance. Solid doesn't mean inflexible.

Strategy 100