article thumbnail

MezzFS?—?Mounting object storage in Netflix’s media processing platform

The Netflix TechBlog

Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Our object storage service splits objects into many parts and stores them in S3.

Media 214
article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both both for compute and storage. The steps can be arbitrary Python code.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Carving an AWS certification path

Dynatrace

Hosted and moderated by Amazon, AWS GameDay is a hands-on, collaborative, gamified learning exercise for applying AWS services and cloud skills to real-world scenarios. As an AWS Advanced Technology Partner , this was a great opportunity for Dynatrace developers to sharpen their AWS skills and pursue or up-level their Amazon certifications.

AWS 215
article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much. It leverages elasticity of the cloud by design?—?both both for compute and storage. The steps can be arbitrary Python code.

article thumbnail

How to Assess MySQL Performance

HammerDB

Instead, focus on understanding what the workloads exercise to help us determine how to best use them to aid our performance assessment. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. Operating System: Ubuntu 22.04

article thumbnail

A Decade of Dynamo: Powering the next wave of high-performance, internet-scale applications

All Things Distributed

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128
article thumbnail

A persistent problem: managing pointers in NVM

The Morning Paper

Byte-addressable non-volatile memory,) NVM will fundamentally change the way hardware interacts, the way operating systems are designed, and the way applications operate on data. This is left as an exercise for the application developer at present. In particular, it’s goodbye to the POSIX interface. What about security?