Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

SVT-AV1: an open-source AV1 encoder and decoder

The Netflix TechBlog

SVT-AV1: open-source AV1 encoder and decoder by Andrey Norkin , Joel Sole , Mariana Afonso , Kyle Swanson, Agata Opalach , Anush Moorthy , Anne Aaron SVT-AV1 is an open-source AV1 codec implementation hosted on GitHub [link] under a BSD + patent license.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Open-sourcing Polynote: an IDE-inspired polyglot notebook

The Netflix TechBlog

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more.

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

machine-learning data-science python open-source productivityby David Berg, Ravi Kiran Chirravuri, Romain Cledat, Savin Goyal, Ferras Hamad, Ville Tuulos Continue reading on Netflix TechBlog ».

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

High Scalability

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Or, considering adding a new database to your application and want to see which combinations are most popular?

Introducing SVT-AV1: a scalable open-source AV1 framework

The Netflix TechBlog

Scalable Video Technology (SVT) is Intel’s open source framework that provides high-performance software video encoding libraries for developers of visual cloud technologies. There exists at least one other alternative open-source AV1 encoder, rav1e.

Open Source Database HA Resources from Severalnines

High Scalability

Severalnines has spent the last several years writing blogs and crafting content to help make your open source database solutions highly available.

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

The Netflix TechBlog

Raven which allows users to perform ad-hoc exploration of realtime data from hundreds of streaming sources using our Mantis Query Language (MQL).

Open-sourcing Polynote: an IDE-inspired polyglot notebook

The Netflix TechBlog

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more.

Open-sourcing Polynote: an IDE-inspired polyglot notebook

The Netflix TechBlog

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more.

Open Sourcing Peloton, Uber’s Unified Resource Scheduler

Uber Engineering

… The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog. Architecture Open Source Active-Active Architecture Compute Compute Cluster Compute Platform Kubernetes Mesos OSS Peloton Resource Scheduling scalability Uber Engineering Uber Open Source

11 top open-source test automation frameworks: How to choose

TechBeacon Testing

In most cases, you'd do better to consider one or more of the open-source options available. If you're thinking about building your own test automation framework, think again. App Dev & Testing, Testing, Test Automation

Open Source at AWS re:Invent

Adrian Cockcroft

We’re excited to let you know that we have an Open Source track at re:Invent this year! OPN220 Build robotic cloud simulations with ROS and AWS RoboMaker Join Camilo Buscaron, AWS Principal Open Source Technologist, and Katherine Scott, Developer Advocate, Open Robotics in this workshop to use Gazebo, a 3D simulator, and Robot Operating System (ROS) on AWS RoboMaker and learn how to spin up robotic simulations. aws open-source cloud-computing reinvent

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

The Netflix TechBlog

Raven which allows users to perform ad-hoc exploration of realtime data from hundreds of streaming sources using our Mantis Query Language (MQL).

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

The Netflix TechBlog

Raven which allows users to perform ad-hoc exploration of realtime data from hundreds of streaming sources using our Mantis Query Language (MQL).

Web performance testing: 18 free open-source tools to consider

TechBeacon Testing

The failure of a mission-critical web application can be costly. App Dev & Testing, Testing, Performance Testing, Web Performance

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

Scalegrid

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? We found all the answers you need at the Percona Live event last month, and broke down the insights into the following free trends reports: Top Databases Used : Open Source vs. Commercial. We broke down the data by open source databases vs. commercial databases: Open Source Databases. Top Open Source Databases.

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems

The Morning Paper

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The most prominent source of misses, especially in the kernel, was Thrift.

11 top open-source API testing tools: What your team needs to know

TechBeacon Testing

How do you find the right open-source API testing tool for your needs? Since my last roundup of the best candidates, a few more tools have appeared that warrant consideration—and there's a new technique that's all the buzz in AI automation circles that you need to know about.

M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus

Uber Engineering

As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog. Architecture Open Source Grafana Infrastructure M3 M3 Coordinator M3DB Metrics Platform OSS Prometheus Uber Infrastructure

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering

Uber facilitates seamless and more enjoyable user experiences by channeling data from a variety of real-time sources. These insights range from in-the-moment traffic conditions that provide guidance on trip routes to the Estimated Time of Delivery (ETD) of an UberEATS … The post Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform appeared first on Uber Engineering Blog.

JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale

Uber Engineering

To help us better leverage this data, we manage massive deployments of Spark … The post JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale appeared first on Uber Engineering Blog. Architecture Open Source JVM Profiler ProfilerComputing frameworks like Apache Spark have been widely adopted to build large-scale data applications. For Uber, data is at the heart of strategic decision-making and product development.

10 open-source Kubernetes tools for highly effective SRE and Ops Teams

Abhishek Tiwari

Here we present a list of 10 open-source Kubernetes tools to make your SRE and Ops teams more effective to achieve their service level objectives.

Shift-Left Testing in the Enterprise and the Case for Open Source

Abstracta

Why continuous testing and open source are a perfect match I recently visited the offices of CA Technologies (one of Abstracta’s partners) in Santa Clara, where I had the chance to discuss shift-left testing, continuous testing, and why and how to turn to open source.

Which Is the Best PostgreSQL GUI? 2019 Comparison

Scalegrid

PostgreSQL graphical user interface (GUI) tools help these open source database users to manage, manipulate, and visualize their data. It supports all PostgreSQL operations and features while being free and open-source. pgAdmin Cost: Free (open source).

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

High Scalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today?

Run Your First Chaos Experiment in 10 Minutes

DZone

Chaos Mesh is an easy-to-use , open-source, cloud-native Chaos Engineering platform that orchestrates chaos in Kubernetes environments. open source tutorial performance howto distributed system chaos engineering getstarted

Introduction to Benchmarking in Julia

DZone

open source benchmarking juliaFor the number of years I’ve been programming using Julia, I’ve never really been concerned with performance.

Predictable Pitfalls of Scaling VoIP to Cluster

DZone

This is not to say, however, that any mid-level developer will have much difficulty finding and handling one of many available open-source servers. Avoid these pitfalls of scaling VoIP to cluster. VoIP technologies have a reputation for being rather complex and not without good reason.

ScaleGrid DBaaS Expands MySQL Hosting Services Through AWS Cloud

Scalegrid

Over the years, migrating data to the cloud has become a top priority for organizations looking to modernize their infrastructure for improved security, performance, and agility, closely followed by the trending shift from commercial database management systems to open source databases.

Cloud 180

ScyllaDB Trends – How Users Deploy The Real-Time Big Data Database

Scalegrid

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. You can run both the free open source ScyllaDB and ScyllaDB Enterprise in the cloud or on-premise, and ScyllaDB Enterprise license starts at $28.8k/year for a total of 48 cores. This number is more inline with our recent 2019 Open Source Database Trends Report where 56.9%

How to Run Video Streaming Performance Tests With the HLS Plugin for JMeter

DZone

Using open-source tools to stress test video streaming at scale. open source performance load testing jmeter streaming stress testing hls live streaming tableau online tutorialFind out how to run video streaming performance tests!

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

Scalegrid

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. While commercial still remains on top, open source is trending towards a majority within the next 12 to 18 months.

Managing High Availability in PostgreSQL – Part III: Patroni

Scalegrid

It is an open-source tool suite, written in Python, for managing high availability of PostgreSQL clusters. Requires multiple ports to be open for components communication: REST API port for Patroni. In our previous blog posts, we discussed the capabilities and functioning of PostgreSQL Automatic Failover (PAF) by Cluster Labs and Replication Manager (repmgr) by 2ndQuadrant.

Spinnaker Sets Sail to the Continuous Delivery Foundation

The Netflix TechBlog

Author: Andy Glover Since releasing Spinnaker to the open source community in 2015 , the platform has flourished with the addition of new cloud providers, triggers, pipeline stages, and much more. spinnaker continuous-delivery cloud-computing open-source

Regression Testing: Tools and Techniques

DZone

performance software testing tools automated regression testing tools regression test automation automated regression tests regression testing tools open source

Making it Easier to Manage a Production PostgreSQL Database

Scalegrid

There are many things I love about it – PL/ PG SQL, smart defaults, replication (that actually works out of the box), and an active and vibrant open source community. Hopefully we can generate enough interest in the open source community to prioritize these features. The past several years have seen increasing adoption for PostgreSQL. PostgreSQL is an amazing relational database. Feature-wise, it is up there with the best, if not the best.

PostgreSQL Trends: Most Popular Cloud Providers, Languages, VACUUM, Query Management Strategies & Deployment Types in Enterprise

Scalegrid

As this open source database continues to pull new users from expensive commercial database management systems like Oracle, DB2 and SQL Server, organizations are adopting new approaches and evolving their own to maintain the exceptional performance of their SQL deployments. PostgreSQL can be easily connected with Java programs through the popular open source PostgreSQL Java Database Connectivity (JBDC) Driver, also known as PgJDBC.

Cloud 141

Schemathesis: Property-Based Testing for API Schemas

DZone

These new microservices use Open API schemas to declare their contracts and be explicit in their expectations. open source python performance property based testing openapi spec hypothesis testing schemathesis

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

Scalegrid

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 144

The Best Way to Host MySQL on Azure Cloud

Scalegrid

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? So many default to Amazon RDS, when MySQL performs exceptionally well on Azure Cloud. While Microsoft Azure does offer a managed solution, Azure Database, the solution has some major limitations you should know about before migrating your MySQL deployments.

Azure 163

Top Redis Use Cases by Core Data Structure Types

Scalegrid

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. RSS Feeds: Create news feeds from custom sources where you can pull the latest updates and allow interested followers to subscribe to your RSS feed.