Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

Open-sourcing Polynote: an IDE-inspired polyglot notebook

The Netflix TechBlog

Jeremy Smith , Jonathan Indig , Faisal Siddiqi We are pleased to announce the open-source launch of Polynote : a new, polyglot notebook with first-class Scala support, Apache Spark integration, multi-language interoperability including Scala, Python, and SQL, as-you-type autocomplete, and more.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

machine-learning data-science python open-source productivityby David Berg, Ravi Kiran Chirravuri, Romain Cledat, Savin Goyal, Ferras Hamad, Ville Tuulos Continue reading on Netflix TechBlog ».

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

High Scalability

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Or, considering adding a new database to your application and want to see which combinations are most popular?

Introducing SVT-AV1: a scalable open-source AV1 framework

The Netflix TechBlog

Scalable Video Technology (SVT) is Intel’s open source framework that provides high-performance software video encoding libraries for developers of visual cloud technologies. There exists at least one other alternative open-source AV1 encoder, rav1e.

Open Source Database HA Resources from Severalnines

High Scalability

Severalnines has spent the last several years writing blogs and crafting content to help make your open source database solutions highly available.

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

The Netflix TechBlog

Raven which allows users to perform ad-hoc exploration of realtime data from hundreds of streaming sources using our Mantis Query Language (MQL).

Open Sourcing Peloton, Uber’s Unified Resource Scheduler

Uber Engineering

… The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog. Architecture Open Source Active-Active Architecture Compute Compute Cluster Compute Platform Kubernetes Mesos OSS Peloton Resource Scheduling scalability Uber Engineering Uber Open Source

Open Source at AWS re:Invent

Adrian Cockcroft

We’re excited to let you know that we have an Open Source track at re:Invent this year! OPN220 Build robotic cloud simulations with ROS and AWS RoboMaker Join Camilo Buscaron, AWS Principal Open Source Technologist, and Katherine Scott, Developer Advocate, Open Robotics in this workshop to use Gazebo, a 3D simulator, and Robot Operating System (ROS) on AWS RoboMaker and learn how to spin up robotic simulations. aws open-source cloud-computing reinvent

11 top open-source test automation frameworks: How to choose

TechBeacon Testing

In most cases, you'd do better to consider one or more of the open-source options available. If you're thinking about building your own test automation framework, think again. App Dev & Testing, Testing, Test Automation

Open Sourcing Mantis: A Platform For Building Cost-Effective, Realtime, Operations-Focused…

The Netflix TechBlog

Raven which allows users to perform ad-hoc exploration of realtime data from hundreds of streaming sources using our Mantis Query Language (MQL).

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems

The Morning Paper

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The most prominent source of misses, especially in the kernel, was Thrift.

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

Scalegrid

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? We found all the answers you need at the Percona Live event last month, and broke down the insights into the following free trends reports: Top Databases Used : Open Source vs. Commercial. We broke down the data by open source databases vs. commercial databases: Open Source Databases. Top Open Source Databases.

11 top open-source API testing tools: What your team needs to know

TechBeacon Testing

How do you find the right open-source API testing tool for your needs? Since my last roundup of the best candidates, a few more tools have appeared that warrant consideration—and there's a new technique that's all the buzz in AI automation circles that you need to know about.

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering

Uber facilitates seamless and more enjoyable user experiences by channeling data from a variety of real-time sources. These insights range from in-the-moment traffic conditions that provide guidance on trip routes to the Estimated Time of Delivery (ETD) of an UberEATS … The post Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform appeared first on Uber Engineering Blog.

M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus

Uber Engineering

As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog. Architecture Open Source Grafana Infrastructure M3 M3 Coordinator M3DB Metrics Platform OSS Prometheus Uber Infrastructure

JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale

Uber Engineering

To help us better leverage this data, we manage massive deployments of Spark … The post JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale appeared first on Uber Engineering Blog. Architecture Open Source JVM Profiler ProfilerComputing frameworks like Apache Spark have been widely adopted to build large-scale data applications. For Uber, data is at the heart of strategic decision-making and product development.

10 open-source Kubernetes tools for highly effective SRE and Ops Teams

Abhishek Tiwari

Here we present a list of 10 open-source Kubernetes tools to make your SRE and Ops teams more effective to achieve their service level objectives.

Shift-Left Testing in the Enterprise and the Case for Open Source

Abstracta

Why continuous testing and open source are a perfect match I recently visited the offices of CA Technologies (one of Abstracta’s partners) in Santa Clara, where I had the chance to discuss shift-left testing, continuous testing, and why and how to turn to open source.

Which Is the Best PostgreSQL GUI? 2019 Comparison

Scalegrid

PostgreSQL graphical user interface (GUI) tools help these open source database users to manage, manipulate, and visualize their data. It supports all PostgreSQL operations and features while being free and open-source. pgAdmin Cost: Free (open source).

Predictable Pitfalls of Scaling VoIP to Cluster

DZone

This is not to say, however, that any mid-level developer will have much difficulty finding and handling one of many available open-source servers. Avoid these pitfalls of scaling VoIP to cluster. VoIP technologies have a reputation for being rather complex and not without good reason.

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

High Scalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today?

How to Run Video Streaming Performance Tests With the HLS Plugin for JMeter

DZone

Using open-source tools to stress test video streaming at scale. open source performance load testing jmeter streaming stress testing hls live streaming tableau online tutorialFind out how to run video streaming performance tests!

ScyllaDB Trends – How Users Deploy The Real-Time Big Data Database

Scalegrid

ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. You can run both the free open source ScyllaDB and ScyllaDB Enterprise in the cloud or on-premise, and ScyllaDB Enterprise license starts at $28.8k/year for a total of 48 cores. This number is more inline with our recent 2019 Open Source Database Trends Report where 56.9%

ScaleGrid DBaaS Expands MySQL Hosting Services Through AWS Cloud

Scalegrid

Over the years, migrating data to the cloud has become a top priority for organizations looking to modernize their infrastructure for improved security, performance, and agility, closely followed by the trending shift from commercial database management systems to open source databases.

Cloud 168

Spinnaker Sets Sail to the Continuous Delivery Foundation

The Netflix TechBlog

Author: Andy Glover Since releasing Spinnaker to the open source community in 2015 , the platform has flourished with the addition of new cloud providers, triggers, pipeline stages, and much more. spinnaker continuous-delivery cloud-computing open-source

Managing High Availability in PostgreSQL – Part III: Patroni

Scalegrid

It is an open-source tool suite, written in Python, for managing high availability of PostgreSQL clusters. Requires multiple ports to be open for components communication: REST API port for Patroni. In our previous blog posts, we discussed the capabilities and functioning of PostgreSQL Automatic Failover (PAF) by Cluster Labs and Replication Manager (repmgr) by 2ndQuadrant.

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

Scalegrid

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. While commercial still remains on top, open source is trending towards a majority within the next 12 to 18 months.

Regression Testing: Tools and Techniques

DZone

performance software testing tools automated regression testing tools regression test automation automated regression tests regression testing tools open source

Squashed Bugs, Served Hot and Fresh With Failure Rate Heatmaps

DZone

open source database devops performance programming golang hackathon qa and testing softwaretesting code bugsLearn how to squash bugs! To err is human; to introduce bugs is to be a developer, and to debug is part of everyday life.

Making it Easier to Manage a Production PostgreSQL Database

Scalegrid

There are many things I love about it – PL/ PG SQL, smart defaults, replication (that actually works out of the box), and an active and vibrant open source community. Hopefully we can generate enough interest in the open source community to prioritize these features. The past several years have seen increasing adoption for PostgreSQL. PostgreSQL is an amazing relational database. Feature-wise, it is up there with the best, if not the best.

PostgreSQL Trends: Most Popular Cloud Providers, Languages, VACUUM, Query Management Strategies & Deployment Types in Enterprise

Scalegrid

As this open source database continues to pull new users from expensive commercial database management systems like Oracle, DB2 and SQL Server, organizations are adopting new approaches and evolving their own to maintain the exceptional performance of their SQL deployments. PostgreSQL can be easily connected with Java programs through the popular open source PostgreSQL Java Database Connectivity (JBDC) Driver, also known as PgJDBC.

Cloud 128

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

Scalegrid

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure.

AWS 130

How to Monitor MySQL Deployments with Prometheus & Grafana at ScaleGrid

Scalegrid

Prometheus is an open-source software application used for event monitoring and alerting. Configure a Firewall to Open Port 9090. Grafana uses Prometheus as a data source, allowing you to create dashboards to better visualize and understand your metrics. To run Grafana, open your browser and go to *[link] 3000 is the http port that Grafana listens to, by default. Adding a Data Source.

Re-Architecting the Video Gatekeeper

The Netflix TechBlog

and can achieve orders of magnitude more efficient data access, which opens up many possibilities. During that cycle , the producer iterates over all records from the source of truth. caching software-architecture programming open-source software-engineering

Top Redis Use Cases by Core Data Structure Types

Scalegrid

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. RSS Feeds: Create news feeds from custom sources where you can pull the latest updates and allow interested followers to subscribe to your RSS feed.

The Best Way to Host MySQL on Azure Cloud

Scalegrid

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? So many default to Amazon RDS, when MySQL performs exceptionally well on Azure Cloud. While Microsoft Azure does offer a managed solution, Azure Database, the solution has some major limitations you should know about before migrating your MySQL deployments.

Azure 150

Best Practices In Appium

DZone

selenium appium mobile application testing open source test tools appium testng android testingMany times, in Appium we face uncertain issues with the AVD Manager, ADB, Emulators, uiautomatorviewer and with MobileWebScript execution. Common Reasons for Errors. Configuration Errors.

Intro to Redis Cluster Sharding – Advantages, Limitations, Deploying & Client Connections

High Scalability

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

ScaleGrid Fully Managed Hosting for Redis™ Now Available on Azure

Scalegrid

This management solution for Redis™ allows startups up to enterprise-level organizations automate their Redis™ operations on Microsoft Azure dedicated cloud servers, alongside their other open source database deployments, including MongoDB , MySQL and PostgreSQL. According to the 2019 Open Source Database Report , a majority of Redis™ deployments are used in conjunction with MySQL, and over half of Redis™ deployments are used with either PostgreSQL, MongoDB, and Elasticsearch.

Azure 100

How To Connect To Your MongoDB Deployments Using Robo 3T GUI

Scalegrid

This open source tool has cross-platform support and actually embeds the mongo shell within its interface to provide both shell and GUI-based interaction. Launch Robo 3T and open the ‘Manage Connections’ window: Click on ‘Create’ to setup a new connection.

MySQL High Availability Framework Explained – Part III: Failover Scenarios

High Scalability

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II.

New Dedicated Application Server Revs PHP to Peak Performance

DZone

php performance website performance load balancer performance and scalability open source software golang development services php application development golang app development golang development toolsHow does this Peak Perform?

Java 130