2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

High Scalability

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? Wondering whether an on-premise vs. public cloud vs. hybrid cloud infrastructure is best for your database strategy? Or, considering adding a new database to your application and want to see which combinations are most popular?

Open Source Database HA Resources from Severalnines

High Scalability

Severalnines has spent the last several years writing blogs and crafting content to help make your open source database solutions highly available.

Introducing SVT-AV1: a scalable open-source AV1 framework

The Netflix TechBlog

Scalable Video Technology (SVT) is Intel’s open source framework that provides high-performance software video encoding libraries for developers of visual cloud technologies. There exists at least one other alternative open-source AV1 encoder, rav1e.

Open Sourcing Peloton, Uber’s Unified Resource Scheduler

Uber Engineering

… The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog. Architecture Open Source Active-Active Architecture Compute Compute Cluster Compute Platform Kubernetes Mesos OSS Peloton Resource Scheduling scalability Uber Engineering Uber Open Source

2019 Open Source Database Report: Top Databases, Public Cloud vs. On-Premise, Polyglot Persistence

Scalegrid

Ready to transition from a commercial database to open source, and want to know which databases are most popular in 2019? We found all the answers you need at the Percona Live event last month, and broke down the insights into the following free trends reports: Top Databases Used : Open Source vs. Commercial. We broke down the data by open source databases vs. commercial databases: Open Source Databases. Top Open Source Databases.

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems

The Morning Paper

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., The most prominent source of misses, especially in the kernel, was Thrift.

M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus

Uber Engineering

As part of our robust and scalable metrics infrastructure, we built … The post M3: Uber’s Open Source, Large-scale Metrics Platform for Prometheus appeared first on Uber Engineering Blog. Architecture Open Source Grafana Infrastructure M3 M3 Coordinator M3DB Metrics Platform OSS Prometheus Uber Infrastructure

Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform

Uber Engineering

Uber facilitates seamless and more enjoyable user experiences by channeling data from a variety of real-time sources. These insights range from in-the-moment traffic conditions that provide guidance on trip routes to the Estimated Time of Delivery (ETD) of an UberEATS … The post Introducing AthenaX, Uber Engineering’s Open Source Streaming Analytics Platform appeared first on Uber Engineering Blog.

JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale

Uber Engineering

To help us better leverage this data, we manage massive deployments of Spark … The post JVM Profiler: An Open Source Tool for Tracing Distributed JVM Applications at Scale appeared first on Uber Engineering Blog. Architecture Open Source JVM Profiler ProfilerComputing frameworks like Apache Spark have been widely adopted to build large-scale data applications. For Uber, data is at the heart of strategic decision-making and product development.

10 open-source Kubernetes tools for highly effective SRE and Ops Teams

Abhishek Tiwari

Here we present a list of 10 open-source Kubernetes tools to make your SRE and Ops teams more effective to achieve their service level objectives.

Shift-Left Testing in the Enterprise and the Case for Open Source

Abstracta

Why continuous testing and open source are a perfect match I recently visited the offices of CA Technologies (one of Abstracta’s partners) in Santa Clara, where I had the chance to discuss shift-left testing, continuous testing, and why and how to turn to open source.

Managing High Availability in PostgreSQL – Part III: Patroni

Scalegrid

It is an open-source tool suite, written in Python, for managing high availability of PostgreSQL clusters. Requires multiple ports to be open for components communication: REST API port for Patroni. In our previous blog posts, we discussed the capabilities and functioning of PostgreSQL Automatic Failover (PAF) by Cluster Labs and Replication Manager (repmgr) by 2ndQuadrant.

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

High Scalability

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines. So what makes PostgreSQL so special, and how is it being used today?

ScaleGrid DBaaS Expands MySQL Hosting Services Through AWS Cloud

Scalegrid

Over the years, migrating data to the cloud has become a top priority for organizations looking to modernize their infrastructure for improved security, performance, and agility, closely followed by the trending shift from commercial database management systems to open source databases.

Cloud 178

2019 PostgreSQL Trends Report: Private vs. Public Cloud, Migrations, Database Combinations & Top Reasons Used

Scalegrid

PostgreSQL is an open source relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. While commercial still remains on top, open source is trending towards a majority within the next 12 to 18 months.

Top Redis Use Cases by Core Data Structure Types

Scalegrid

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. RSS Feeds: Create news feeds from custom sources where you can pull the latest updates and allow interested followers to subscribe to your RSS feed.

Regression Testing: Tools and Techniques

DZone

performance software testing tools automated regression testing tools regression test automation automated regression tests regression testing tools open source

What is keptn, how it works and how to get started!

Dynatrace

Keptn is an open source enterprise-grade control plane for cloud-native continuous delivery and automated operations.” This ensures that Git always reflects the source of truth. Cloud and microservices automated operations continuous deployment k8s keptn NoOps open sourceDynatrace news. That’s the high-level introduction you will find on www.keptn.sh. But what does this really mean?

Managing High Availability in PostgreSQL – Part III: Patroni

High Scalability

Appliction monitoring Clustering DBA DevOps Failure Analysis Geo-distributed Clusters Patroni Performance PostgreSQL Automatic Failover Postgres Python REST API Replication Manager administrator best platform cloud cluster database database replication deployment developer enterprise architecture framework high availability infrastructure master-slave open source postgresql python sql tutorial

The Best Way to Host MySQL on Azure Cloud

Scalegrid

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? So many default to Amazon RDS, when MySQL performs exceptionally well on Azure Cloud. While Microsoft Azure does offer a managed solution, Azure Database, the solution has some major limitations you should know about before migrating your MySQL deployments.

Azure 161

Spinnaker Sets Sail to the Continuous Delivery Foundation

The Netflix TechBlog

Author: Andy Glover Since releasing Spinnaker to the open source community in 2015 , the platform has flourished with the addition of new cloud providers, triggers, pipeline stages, and much more. spinnaker continuous-delivery cloud-computing open-source

Best Practices In Appium

DZone

selenium appium mobile application testing open source test tools appium testng android testingMany times, in Appium we face uncertain issues with the AVD Manager, ADB, Emulators, uiautomatorviewer and with MobileWebScript execution. Common Reasons for Errors. Configuration Errors.

How To Connect To Your MongoDB Deployments Using Robo 3T GUI

Scalegrid

This open source tool has cross-platform support and actually embeds the mongo shell within its interface to provide both shell and GUI-based interaction. Launch Robo 3T and open the ‘Manage Connections’ window: Click on ‘Create’ to setup a new connection.

Re-Architecting the Video Gatekeeper

The Netflix TechBlog

and can achieve orders of magnitude more efficient data access, which opens up many possibilities. During that cycle , the producer iterates over all records from the source of truth. caching software-architecture programming open-source software-engineering

Intro to Redis Cluster Sharding – Advantages, Limitations, Deploying & Client Connections

High Scalability

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

MySQL High Availability Framework Explained – Part III: Failover Scenarios

High Scalability

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II.

How Much Testing Is Enough?

DZone

Whether you’re writing unit tests for your programs or finding bugs in closed-source third-party software, knowing what code you have and have not covered is an important piece of information. In this article, we’ll introduce bncov, an open-source tool developed by ForAllSecure (available at on GitHub ), and demonstrate how it can be used to answer common questions that arise in software testing.

JUnit Annotations in Selenium

DZone

JUnit is a Java-based, open-source framework to help you execute unit testing. open source performance testing automation selenium junit annotations selenium webdriverJUnit is used primarily to test each and every unit or component of your application, like classes and methods. It helps to write and run repeatable automated tests to ensure your code runs as intended. The framework offers support to Selenium for automation testing for web apps or websites.

Java 118

Tool up your API integration testing with OpenAPI

TechBeacon Testing

App Dev & Testing, Testing, Open Source, Integration Testing, Application Programming Interface (API APIs have become the adhesive that holds the modern web together, reflecting the changing nature of web apps.

Highly Available Redis Clusters with Automated Sharding Launches at ScaleGrid

Scalegrid

Redis Cluster is the native sharding implementation available within Redis, an open-source in-memory data structure project, that allows you to automatically shard across multiple Redis nodes without having to rely on external tools and utilities. PALO ALTO, Calif., January 24, 2019 – ScaleGrid , a rising leader in the Database-as-a-Service (DBaaS) space, has just announced support for Redis Clusters on their fully managed Redis hosting plans.

Top 9 Free Java Process Monitoring Tools and How to Choose One

DZone

java open source performance monitoring jvm process java performance process monitoringTo help equip you for the ongoing process of optimization and the life of debugging ahead of you, we’ve gathered a list of the best tools to monitor the JVM in both development and production environments. And the best part? They all come for a very affordable price: free. No trials, no license purchases – just the tools you need to delve behind the scenes of your code execution.

The Billion Data Point Challenge: Building a Query Engine for High Cardinality Time Series Data

Uber Engineering

Architecture Open Source Graphite High Cardinality M3 M3DB Metrics NYC Engineering Observability Engineering Open Source at Uber Prometheus Query Engine Reliability Time Series Uber EngineeringUber, like most large technology companies, relies extensively on metrics to effectively monitor its entire stack.

Top Redis Use Cases by Core Data Structure Types

High Scalability

Redis , short for Remote Dictionary Server, is a BSD-licensed, open-source in-memory key-value data structure store written in C language by Salvatore Sanfillipo and was first released on May 10, 2009. C C++ Caching Clustering Database DevOps Message Broker Redis Redis Cluster Redis Hashes Redis Lists Redis Queues Redis Sets Redis Sorted Sets Redis Strings Use Cases administrator cache data management database databases in-memory key-value store nosql open source queue redis

Client-side Performance Monitoring with InfluxDB

Wayfair Tech

Database Open Source Tools Web Performance databases InfluxDB kafka monitoring real user monitoring time seriesAccurate performance monitoring is crucial for Wayfair’s Storefront Engineering team. Each day we deploy hundreds of code changes to the web application for our customer-facing websites, and each change has the potential to impact performance for better or worse. For this reason, we carefully monitor KPIs such as page load. Read more.

Testing PHP7

Wayfair Tech

Open Source Web Performance open source phpPHP7 is out. This isn’t news. It’s been out since last December, with nine minor revisions since then. What’s new is that it’s serving all of Wayfair’s customer-facing traffic. Performance-wise, PHP7 is the rocket ship people said it would be. We’re nothing but pleased. If you can upgrade, you should do. Read more.

Observability at Scale: Building Uber’s Alerting Ecosystem

Uber Engineering

Architecture Alerting Jaeger M3 Monitoring New York City Obersvability OSS Runbooks Uber Uber Engineering Uber NYC Engineering Uber Open SourceUber’s software architectures consists of thousands of microservices that empower teams to iterate quickly and support our company’s global growth.

Why Uber Engineering Switched from Postgres to MySQL

Uber Engineering

Architecture Open Source Data Database Infra MySQL Postgres Uber DataBy Evan Klitzke. Introduction. The early architecture of Uber consisted of a monolithic backend application written in Python that used Postgres for data persistence.

Evolving Distributed Tracing at Uber Engineering

Uber Engineering

At Uber Engineering, our open source distributed tracing system Jaeger saw large-scale internal adoption throughout 2016, integrated into hundreds … The post Evolving Distributed Tracing at Uber Engineering appeared first on Uber Engineering Blog. Architecture Open Source Cassandra Distributed Go Jaeger Java Kafka Microservice New York City Node.js

Improving the User Experience with Uber’s Customer Obsession Ticket Routing Workflow and Orchestration Engine

Uber Engineering

Architecture Open Source Cadence Customer Obsession Platform Customer Support Natural Language Processing NLP Orchestration Engine Ticket Routing Ticket Routing WorkflowEvery day, Uber users around the world initiate customer support tickets through our Customer Obsession Platform.

Rewriting Uber Engineering: The Opportunities Microservices Provide

Uber Engineering

Architecture Open Source Business Intelligence Currency Infra Lady Eng Microservice Money Postgres Python RFC SOA SQL ThriftA few months back, we discussed Uber’s decision to abandon its monolithic codebase in favor of a modular, flexible microservice architecture.

Scaling Redis and Memcached at Wayfair

Wayfair Tech

Open Source Web Performance Ketama memcached redis Twemproxy

Hudi: Uber Engineering’s Incremental Processing Framework on Apache Hadoop

Uber Engineering

Architecture Open Source Data Data Architecture Hadoop HDFS HIVE Hoodie Incremental Processing Framework Spark Uber Data

Tuning PostgreSQL Database Parameters to Optimize Performance

Percona

open source databases Performance Tuning PostgreSQL database performance parameters PostgreSQL Performance TuningOut of the box, the default PostgreSQL configuration is not tuned for any particular workload. Default values are set to ensure that PostgreSQL runs everywhere, with the least resources it can consume and so that it doesn’t cause any vulnerabilities. It has default settings for all of the database parameters.