The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 226

Systems Media Cache Open Source 226

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Scalegrid

JANUARY 24, 2019

Redis Cluster is the native sharding implementation available within Redis, an open-source in-memory data structure project, that allows you to automatically shard across multiple Redis nodes without having to rely on external tools and utilities. Some of the advanced benefits of Redis Clusters include: High Availability.

Availability 113

Availability Open Source AWS DevOps 113

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Open Source. What Exactly is Greenplum?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

High Scalability

OCTOBER 29, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. ScaleGrid offers a compelling alternative to hosting MySQL on AWS that offers better performance, more control, and no cloud vendor lock-in and the same price as Amazon RDS.

AWS 133

AWS Latency Performance Open Source 133

Dynatrace

JANUARY 16, 2023

Open-source software drives a vibrant Kubernetes ecosystem. Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Java, Go, and Node.js

Open Source 347

Open Source Java Operating System Programming 347

Dynatrace

DECEMBER 8, 2022

DevOps platform engineers are responsible for cloud platform availability and performance, as well as the efficiency of virtual bandwidth, routers, switches, virtual private networks, firewalls, and network management. They are similar to site reliability engineers (SREs) who focus on creating scalable, highly reliable software systems.

DevOps 196

DevOps Engineering Testing Open Source 196

All Things Distributed

OCTOBER 24, 2016

I am excited that Adrian Cockcroft will be joining AWS as VP of Cloud Architecture. At Netflix, Adrian played a key role in the company's much-discussed migration to a "cloud native" architecture, and the open sourcing of the widely used (and award-winning) NetflixOSS platform.

AWS 167

AWS Open Source Education Architecture 167

Percona

OCTOBER 19, 2023

Welcome to the first installment of our series: Scalable Solutions with Percona Distribution for PostgreSQL. This setup empowers your database to efficiently manage increased data volumes, enhance performance, and maintain availability. This tutorial will use Ubuntu 20.04 and Percona Distribution for PostgreSQL 15.

Scalability 82

Scalability Database Open Source Traffic 82

All Things Distributed

NOVEMBER 22, 2016

A set of programming models has emerged to help developers define and train AI models with deep learning; along with open source frameworks that put deep learning in the hands of mere mortals. Some examples of popular deep learning frameworks that we support on AWS include Caffe, CNTK, MXNet, TensorFlow, Theano, and Torch.

AWS 167

AWS Open Source Scalability Programming 167

Percona

AUGUST 21, 2023

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. It includes all the features and bug fixes available in MySQL 5.7.43 Take a look.

Open Source 81

Open Source AWS Servers Database 81

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Acceleration and distribution.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

JANUARY 31, 2024

The exponential growth of data volume—including observability, security, software lifecycle, and business data—forces organizations to deal with cost increases while providing flexible, robust, and scalable ingest. Of course, configuration-as-code using an application programming interface (API) is also available.

Analytics 198

Analytics Processing Transportation Storage 198

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Percona

FEBRUARY 15, 2023

Percona Distribution for MySQL is the most complete, stable, scalable, and secure open-source MySQL solution available, delivering enterprise-grade database environments for your most critical business applications… and it’s free to use! resource "percona_ps" "psgr" { count = 1 instance_type = "t3.micro"

Open Source 121

Open Source AWS Scalability Servers 121

Dynatrace

SEPTEMBER 17, 2019

Kubernetes (k8s) provides basic monitoring through the Kubernetes API and you can find instructions like Top 9 Open Source Tools for Monitoring Kubernetes as a “do it yourself guide”. AWS EKS for Integration and Production. Dynatrace news. Full-stack observability. End-to-end code-level tracing. Service mash insights.

AWS 128

AWS Monitoring Ecommerce Lambda 128

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

High Scalability

APRIL 16, 2019

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability.

Availability 149

Availability Network Azure AWS 149

Percona

DECEMBER 18, 2023

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. A release highlight is that Docker images are now available for x86_64 architectures.

Monitoring 84

Monitoring Open Source Servers Scalability 84

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. Open-source solutions, such as OpenTelemetry , provide a de facto standard for collecting telemetry data in cloud settings.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Dynatrace

OCTOBER 11, 2021

In recent years, function-as-a-service (FaaS) platforms such as Google Cloud Functions (GCF) have gained popularity as an easy way to run code in a highly available, fault-tolerant serverless environment. Avoid lock-in with open-source technologies. Scalability is a major feature of GCF. How Google Cloud Functions works.

Google 227

Google Cloud Serverless Azure 227

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Building upon Redis.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

MARCH 27, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. It is an open source database monitoring, management, and observability solution for MySQL, PostgreSQL, and MongoDB.

Open Source 76

Open Source Servers Scalability Cache 76

All Things Distributed

AUGUST 20, 2015

Like many AWS innovations, the desire to build a solution for a scalable graph database came from Amazon’s retail business. Thus, the idea was born for a robust, highly available, and scalable backend solution that wouldn’t require the burden of managing a massive storage layer. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

Percona

APRIL 10, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. Offered free as an open source solution, Percona XtraBackup drives down backup costs while providing unique features for MySQL backups.

Open Source 75

Open Source Servers AWS Database 75

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Azure 52

Percona

FEBRUARY 13, 2023

Recently, I was working with my colleagues Edwin Wang and Taras Onishchuk and found an interesting edge case involving a situation where a replica running Percona Server for MySQL 5.7 , external to AWS Aurora instance version 2.10.2 (5.7-compatible), sec) But you will see this is available in Aurora. compatible), broke.

AWS 87

AWS Database Open Source Servers 87

The Netflix TechBlog

OCTOBER 18, 2022

As Big data and ML became more prevalent and impactful, the scalability, reliability, and usability of the orchestrating ecosystem have increasingly become more important for our data scientists and the company. Motivation Scalability and usability are essential to enable large-scale workflows and support a wide range of use cases.

Java 202

Java Scalability Traffic Architecture 202

O'Reilly

OCTOBER 19, 2021

Cloud-based data warehouses, such as Snowflake , AWS’ portfolio of databases like RDS, Redshift or Aurora , or an S3-based data lake , are a great match to ML use cases since they tend to be much more scalable than traditional databases, both in terms of the data set sizes as well as query patterns. Software Development Layers.

DevOps 137

DevOps Software Engineering Infrastructure Open Source 137

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 116

Cloud Serverless AWS Storage 116

Dynatrace

FEBRUARY 9, 2021

The Hub includes the most prominent platforms like Kubernetes and Red Hat OpenShift as well as public cloud vendors like AWS, GCP, and Azure. A broad range of infrastructure components, open data frameworks, mobile platforms and frameworks (iOS, Android, Flutter, Xamarin, React, and others), and many more are also fully supported.

Software 146

Software Software Technology Technology 146

Dynatrace

JULY 7, 2022

Smaller teams can launch services much faster using flexible containerized environments, such as Kubernetes, or serverless functions, such as AWS Lambda, Google Cloud Functions, and Azure Functions. The demand for adaptable, highly scalable, and modular application designs has led many developers to move from SOA to a microservices approach.

Architecture 206

Architecture Serverless Azure Programming 206

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Take Cloudflare as an example; they have an entire service called Cloudflare Terraform. ‍

Open Source 40

Open Source DevOps AWS Azure 40

The Netflix TechBlog

MAY 21, 2019

Choose the most promising subset of tests out of thousands of test cases available when running continuous integration against a device. Solution We built a system called Lerner that consists of a set of microservices and a python library that allows scalable agent training and inference for test case scheduling.

Testing 163

Testing AWS Lambda Network 163

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. Cloud-based development and deployment One of the main advantages of cloud-based development and deployment is scalability. JavaScript frameworks JavaScript frameworks like React, Angular, and Vue.js

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111