The Netflix TechBlog

MARCH 10, 2021

ConsoleMe: A Central Control Plane for AWS Permissions and Access By Curtis Castrapel , Patrick Sanders , and Hee Won Kim At AWS re:Invent 2020, we open sourced two new tools for managing multi-account AWS permissions and access. If you missed the talk, check it out here. This happened for us at Netflix.

AWS 251

AWS Cloud Games Infrastructure 251

Dynatrace

DECEMBER 15, 2020

We’re therefore excited to see that AWS has adopted the OpenTelemetry standards, which are actively driven by Dynatrace and the largest cloud providers. What is AWS Distro for OpenTelemetry? It has undergone security analysis and testing in accordance with AWS requirements. What is OpenTelemetry? New to Dynatrace?

AWS 179

AWS Metrics Analytics Government 179

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 226

Systems Media Cache Open Source 226

Dynatrace

DECEMBER 15, 2022

While engaging the automatic instrumentation of the Dynatrace OneAgent makes log ingestion automatic and scalable , our customers have set up multiple other log ingestion methods. Fluentd is an open source data collector that decouples data sources from observability tools and platforms by providing a unified logging layer.

Strategy 185

Strategy AWS Open Source Transportation 185

Dynatrace

JANUARY 16, 2023

Open-source software drives a vibrant Kubernetes ecosystem. Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Java, Go, and Node.js

Open Source 346

Open Source Java Operating System Programming 346

High Scalability

MARCH 22, 2019

Hell, many of these providers are just providing open source API compatibility with custom-built backends! What happens when no new open source comes out of the smaller companies, and the big-3 decide they don't really need or want to play nice anymore? They'll learn a lot and love you even more.5

Internet 134

Internet Internet Scalability Wireless 134

Dynatrace

DECEMBER 8, 2022

They are similar to site reliability engineers (SREs) who focus on creating scalable, highly reliable software systems. Version control system and source code management with end-to-end DevOps platform and cloud-hosted Git services. Open source CI/CD pipeline tool with extensible server automation for distributed builds and scaling.

DevOps 196

DevOps Engineering Testing Open Source 196

High Scalability

OCTOBER 29, 2019

AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. ScaleGrid offers a compelling alternative to hosting MySQL on AWS that offers better performance, more control, and no cloud vendor lock-in and the same price as Amazon RDS.

AWS 133

AWS Latency Performance Open Source 133

Percona

OCTOBER 19, 2023

Welcome to the first installment of our series: Scalable Solutions with Percona Distribution for PostgreSQL. Then, in the upcoming part of this post, Scalable Solutions with Percona Distribution for PostgreSQL (Part 2): Using Citus , we will use these worker nodes to establish a multi-node Citus cluster and implement sharding techniques.

Scalability 83

Scalability Database Open Source Traffic 83

Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Open Source. What Exactly is Greenplum?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Dynatrace

SEPTEMBER 17, 2019

Kubernetes (k8s) provides basic monitoring through the Kubernetes API and you can find instructions like Top 9 Open Source Tools for Monitoring Kubernetes as a “do it yourself guide”. AWS EKS for Integration and Production. Dynatrace news. Full-stack observability. End-to-end code-level tracing. Service mash insights.

AWS 128

AWS Monitoring Ecommerce Lambda 128

The Netflix TechBlog

MARCH 5, 2019

the order of the rows on your Netflix home page, issuing content licenses when you click play, finding the Open Connect cache closest to you with the content you requested, and many more). All these micro-services are currently operated in AWS cloud infrastructure.

Infrastructure 182

Infrastructure Cloud Scalability AWS 182

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. Microservices architecture helps teams become more flexible and bring highly scalable apps to market faster. Dynatrace news. Focused on delivering business value. Microservices benefits.

Architecture 246

Architecture Software Software Development 246

Percona

AUGUST 21, 2023

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. Take a look. Percona Monitoring and Management 2.39.0 was released on August 14, 2023.

Open Source 82

Open Source AWS Servers Database 82

Dynatrace

AUGUST 17, 2021

2020 cemented the reality that modern software development practices require rapid, scalable delivery in response to unpredictable conditions. Microservices architecture helps teams become more flexible and bring highly scalable apps to market faster. Dynatrace news. Focused on delivering business value. Microservices benefits.

Architecture 245

Architecture Software Software Development 245

Percona

FEBRUARY 15, 2023

Percona Distribution for MySQL is the most complete, stable, scalable, and secure open-source MySQL solution available, delivering enterprise-grade database environments for your most critical business applications… and it’s free to use! resource "percona_ps" "psgr" { count = 1 instance_type = "t3.micro"

Open Source 122

Open Source AWS Scalability Servers 122

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. Open-source solutions, such as OpenTelemetry , provide a de facto standard for collecting telemetry data in cloud settings.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

Dynatrace

JANUARY 31, 2024

The exponential growth of data volume—including observability, security, software lifecycle, and business data—forces organizations to deal with cost increases while providing flexible, robust, and scalable ingest. Understanding the context. OpenPipeline then filters and preprocesses that data to manage and reduce costs.

Analytics 197

Analytics Processing Transportation Storage 197

Percona

FEBRUARY 14, 2023

Scalability : Terraform makes it easy to scale infrastructure up or down, so you can quickly adapt to changing needs. Percona Monitoring and Management is a best-of-breed open source database monitoring solution. You need the provider version 0.9.10 and PMM can be deployed as: resource "percona_pmm" "pmm" { instance_type = "t3.micro"

Monitoring 120

Monitoring Infrastructure Open Source AWS 120

Percona

DECEMBER 18, 2023

Percona is a leading provider of unbiased, performance-first, open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive, free from vendor lock-in. Take a look. Percona Monitoring and Management 2.41.0 was released on December 12, 2023.

Monitoring 85

Monitoring Open Source Servers Scalability 85

The Netflix TechBlog

OCTOBER 19, 2020

Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Dynatrace

OCTOBER 11, 2021

In a time when modern microservices are easier to deploy, GCF, like its counterparts AWS Lambda and Microsoft Azure Functions , gives development teams an agility boost for delivering value to their customers quickly with low overhead costs. Avoid lock-in with open-source technologies. Scalability is a major feature of GCF.

Google 226

Google Cloud Serverless Azure 226

Percona

MARCH 27, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. It is an open source database monitoring, management, and observability solution for MySQL, PostgreSQL, and MongoDB.

Open Source 77

Open Source Servers Scalability Cache 77

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Infrastructure 52

Scalegrid

JANUARY 24, 2019

Redis Cluster is the native sharding implementation available within Redis, an open-source in-memory data structure project, that allows you to automatically shard across multiple Redis nodes without having to rely on external tools and utilities. Horizontal & Vertical Scalability. PALO ALTO, Calif., Native Solution.

Availability 113

Availability Open Source AWS DevOps 113

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

APRIL 10, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. Offered free as an open source solution, Percona XtraBackup drives down backup costs while providing unique features for MySQL backups.

Open Source 76

Open Source Servers AWS Database 76

Dynatrace

JULY 7, 2022

Smaller teams can launch services much faster using flexible containerized environments, such as Kubernetes, or serverless functions, such as AWS Lambda, Google Cloud Functions, and Azure Functions. The demand for adaptable, highly scalable, and modular application designs has led many developers to move from SOA to a microservices approach.

Architecture 205

Architecture Serverless Azure Programming 205

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Take Cloudflare as an example; they have an entire service called Cloudflare Terraform. ‍

Open Source 40

Open Source DevOps AWS Infrastructure 40

Percona

FEBRUARY 13, 2023

Recently, I was working with my colleagues Edwin Wang and Taras Onishchuk and found an interesting edge case involving a situation where a replica running Percona Server for MySQL 5.7 , external to AWS Aurora instance version 2.10.2 (5.7-compatible), compatible), broke. Download Percona Distribution for MySQL Today

Database 87

Database AWS Open Source Servers 87

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 116

Cloud Serverless AWS Storage 116

Dynatrace

FEBRUARY 9, 2021

The Hub includes the most prominent platforms like Kubernetes and Red Hat OpenShift as well as public cloud vendors like AWS, GCP, and Azure. A broad range of infrastructure components, open data frameworks, mobile platforms and frameworks (iOS, Android, Flutter, Xamarin, React, and others), and many more are also fully supported.

Software 145

Software Software Technology Technology 145

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! Netflix has been one of the largest users of Amazon Web Services (AWS) for many years and we have accumulated plenty of operational experience and expertise in dealing with the cloud, AWS in particular.

Open Source 232

Open Source AWS Infrastructure Energy 232

Dynatrace

JULY 13, 2020

Two years later, I came across that same customer at the AWS re:Invent conference , who then told me they were in the midst of a big project, moving their eCommerce to AWS , targeting running a big chunk of it in Kubernetes next year. . How do you make it scalable? . But how will you set up the communication?

Google 132

Google Ecommerce DevOps Cloud 132