The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JULY 24, 2023

PBM) introduced a GA version of incremental physical backups , which can greatly impact both the recovery time and the cost of backup (considering storage and data transfer cost). Well, it is because we believe that open source philosophy is not only about the source but also about design and decision-making.

Availability 79

Availability Open Source Strategy Storage 79

Dynatrace

JANUARY 16, 2023

Open-source software drives a vibrant Kubernetes ecosystem. Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Java, Go, and Node.js

Open Source 343

Open Source Java Operating System Programming 343

Dynatrace

JANUARY 31, 2024

Introducing Dynatrace OpenPipeline OpenPipeline is a stream-processing technology that transforms how the Dynatrace platform ingests data from any source, at any scale, and in any format. With OpenPipeline, you can easily collect data from Dynatrace OneAgent®, open source collectors such as OpenTelemetry, or other third-party tools.

Analytics 194

Analytics Processing Transportation Storage 194

Dynatrace

SEPTEMBER 29, 2021

Prometheus is an open-source monitoring and alerting toolkit for services and applications that run in containers. Prometheus components include client libraries for application code instrumentation, special-purpose exporters for popular services, and the optional Prometheus server for orchestrating service discovery and data storage.

Technology 210

Technology Technology Monitoring AWS 210

Adrian Cockcroft

NOVEMBER 26, 2023

The Pantheon in Rome — Extremely sustainable architecture — photo by Adrian I wrote a medium post after AWS re:Invent 2022 summarizing the (lack of) news and all the talks related to Sustainability. This includes providing the efficient, resilient services AWS customers expect, while minimizing their environmental footprint.

AWS 52

AWS Energy IoT Best Practices 52

Dynatrace

SEPTEMBER 17, 2019

Kubernetes (k8s) provides basic monitoring through the Kubernetes API and you can find instructions like Top 9 Open Source Tools for Monitoring Kubernetes as a “do it yourself guide”. PostgreSQL & Elastic for data storage. AWS EKS for Integration and Production. Dynatrace news. Full-stack observability.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc.

AWS 52

AWS Database Serverless Storage 52

Percona

JANUARY 30, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. was made available on January 23, 2023. was made available on January 23, 2023. It’s time for the release roundup!

Open Source 87

Open Source Storage AWS Cloud 87

High Scalability

APRIL 16, 2019

In this three-part blog series, we introduced a High Availability (HA) Framework for MySQL hosting in Part I, and discussed the details of MySQL semisynchronous replication in Part II. Now in Part III, we review how the framework handles some of the important MySQL failure scenarios and recovers to ensure high availability.

Availability 149

Availability Network Azure AWS 149

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 121

Cloud Serverless AWS Storage 121

Percona

FEBRUARY 10, 2023

Xbcloud is a tool part of Percona XtraBackup and allows you to upload and download backups to Amazon S3 storage. Summary Percona xbcloud can now utilize an instance profile allowing users to automate access to AWS S3 buckets by removing the need of access/secret-key being provided as parameters or configuration.

Storage 95

Storage Open Source AWS Servers 95

Dynatrace

OCTOBER 11, 2021

In recent years, function-as-a-service (FaaS) platforms such as Google Cloud Functions (GCF) have gained popularity as an easy way to run code in a highly available, fault-tolerant serverless environment. Avoid lock-in with open-source technologies. Think of GCP as a suite, whereas GCF is a specialized service within it.

Google 221

Google Cloud Serverless Azure 221

Scalegrid

OCTOBER 7, 2019

As this open source database continues to pull new users from expensive commercial database management systems like Oracle, DB2 and SQL Server, organizations are adopting new approaches and evolving their own to maintain the exceptional performance of their SQL deployments. PostgreSQL popularity is skyrocketing in the enterprise space.

Strategy 182

Strategy Cloud Java Open Source 182

Scalegrid

JULY 8, 2019

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? The first thing to consider when weighing between self-management and a MySQL Database-as-a-Service (DBaaS) solution is what internal resources you have available.

Azure 219

Azure Cloud Virtualization Database 219

Percona

JANUARY 20, 2023

When using cloud storage like EBS or similar, it is normally easy(er) to extend volumes, which gives us the luxury to plan the space to allocate for data with a good grade of relaxation. The story The case was on AWS using EKS. aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false

AWS 95

AWS Storage Monitoring Cloud 95

Scalegrid

DECEMBER 16, 2019

MongoDB is the #3 open source database and the #1 NoSQL database in the world. So, what makes DigitalOcean a compelling alternative to other popular MongoDB hosting providers like AWS and Azure ? DigitalOcean, along with AWS and Azure, offer a 99.99% uptime SLA, but while that sounds close to perfect, that 0.01% equates to 52.6

Azure 187

Azure AWS Latency Database 187

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Host MySQL on AWS , or MySQL on Azure with configurable instance sizes through the top two cloud providers in the world.

Database 166

Database Cloud Website Azure 166

Percona

FEBRUARY 23, 2023

Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination. At the same time, the common goal is to save both the network bandwidth and storage space (cost savings!) The two most popular ones — s3cmd and AWS — are sufficient, and I will show examples using both. %H-%M)

AWS 123

AWS Storage Database Open Source 123

Percona

APRIL 10, 2023

Percona is a leading provider of unbiased open source database solutions that allow organizations to easily, securely, and affordably maintain business agility, minimize risks, and stay competitive. Offered free as an open source solution, Percona XtraBackup drives down backup costs while providing unique features for MySQL backups.

Open Source 80

Open Source Servers AWS Database 80

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Azure 52

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

MARCH 28, 2023

To briefly explain pgBackRest, it is an open source backup tool that takes FULL Backup, Incremental Backup, and Differential Backup for PostgreSQL databases. One can configure both repositories in different storage. In case one storage is unavailable, then another storage will still have a backup, which can be helpful.

Servers 85

Servers Azure AWS Cloud 85

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Take Cloudflare as an example; they have an entire service called Cloudflare Terraform. ‍

Open Source 40

Open Source DevOps AWS Azure 40

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. The Kubernetes experience.

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

KeyCDN

FEBRUARY 22, 2023

The goal of WebAssembly is to execute at native speeds by taking advantage of common hardware features available on a variety of platforms. There are several popular cloud-based platforms for web development and deployment, such as AWS , Azure , and Google Cloud Platform.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. Hence, the node would still be available for other operations. Caveat: Good as long as you have the additional resources available for running the parallel threads.

Best Practices 52

Best Practices Database Storage Servers 52

The Netflix TechBlog

MAY 21, 2019

Choose the most promising subset of tests out of thousands of test cases available when running continuous integration against a device. We wanted the to tool be available as a standalone library as well as scalable API service. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! both for compute and storage. For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

Open Source 232

Open Source AWS Infrastructure Energy 232

Percona

JULY 2, 2023

Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

High Scalability

APRIL 3, 2019

PostgreSQL is an open source object-relational database system that has soared in popularity over the past 30 years from its active, loyal, and growing community. For the 2nd year in a row, PostgreSQL has kept the title of #1 fastest growing database in the world according to the DBMS of the Year report by the experts at DB-Engines.

Database 177

Database Cloud Open Source Systems 177

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 107

Database Benchmarking Latency C++ 107

Percona

DECEMBER 20, 2018

With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies. Fsync Performance on Storage Devices. And making lists. About ZFS Performance.

Database 40

Database Tuning Performance AWS 40

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! both for compute and storage. For the open-source release, we partnered with AWS to provide a seamless integration between Metaflow and various AWS services.

Open Source 134

Open Source AWS Infrastructure Energy 134

Adrian Cockcroft

APRIL 5, 2023

The challenge is that accurate data isn’t available immediately, and cloud providers currently only provide monthly carbon data, with several months lag. There are also control plane overheads, shared storage volumes and supporting services to instrument. At the one minute granularity security concerns are minimized.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. It provides redundancy and data availability for your data. Replication provides redundancy, and having multiple copies of the same data increases data availability. MongoDB is popular with developers as it is easy to get started with.

Database 83

Database Servers Storage Strategy 83