Percona

JANUARY 20, 2023

When using cloud storage like EBS or similar, it is normally easy(er) to extend volumes, which gives us the luxury to plan the space to allocate for data with a good grade of relaxation. The story The case was on AWS using EKS. aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false aws-ebs"} ,storageclass.kubernetes.io/is-default-class=false

AWS 90

AWS Storage Monitoring Cloud 90

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 117

Database Design Cloud Storage 117

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much.

Open Source 232

Open Source AWS Infrastructure Energy 232

Dynatrace

JUNE 27, 2023

The increasing complexity of cloud service architectures requires a rock-solid understanding of the activity, health status, and security of cloud services. Many AWS services and third party solutions use AWS S3 for log storage. Another painful blocker is the need for more support for multiple S3 accounts and AWS regions.

AWS 203

AWS Cloud Lambda Analytics 203

The Netflix TechBlog

MAY 21, 2019

Lerner, as a web-service, relies on Amazon Web Services (AWS) and Netflix’s Open Source Software (OSS) tools. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! The infrastructure should allow them to exercise their freedom as data scientists but it should provide enough guardrails and scaffolding, so they don’t have to worry about software architecture too much.

Open Source 134

Open Source AWS Infrastructure Energy 134

The Symphonia

JUNE 19, 2018

Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage? I was fortunate to be both presenting a 2-day workshop (on AWS Serverless Architectures and Continuous Deployment) as well as hosting a full-day Serverless track of talks. Unlike the temperature outside. Great stuff!

Serverless 40

Serverless AWS DevOps Open Source 40

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum Advantages.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

High Scalability

APRIL 16, 2019

At ScaleGrid, we offer highly available hosting for MySQL on AWS and MySQL on Azure that is implemented based on the concepts explained in this blog series. This concludes our 3-part blog series on the MySQL High Availability (HA) framework using semisynchronous replication and the Corosync plus Pacemaker stack.

Availability 149

Availability Network Azure AWS 149

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

High Scalability

SEPTEMBER 8, 2018

RISELabs , those wonderfully innovative folks over at Berkeley, have uplifted their Anna datatabase —a shared-nothing, thread-per-core architecture to achieve lightning-fast speeds by avoiding all coordination mechanisms—to become cloud-aware. No, I don’t think that is because AWS is earning a 355x margin on DynamoDB!

Storage 199

Storage Performance AWS Efficiency 199

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Infrastructure 52

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Take Cloudflare as an example; they have an entire service called Cloudflare Terraform.

Open Source 40

Open Source DevOps AWS Infrastructure 40

KeyCDN

FEBRUARY 22, 2023

There are several popular cloud-based platforms for web development and deployment, such as AWS , Azure , and Google Cloud Platform. Each of these platforms offers a wide range of services and tools for web application development and deployment, including storage, databases, and serverless computing.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. The first layer, Cassandra , is the source of truth for us. These applications are built on a microservices architecture, and the Asset Management Platform provides asset management to those dozens of services for various asset types.

Strategy 258

Strategy Cache Analytics Storage 258

High Scalability

OCTOBER 24, 2022

You can even go old school and use non cloud-native architectures. Maybe start investing into open source alternatives rather than complaining they don't already exist? For example, AWS created Nitro. Would Nitro have been invented if AWS was restricted to being a platform provider? It has been done.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. Indexing can help to speed up read queries, but it comes with an extra cost of storage, and they will slow down write operations. Having indexes that will never be used is a waste of storage and will slow down write operations.

Database 79

Database Servers Storage Strategy 79

Adrian Cockcroft

APRIL 5, 2023

The open source Cloud Carbon Footprint Tool takes billing data (which is available monthly or hourly) as it’s input, along with estimated carbon intensity factors, and can produce workload carbon estimates, but not in real time. At the instance level, many CPU and system architectures have direct access to power consumption metrics.

Energy 52

Energy Metrics Cloud Operating System 52

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. For example: Read/Write tickets WiredTiger uses tickets to control the number of read / write operations simultaneously processed by the storage engine. The report focuses on MySQL, but it is valid for MongoDB as well.

Best Practices 52

Best Practices Design Tuning Database 52

Enprowess

JANUARY 12, 2022

Serverless Architecture. Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Technologies like Microsoft Bot framework, Facebook Bot Engine, and DailougeFlow open-source builds these bots. Image Source.

Blockchain 59

Blockchain IoT Development Serverless 59

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. An end-to-end architecture. Boosted race trees for low energy classification Tzimpragos et al., ASPLOS’19. This fits rather nicely with an INHIBIT gate.

Energy 52

Energy Hardware Efficiency Architecture 52

Percona

NOVEMBER 3, 2023

PostgreSQL Cluster One coordinator node citus-coord-01 Three worker nodes citus1 citus2 citus3 Hardware AWS Instance Ubuntu Server 20.04, SSD volume type 64-bit (x86) c5.xlarge A future blog will continue my exploration into Citus by scaling out pgbench into other architectures. Download Percona Distribution for PostgreSQL Today!

Database 103

Database Benchmarking Latency C++ 103

Smashing Magazine

JANUARY 11, 2021

Defining The Environment Choosing a framework, baseline performance cost, Webpack, dependencies, CDN, front-end architecture, CSR, SSR, CSR + SSR, static rendering, prerendering, PRPL pattern. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Still, after all these years, keeping progressive enhancement as the guiding principle of your front-end architecture and deployment is a safe bet. Consider using PRPL pattern and app shell architecture.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. Keeping progressive enhancement as the guiding principle of your front-end architecture and deployment is a safe bet. Consider using PRPL pattern and app shell architecture. Baseline performance cost matters.

Performance 104

Performance Cache Metrics Network 104