High Scalability

SEPTEMBER 8, 2018

No, I don’t think that is because AWS is earning a 355x margin on DynamoDB! They've posted about Anna's new superpowers in Going Fast and Cheap: How We Made Anna Autoscale : Using Anna v0 as an in-memory storage engine, we set out to address the cloud storage problems described above.

Storage 199

Storage Performance AWS Efficiency 199

Scalegrid

JULY 8, 2019

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? This is why we caution against defaulting to Azure Database, or it’s AWS competitor, Amazon RDS, as they do not allow you to keep MySQL superuser access or even SSH access to your machines.

Azure 219

Azure Cloud Virtualization Database 219

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 116

Cloud Serverless AWS Storage 116

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Why Manage Infrastructure by Code?

Open Source 52

Open Source DevOps AWS Azure 52

Percona

FEBRUARY 23, 2023

Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination. At the same time, the common goal is to save both the network bandwidth and storage space (cost savings!) The two most popular ones — s3cmd and AWS — are sufficient, and I will show examples using both. %H-%M)

AWS 118

AWS Storage Database Open Source 118

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 140

Performance Latency Hardware Storage 140

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 117

Database Design Cloud Storage 117

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. Graph databases at Amazon.

Database 134

Database Logistics Availability Social Media 134

High Scalability

OCTOBER 24, 2022

Network effects are not the same as monopoly control. Maybe start investing into open source alternatives rather than complaining they don't already exist? Cloud providers incur huge fixed costs for creating and maintaining a network of datacenters spread throughout the word. For example, AWS created Nitro.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. Possible solutions.

Virtualization 162

Virtualization Infrastructure Monitoring Cloud 162

Scalegrid

JULY 29, 2019

MySQL is a free open source relational database management system that is leveraged across a majority of WordPress sites, and allows you to query your data such as posts, pages, images, user profiles, and more. Host MySQL on AWS , or MySQL on Azure with configurable instance sizes through the top two cloud providers in the world.

Database 166

Database Cloud Website Azure 166

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Take Cloudflare as an example; they have an entire service called Cloudflare Terraform. ‍

Open Source 40

Open Source DevOps AWS Azure 40

Abhishek Tiwari

JULY 22, 2023

For instance, Sentinel policies can enforce rules such as "All AWS S3 buckets must have server-side encryption enabled" or "Only specific IAM roles can access certain resources." " Open Policy Agent (OPA) : OPA is an open-source policy as code framework that provides a general-purpose policy engine.

AWS 52

AWS Best Practices Infrastructure Traffic 52

The Netflix TechBlog

MAY 21, 2019

Lerner, as a web-service, relies on Amazon Web Services (AWS) and Netflix’s Open Source Software (OSS) tools. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

Smashing Magazine

NOVEMBER 15, 2021

Mosh is a remote terminal app (or mobile shell) for interactive SSH usage that includes several useful features for those who need to do terminal-based tasks over weak WiFi, cellular networks, or other less-reliable connections. Storage is in plain text, includes Git-based versioning, wiki-style linking, color themes, and lots more.

Development 134

Development Google Storage Open Source 134

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra Cassandra persistence module is a partial implementation.

Lambda 189

Lambda Media Open Source Metrics 189

High Scalability

APRIL 16, 2019

Scenario 3 – Network Partition – Network Connectivity Breaks Down Between Master and Slave Nodes. This is a classical problem in any distributed system where each node thinks the other nodes are down, while in reality, only the network communication between the nodes is broken.

Availability 149

Availability Network Azure AWS 149

Percona

MAY 2, 2023

Also, we will take a look at our open-source backup utility custom-built to help avoid costs and proprietary software – Percona Backup for MongoDB or PBM. The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process.

Best Practices 52

Best Practices Database Storage Servers 52

Percona

JULY 2, 2023

Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters. WALs in PostgreSQL are similar to transaction log files in the InnoDB storage engine for MySQL.

Strategy 52

Strategy Database Storage Open Source 52

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] Nov 2011 - [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] Feb 2012 - [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] 2013 - [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. All these capabilities are available to customers at no additional charge, and maintain open-source Redis compatibility. Redis and Fast Data.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

APRIL 17, 2023

For example: UUID=f41e390f-835b-4223-a9bb-9b45984ddf8d / xfs rw,noatime,attr2,inode64,noquota 0 0 Unix ulimit settings Most UNIX-like operating systems, including Linux and macOS, provide ways to limit and control the usage of system resources such as threads, files, and network connections on a per-process and per-user basis.

Best Practices 52

Best Practices Design Tuning Database 52

Adrian Cockcroft

APRIL 5, 2023

The open source Cloud Carbon Footprint Tool takes billing data (which is available monthly or hourly) as it’s input, along with estimated carbon intensity factors, and can produce workload carbon estimates, but not in real time. There are also control plane overheads, shared storage volumes and supporting services to instrument.

Energy 52

Energy Metrics Cloud Operating System 52

The Symphonia

JUNE 19, 2018

This summer also marks the 4-yearly event that is La Copa Mundial (we only get Telemundo in my apartment, not Fox Sports Network) but since the good old US of A are absent from the men’s World Cup this year, football fever is distinctly frigid. Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage?

Serverless 40

Serverless AWS DevOps Open Source 40

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. Indexing can help to speed up read queries, but it comes with an extra cost of storage, and they will slow down write operations. Having indexes that will never be used is a waste of storage and will slow down write operations.

Database 78

Database Servers Storage Strategy 78

Brendan Gregg

FEBRUARY 28, 2023

Make sure your system can handle next-generation DRAM,” [link] , Nov 2011 [Hruska 12] Joel Hruska, “The future of CPU scaling: Exploring options on the cutting edge,” [link] , Feb 2012 [Gregg 13] Brendan Gregg, “Blazing Performance with Flame Graphs,” [link] , 2013 [Shimpi 13] Anand Lal Shimpi, “Seagate to Ship 5TB HDD in 2014 using Shingled Magnetic (..)

Performance 52

Performance Latency Cache Virtualization 52

Enprowess

JANUARY 12, 2022

Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. Technologies like Microsoft Bot framework, Facebook Bot Engine, and DailougeFlow open-source builds these bots. Image Source. Image Source.

Blockchain 59

Blockchain IoT Development Serverless 59

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. So decision trees are essentially networks of threshold functions. Boosted race trees for low energy classification Tzimpragos et al., ASPLOS’19.

Energy 52

Energy Hardware Efficiency Architecture 52

Smashing Magazine

JANUARY 11, 2021

Networking, HTTP/2, HTTP/3 OCSP stapling, EV/DV certificates, packaging, IPv6, QUIC, HTTP/3. dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g.

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 6, 2020

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled 3G network (e.g. Large preview ). There are many tools allowing you to achieve that: SiteSpeed.io 300ms RTT, 1.6

Performance 145

Performance Cache Network Metrics 145

Adrian Cockcroft

NOVEMBER 11, 2019

This is why most AWS regions have three availability zones. The second team is the software platform team, who provide standardized supported libraries, bundled open source projects, packaged commercial software, operating systems, build pipelines, language runtimes, databases, external high level services etc.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This is why most AWS regions have three availability zones. The second team is the software platform team, who provide standardized supported libraries, bundled open source projects, packaged commercial software, operating systems, build pipelines, language runtimes, databases, external high level services etc.

Latency 53

Latency Engineering Systems Hardware 53

Smashing Magazine

JANUARY 7, 2019

dashboard (open source), SpeedCurve and Calibre are just a few of them, and you can find more tools on perf.rocks. If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled network (e.g. There are many tools allowing you to achieve that: SiteSpeed.io 150ms RTT, 1.5 Mbps down, 0.7

Performance 104

Performance Cache Network Metrics 104