Scalegrid

MARCH 14, 2024

When delving into the networking aspect of a hybrid cloud deployment, complexities arise due to the requirement of linking or expanding existing on-premises network architectures into the cloud sphere. Ready to take your database management to the next level with ScaleGrid’s cutting-edge solutions?

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Morning Paper

MARCH 3, 2020

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. NSDI’20. This paper is a real joy to read.

Database 106

Database AWS Network Design 106

Percona

FEBRUARY 24, 2023

In the Home Dashboard of PMM, a low CPU utilization on any of the database services that are being monitored could mean that the server is inactive or over-provisioned. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2.

Cloud 117

Cloud Serverless AWS Storage 117

All Things Distributed

OCTOBER 17, 2016

The Ohio Region is the fifth AWS region in the US. It brings the worldwide total of AWS Availability Zones (AZs) to 38, and the number of regions globally to 14. The pace of expansion at AWS is accelerating, and Ohio is our third region launch this year. Check out the Regional Products and Services page for the full list.

AWS 127

AWS Cloud Infrastructure Analytics 127

Percona

MAY 2, 2023

That’s why it’s essential to implement the best practices and strategies for MongoDB database backups. Why are MongoDB database backups important? Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks.

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

MAY 19, 2017

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. For a long time, these requirements were almost exclusively served by commercial, proprietary databases.

Database 120

Database Design Cloud Storage 120

Scalegrid

JULY 8, 2019

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? While Microsoft Azure does offer a managed solution, Azure Database, the solution has some major limitations you should know about before migrating your MySQL deployments.

Azure 219

Azure Cloud Virtualization Database 219

Brendan Gregg

NOVEMBER 29, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. Impressive!

Virtualization 111

Virtualization AWS Hardware Storage 111

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. A second job taps the data feed from the first job, does tail sampling of data and writes traces to the storage system.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 8, 2024

For example, an application could use on-premises databases while also having access to ‘cloud bursting’ capabilities during times of high demand. The company utilizes public cloud resources such as Amazon Web Services (AWS) for streaming purposes and maintains on-premises infrastructure for content creation and processing.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

MAY 6, 2021

Contact Dynatrace ONE if you wish to enable Cluster-side screenshot storage on pre-1.216 fresh-installed Clusters. On the “Network overview” page, `Host group` filter suggestions are now properly displayed when a management zone is selected. APM-292756). APM-288329). APM-290353). APM-292404). APM-293415). APM-295166).

Operating System 230

Operating System AWS Metrics Storage 230

Percona

APRIL 26, 2023

When you do a database restore, you want to have it done as soon as possible. And the database is unusable until the restore is done. Our tests showed physical database restores up to 5x faster than the logical ones. The speed of the physical restoration comes down to how fast we can copy (download) data from the remote storage.

Speed 77

Speed Storage AWS Azure 77

Percona

FEBRUARY 23, 2023

If you ever had to make a quick ad-hoc backup of your MongoDB databases, but there was not enough disk space on the local disk to do so, this blog post may provide some handy tips to save you from headaches. Fortunately, there are ways to skip the local storage entirely and stream MongoDB backups directly to the destination.

AWS 118

AWS Storage Database Open Source 118

Scalegrid

JANUARY 8, 2024

AI-driven cloud solutions like ScaleGrid offer a diverse range of database hosting options, robust infrastructure optimized for scalability and security, and enable significant cost reductions, supporting businesses in efficient growth and improved ROI. These services are tailored to meet various business requirements.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

AUGUST 20, 2012

Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. Amazon Glacier integrates seamlessly with other AWS services such as Amazon S3 and the different AWS Database services.

Storage 122

Storage Cloud AWS Media 122

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. The AWS Import/Export team has announced today that they have expanded their functionality significantly by adding Import into Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet.

AWS 98

AWS Cloud Storage Internet 98

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. Logs can also be used to represent event data.

Virtualization 160

Virtualization Infrastructure Monitoring Cloud 160

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. Today Amazon Web Services is expanding its world-wide coverage with the launch of a new AWS Region located in Tokyo, Japan. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea.

AWS 114

AWS Cloud Games Latency 114

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. Impressive!

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

JULY 16, 2012

Register for AWS re: Invent. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Comments ().

AWS 85

AWS Big Data Media Storage 85

Percona

JULY 2, 2023

The size of the database and your database environment—if it is on colo or cloud—matters. Having a backup strategy in place that takes regular backups and has secure storage is essential to protect the database in an enterprise-grade environment to ensure its availability in the event of failures or disasters.

Strategy 52

Strategy Database Storage Open Source 52

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 113

AWS Government Big Data Cloud 113

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements. Comments ().

AWS 115

AWS Cloud Java Scalability 115

The Netflix TechBlog

MAY 21, 2019

Lerner, as a web-service, relies on Amazon Web Services (AWS) and Netflix’s Open Source Software (OSS) tools. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data. Lerner uses AWS services to store binary versions of the agents, agent configurations, and training data.

Testing 163

Testing AWS Lambda Network 163

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. The Linux default is usually 60 , which is not ideal for database usage. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

High Scalability

APRIL 16, 2019

Scenario 3 – Network Partition – Network Connectivity Breaks Down Between Master and Slave Nodes. This is a classical problem in any distributed system where each node thinks the other nodes are down, while in reality, only the network communication between the nodes is broken.

Availability 149

Availability Network Azure AWS 149

All Things Distributed

APRIL 5, 2012

From tax preparation to safe social networks, Amazon RDS brings new and innovative applications to the cloud. Empowering innovation is at the heart of everything we do at Amazon Web Services (AWS). Intelligent Social network - Facilitate topical Q&A conversations among employees, customers and our most valued super contributors.

Innovation 149

Innovation AWS Education Network 149

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Choosing a cloud DBMS: architectures and tradeoffs Tan et al.,

Architecture 76

Architecture Cloud Storage Serverless 76

The Morning Paper

FEBRUARY 6, 2020

The canononical cloud platform architecture decouples storage and compute services so that each can be scaled and operated independently, i.e., they are disaggregated. Only now the database is itself a distributed KVS, and the slices of application functionality are much finer-grained. Evaluation. A closing thought.

Lambda 98

Lambda Serverless Cache Latency 98

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. First released in 2009, it is the most used NoSQL database and has been downloaded more than 325 million times. The bigger the database, the bigger the damage from a leak.

Database 78

Database Servers Storage Strategy 78

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started This level of granularity is not found in UI-managed systems.Â

Open Source 52

Open Source DevOps AWS Azure 52

Smashing Magazine

JUNE 25, 2020

We’ll also discuss the costs and benefits of CDNs and dedicated file storage solutions. Part 3 : Models, Admin, And Harnessing The Relational Database. These strategies often involve spinning up and down numerous servers and using tools like load balancers and managed databases. Part 2 : Templating Saves Lines. Definitions.

Media 69

Media Cache Storage AWS 69

High Scalability

JUNE 22, 2018

using them to respond to storage events on s3 or database events or auth events is super easy and powerful. OpenConnect, the ability to deploy the CDN directly into the internal network of these ISPs served multiple purposes--not the least of which was to expose the fact that they were holding Netflix for ransom.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS.

Servers 126

Servers Social Media AWS Website 126

The Netflix TechBlog

JULY 30, 2019

The Netflix Media Database (NMDB) is one such example. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra This opens the route to using a managed Elasticsearch cluster (a la AWS) as part of the Conductor deployment.

Lambda 189

Lambda Media Open Source Metrics 189