DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. Traditionally, this process involved manual configuration, leading to potential inconsistencies, human errors, and time-consuming deployments.

Data Engineering 141

Data Engineering Infrastructure Engineering Code 141

Dynatrace

JANUARY 11, 2023

Continuous cloud monitoring with automation provides clear visibility into the performance and availability of websites, files, applications, servers, and network resources. Database monitoring. This ensures the database queries are performant, while also identifying host problems. Cloud storage monitoring.

Cloud 222

Cloud Monitoring Best Practices Infrastructure 222

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 105

Availability Database Open Source Hardware 105

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. Because of this, preserving the availability and integrity of the data stored in MySQL databases requires regular backups. Having MySQL backups for your database can speed up and simplify the recovery process.

Best Practices 130

Best Practices Storage Strategy Database 130

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Today, we’ll be taking a deep dive into the intricacies of database migration, along with specific solutions to help make the process easier.

Open Source 90

Open Source Database Hardware Strategy 90

Percona

AUGUST 30, 2023

Data powers everything, and unlike coal and coal combustion, data and databases aren’t going away. In this blog, we’ll focus on the elements of database backup and disaster recovery, and we’ll introduce proven solutions for maintaining business continuity, even amid otherwise dire circumstances.

Database 85

Database Hardware Open Source Strategy 85

Scalegrid

MARCH 14, 2024

This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential. Mastering Hybrid Cloud Strategy Are you looking to leverage the best private and public cloud worlds to propel your business forward? A hybrid cloud strategy could be your answer.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Scalegrid

DECEMBER 21, 2023

Redis® Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis® database requires active monitoring. With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times.

Strategy 130

Strategy Monitoring Latency DevOps 130

Scalegrid

JANUARY 8, 2024

Key Takeaways Multi-cloud involves using services from multiple cloud providers to gain flexibility and reduce vendor lock-in, while hybrid cloud combines private and public cloud resources to balance control and scalability. The reason lies in the unique advantages that come from utilizing a hybrid cloud.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. The next challenge was to stream large amounts of traces via a scalable data processing platform.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Percona

MAY 2, 2023

That’s why it’s essential to implement the best practices and strategies for MongoDB database backups. Why are MongoDB database backups important? Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks.

Best Practices 52

Best Practices Database Storage Servers 52

Scalegrid

JULY 13, 2020

Oracle Database is a commercial, proprietary multi-model database management system produced by Oracle Corporation, and the largest relational database management system (RDBMS) in the world. While Oracle remains the #1 database on the market, its popularity has steadily declined by over 18% since 2013. Not available.

Open Source 244

Open Source Tuning C++ Database 244

Highly Scalable

SEPTEMBER 18, 2012

Scalability is one of the main drivers of the NoSQL movement. These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases.

Database 213

Database Latency C++ Scalability 213

Dynatrace

MAY 8, 2023

The process involves monitoring various components of the software delivery pipeline, including applications, infrastructure, networks, and databases. Infrastructure monitoring Infrastructure monitoring reviews servers, storage, network connections, virtual machines, and other data center elements that support applications.

DevOps 219

DevOps Efficiency Monitoring Infrastructure 219

Dynatrace

NOVEMBER 2, 2020

IT infrastructure is the heart of your digital business and connects every area – physical and virtual servers, storage, databases, networks, cloud services. Ensures platform is flexible and scalable to handle peaks by sending alerts to IT management. for unplanned downtime, resource saturation, network intrusion.

Infrastructure 199

Infrastructure Monitoring Virtualization Serverless 199

High Scalability

JUNE 22, 2018

using them to respond to storage events on s3 or database events or auth events is super easy and powerful. OpenConnect, the ability to deploy the CDN directly into the internal network of these ISPs served multiple purposes--not the least of which was to expose the fact that they were holding Netflix for ransom.

Internet 113

Internet Internet Scalability Artificial Intelligence 113

Percona

FEBRUARY 24, 2023

In the Home Dashboard of PMM, a low CPU utilization on any of the database services that are being monitored could mean that the server is inactive or over-provisioned. From AWS documentation , Amazon EBS is an easy-to-use, scalable, high-performance block-storage service designed for Amazon EC2.

Cloud 117

Cloud Serverless AWS Storage 117

Dynatrace

DECEMBER 18, 2023

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. But often, we use additional services and solutions within our environment for backups, storage, networking, and more.

Metrics 177

Metrics Engineering Energy Tuning 177

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Without it, sending an email over a long distance would require the immediate availability of every node on the routing network to forward each message. A producer creates the message, and a consumer processes it.

Monitoring 199

Monitoring Serverless Programming Speed 199

Dynatrace

AUGUST 5, 2022

Consumers store messages in a queue — usually in a buffer or on a storage medium — until they can process and delete them. Without it, sending an email over a long distance would require the immediate availability of every node on the routing network to forward each message. A producer creates the message, and a consumer processes it.

Monitoring 198

Monitoring Serverless Programming Speed 198

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. All Things Distributed. Comments ().

Storage 122

Storage Cloud AWS Media 122

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. What does observability mean for Kubernetes?

Virtualization 160

Virtualization Infrastructure Monitoring Cloud 160

ScaleOut Software

JULY 27, 2018

Hosted on commodity clusters or cloud infrastructures, IMDGs harness the power of distributed computing to deliver scalable storage capacity and access throughput, along with integrated high availability. To help ensure fast data access and scalability, IMDGs usually employ a straightforward key/value storage model.

Scalability 40

Scalability Cache Airlines Healthcare 40

ScaleOut Software

JULY 27, 2018

Hosted on commodity clusters or cloud infrastructures, IMDGs harness the power of distributed computing to deliver scalable storage capacity and access throughput, along with integrated high availability. To help ensure fast data access and scalability, IMDGs usually employ a straightforward key/value storage model.

Scalability 40

Scalability Cache Airlines Healthcare 40

Percona

AUGUST 22, 2023

Estimates vary, but most reports put the average cost of unplanned database downtime at approximately $300,000 to $500,000 per hour, or $5,000 to $8,000 per minute. With so much at stake, database high availability and fault tolerance have become must-have items, but many companies just aren’t certain which one they must have.

Availability 77

Availability Hardware Open Source Database 77

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. This blog highlights considerations for keeping your own PostgreSQL databases highly available and healthy. The same changes made in the primary database are made in the replicas.

Availability 81

Availability Open Source Architecture Database 81

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The list goes on. The Limitations of Today’s Streaming Analytics. The heavy lifting is deferred to the back office.

IoT 78

IoT Analytics Big Data Architecture 78

Smashing Magazine

SEPTEMBER 28, 2022

The resource loading waterfall is a cascade of files downloaded from the network server to the client to load your website from start to finish. It essentially describes the lifetime of each file you download to load your page from the network. You can see this by opening your browser and looking in the Networking tab.

Cache 125

Cache Performance Servers Social Media 125

All Things Distributed

OCTOBER 17, 2016

Now customers who have been requesting a second US East region have more infrastructure options for running workloads, storing files, running analytics, and managing databases. The Ohio Region launches with three AZs so that customers can create high-availability environments and architect for fault tolerance and scalability.

AWS 127

AWS Cloud Infrastructure Analytics 127

The Netflix TechBlog

MAY 21, 2019

Solution We built a system called Lerner that consists of a set of microservices and a python library that allows scalable agent training and inference for test case scheduling. We wanted the to tool be available as a standalone library as well as scalable API service. which allows fast deployment times and rapid scalability.

Testing 163

Testing AWS Lambda Network 163

ScaleOut Software

APRIL 22, 2020

Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. In addition, repeatedly accessing back-end databases to serve up popular items, such as product descriptions and news stories, also adds to the bottleneck. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

Maintaining rapidly changing data in back-end databases creates bottlenecks that impact responsiveness. In addition, repeatedly accessing back-end databases to serve up popular items, such as product descriptions and news stories, also adds to the bottleneck. The Solution: Distributed Caching.

Cache 52

Cache Storage Servers Database 52

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

ScaleOut Software

JUNE 22, 2020

In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

ScaleOut Software

JUNE 22, 2020

In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52