DZone

JULY 13, 2023

In today's data-driven world, organizations need efficient and scalable data pipelines to process and analyze large volumes of data. Each zone has a specific purpose and plays a critical role in building efficient and scalable data pipelines.

Azure 246

Azure Architecture Efficiency Processing 246

InfoQ

DECEMBER 29, 2023

Zendesk reduced its data storage costs by over 80% by migrating from DynamoDB to a tiered storage solution using MySQL and S3. The company considered different storage technologies and decided to combine the relational database and the object store to strike a balance between querybility and scalability while keeping the costs down.

Storage 134

Storage Scalability Database Technology 134

DZone

JUNE 12, 2019

A system that has the ability to easily scale resources to meet the increasing workload without affecting the performance is known as a scalable system. The workload could refer to anything from an increase in users, storage, or a number of transactions.

Scalability 100

Scalability Software Architecture Storage Architecture 100

DZone

MARCH 2, 2023

It must be said that this video traffic phenomenon primarily owes itself to modernizations in the scalability of streaming infrastructure, which simply weren’t present fifteen years ago.

Social Media 269

Social Media Java Traffic Internet 269

Scalegrid

JANUARY 5, 2024

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. Practical Applications of DBMS DBMS finds practical applications in various fields.

Efficiency 147

Efficiency Storage Database Scalability 147

High Scalability

FEBRUARY 1, 2019

Glacier is cheap because it isn't "always ready" storage. Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading). There are TRADEOFFS YOU HAVE TO CONSIDER. Works great.

Internet 146

Internet Internet Scalability Games 146

Dynatrace

MAY 7, 2024

New processors: Introducing new processors, including Metric Selector and Content Modifier, for selective data processing and metadata adjustment, improving data relevance and storage efficiency. By default, you have a storage type memory, but you may exceed this buffer limit if you have a lot of data.

Best Practices 130

Best Practices IoT Metrics Storage 130

The Netflix TechBlog

APRIL 27, 2023

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 288

Storage Cache Metrics Database 288

DZone

APRIL 11, 2023

Data processing in the cloud has become increasingly popular due to its scalability, flexibility, and cost-effectiveness. It provides built-in connectors for various data sources such as databases, file systems, cloud storage, and more.

Azure 246

Azure Analytics Storage Cloud 246

DZone

NOVEMBER 27, 2023

An open-source distributed SQL query engine, Trino is widely used for data analytics on distributed data storage. Optimizing Trino to make it faster can help organizations achieve quicker insights and better user experiences, as well as cut costs and improve infrastructure efficiency and scalability. But how do we do that?

Tuning 152

Tuning Speed Performance Open Source 152

High Scalability

JANUARY 11, 2022

Firstly, the synchronous process which is responsible for uploading image content on file storage, persisting the media metadata in graph data-storage, returning the confirmation message to the user and triggering the process to update the user activity. Fetching User Feed. Sample Queries supported by Graph Database. Optimization.

Design 334

Design Media Storage Logistics 334

High Scalability

DECEMBER 16, 2022

Cloud computing is a model of computing that delivers computing services over the internet, including storage, data processing, and networking. It allows users to access and use shared computing resources, such as servers, storage, and applications, on demand and without the need to manage the underlying infrastructure. Can you expand?

Cloud 201

Cloud Serverless Internet Internet 201

DZone

MARCH 20, 2024

Embedded within the Linux kernel, KVM empowers the creation of VMs with their virtualized hardware components, such as CPUs, memory, storage, and network cards, essentially mimicking a machine. It allows physical servers to serve as hypervisor hosting machines ( VMs ).

Virtualization 117

Virtualization Hardware Open Source Storage 117

Dynatrace

OCTOBER 23, 2023

Secondly, determining the correct allocation of resources (CPU, memory, storage) to each virtual machine to ensure optimal performance without over-provisioning can be difficult. Firstly, managing virtual networks can be complex as networking in a virtual environment differs significantly from traditional networking.

Efficiency 216

Efficiency Virtualization Hardware Performance 216

DZone

MARCH 22, 2024

As a developer, engineer, or architect, finding the right storage solution that seamlessly integrates with your infrastructure while providing the necessary scalability, security, and performance can be a daunting task. Scalability and Flexibility One of the key strengths of StoneFly's offerings is its exceptional scalability.

Storage 177

Storage Scalability Development Infrastructure 177

DZone

JULY 3, 2023

Data engineering projects often require the setup and management of complex infrastructures that support data processing, storage, and analysis. Traditionally, this process involved manual configuration, leading to potential inconsistencies, human errors, and time-consuming deployments.

Data Engineering 141

Data Engineering Infrastructure Engineering Code 141

Scalegrid

NOVEMBER 29, 2023

As CTOs, database developers & experts, and DBAs seek more efficient, secure, and scalable cloud services solutions, DBaaS emerges as a compelling choice. This surge aligns with the 62% of companies reporting substantial data growth, underscoring the escalating need for scalable and agile database solutions.

Healthcare 130

Healthcare Hardware Database Scalability 130

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

All Things Distributed

MARCH 23, 2021

We had to rethink everything previously known about building scalable systems. Storage was one of our biggest pain points, and the traditional systems we used just weren’t fitting the needs of the Amazon.com retail business. and we needed the low cost with high reliability that wasn’t readily available in storage solutions.

Ecommerce 216

Ecommerce Retail Storage Scalability 216

Dynatrace

JUNE 9, 2023

Increasing an organization’s DevOps maturity is a key goal as teams adopt more cloud-native technologies, which simultaneously makes their environments more scalable and feature-rich but also more complex. Indexless means teams have rapid access to data without the storage cost and resources needed to maintain massive indexes.

DevOps 186

DevOps Analytics Storage Metrics 186

DZone

MAY 5, 2022

S3 plays a critical role in storing objects in hot and cold storage. Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This article will help you to upload files to AWS S3 in JMeter using Groovy. What Is S3?

AWS 130

AWS Storage Scalability Speed 130

Dynatrace

FEBRUARY 2, 2022

All data at rest is stored in Azure Storage and is encrypted and decrypted using 256-bit AES encryption (FIPS 140-2 compliant). Scalability: Dynatrace provides easy and limitless horizontal scalability for SaaS deployments.,

Azure 321

Azure Availability Hardware Innovation 321

DZone

SEPTEMBER 14, 2023

From an architectural perspective, the system should be able to undertake real-time analysis of various formats of logs, and of course, be scalable to support the huge and ever-enlarging data size.

Analytics 124

Analytics Storage Architecture Scalability 124

High Scalability

JUNE 22, 2018

using them to respond to storage events on s3 or database events or auth events is super easy and powerful. Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading).

Internet 113

Internet Internet Scalability Artificial Intelligence 113

The Netflix TechBlog

OCTOBER 19, 2020

Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. An additional implication of a lenient sampling policy is the need for scalable stream processing and storage infrastructure fleets to handle increased data volume. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 8, 2024

This article delves into the specifics of how AI optimizes cloud efficiency, ensures scalability, and reinforces security, providing a glimpse at its transformative role without giving away extensive details. Exploring artificial intelligence in cloud computing reveals a game-changing synergy.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Dynatrace

OCTOBER 17, 2023

Dynatrace has developed the purpose-built data lakehouse, Grail , eliminating the need for separate management of indexes and storage. All data is readily accessible without storage tiers, such as costly solid-state drives (SSDs). No storage tiers, no archiving or retrieval from archives, and no indexing or reindexing.

Retail 239

Retail Storage Best Practices Architecture 239

All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? s storage infrastructure. Comments ().

Storage 116

Storage AWS Virtualization Cloud 116

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Dynatrace

SEPTEMBER 8, 2022

Log management is an organization’s rules and policies for managing and enabling the creation, transmission, analysis, storage, and other tasks related to IT systems’ and applications’ log data. It involves both the collection and storage of logs, as well as aggregation, analysis, and even the long-term storage and destruction of log data.

Systems 187

Systems Cloud Analytics DevOps 187

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. All Things Distributed. Comments ().

Storage 122

Storage Cloud AWS Media 122

Percona

OCTOBER 13, 2023

storage/innobase/./././mysql-8.0.34/storage/innobase/row/row0sel.cc': storage/innobase/row/row0sel.cc': 'SourceRequest' not supported. storage/innobase/./././mysql-8.0.34/": storage/innobase/./././mysql-8.0.34/": Could not load source './obj/sql/./storage/innobase/./././mysql-8.0.34/storage/innobase/row/row0sel.cc':

Code 104

Code C++ Storage Programming 104

All Things Distributed

FEBRUARY 6, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Driving Storage Costs Down for AWS Customers. As we showed last week one of the services that is growing rapidly is the Amazon Simple Storage Service (S3). Other storage tiers may see even greater cost savings. All Things Distributed. Comments ().

Storage 113

Storage AWS Innovation Scalability 113

Percona

FEBRUARY 15, 2023

LSM storage engines like MyRocks are very different from the more common B-Tree-based storage engines like InnoDB. Bloom filter is an important feature improving performance of LSM storage engines. A good understanding of how bloom filters work can only lead to improved database performance.

Storage 130

Storage Tuning Cache Engineering 130

InfoQ

JUNE 16, 2023

Datadog created a dedicated data ingestion architecture offering exactly-once semantics for their third-generation event store, Husky. The event-driven architecture (EDA) can accommodate bursts in traffic in the multi-tenant platform with reasonable ingestion latency and acceptable operational costs. By Rafal Gancarz

Architecture 55

Architecture Scalability Latency Traffic 55

Dynatrace

AUGUST 30, 2023

Dynatrace’s collaboration with Google addresses these needs by providing simple, scalable, and innovative data acquisition for comprehensive analysis and troubleshooting. This increased agility requires ways of collecting and analyzing observability signals such as metrics, logs, and traces. Agent logs security.

Google 222

Google Cloud Innovation Infrastructure 222

Dynatrace

JANUARY 22, 2024

Data lakehouses combine a data lake’s flexible storage with a data warehouse’s fast performance. Their scalability, comparatively low cost, and support for advanced analytics and machine learning have helped fuel AI’s rapid enterprise adoption. That’s why many organizations turn to data lakehouses.

Artificial Intelligence 210

Artificial Intelligence Healthcare Retail Government 210