Scalegrid

MAY 13, 2020

In this blog post, we explain what Greenplum is, and break down the Greenplum architecture, advantages, major use cases, and how to get started. It’s architecture was specially designed to manage large-scale data warehouses and business intelligence workloads by giving you the ability to spread your data out across a multitude of servers.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

AUGUST 22, 2023

With so much at stake, database high availability and fault tolerance have become must-have items, but many companies just aren’t certain which one they must have. This blog article will examine shared attributes of high availability (HA) and fault tolerance (FT). What does high availability mean?

Availability 79

Availability Hardware Open Source Database 79

Dynatrace

OCTOBER 4, 2022

A data lakehouse addresses these limitations and introduces an entirely new architectural design. This architecture offers rich data management and analytics features (taken from the data warehouse model) on top of low-cost cloud storage systems (which are used by data lakes). This scenario is a thing of the past.

Artificial Intelligence 275

Artificial Intelligence Analytics Storage Architecture 275

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Reliability.

Serverless 289

Serverless AWS Lambda Storage 289

Scalegrid

JANUARY 8, 2019

In Part I , we introduced a High Availability (HA) framework for MySQL hosting and discussed various components and their functionality. Simply put, in a MySQL semisynchronous replication configuration, the master commits transactions to the storage engine only after receiving acknowledgement from at least one of the slaves.

Availability 113

Availability Tuning Speed Network 113

Dynatrace

AUGUST 11, 2022

Infrastructure as a service (IaaS) handles compute, storage, and network resources. Increased availability. Because FaaS is a cloud-native approach, it makes great use of multisite cloud architecture to improve availability and reliability. Consider a monolithic application, for example, designed to perform a host of functions.

Development 259

Development Serverless Best Practices Lambda 259

The Netflix TechBlog

NOVEMBER 29, 2023

HDR was launched at Netflix in 2016 and the number of titles available in HDR has been growing ever since. As noted in an earlier blog post , we began developing an HDR variant of VMAF; let’s call it HDR-VMAF. The arrival of HDR-VMAF allowed us to create HDR streams with DO applied, i.e., HDR-DO encodes. The graphic below (Fig.

Open Source 252

Open Source Software Engineering Internet Internet 252

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

Percona

MAY 29, 2023

With the Percona Operators, businesses can manage multi-cloud or hybrid-cloud PostgreSQL deployments with ease, ensuring that critical data is always available and secure, no matter what happens. pgBackrest on the Main site streams backups and Write Ahead Logs (WALs) to the object storage.

Storage 120

Storage Cloud Network Traffic 120

Dynatrace

NOVEMBER 20, 2023

The path to achieving unprecedented productivity and software innovation through ChatGPT and other generative AI – blog Paired with causal AI, organizations can increase the impact and safer use of ChatGPT and other generative AI technologies. What is causal AI? What is predictive AI? What is AIOps?

AWS 217

AWS Artificial Intelligence Analytics Cloud 217

The Netflix TechBlog

APRIL 26, 2022

We will share how its design has evolved over the years and the lessons learned while building it. To understand Axion’s design, we need to know the various components that interact with it. These facts are managed and made available by services like viewing history or video metadata services outside of Axion.

Storage 187

Storage Design Scalability Latency 187

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. In this blog, we will discuss both data and network-level compression offered in MongoDB.

Storage 108

Storage Network Open Source Latency 108

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 119

Cloud Serverless AWS Storage 119

Percona

DECEMBER 11, 2023

A Dedicated Log Volume (DLV) is a specialized storage volume designed to house database transaction logs separately from the volume containing the database tables. DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads.

AWS 97

AWS Benchmarking Performance Traffic 97

The Netflix TechBlog

MAY 5, 2021

Netflix Drive relies on a data store that will be the persistent storage layer for assets, and a metadata store which will provide a relevant mapping from the file system hierarchy to the data store entities. We will cover the different namespaces of Netflix Drive in more detail in a subsequent blog post. A sample manifest file.

Media 174

Media Storage Architecture Cloud 174

The Netflix TechBlog

MARCH 14, 2023

We must quickly surface the most stand-out highlights from the titles available on our service in the form of images and videos in the member experience. Dawn Chenette , Design Lead This approach had several benefits for product engineering. At the same time, we kept the design open enough to allow future extensibility.

Media 291

Media Innovation Energy Architecture 291

All Things Distributed

AUGUST 20, 2012

Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud â??

Storage 122

Storage Cloud AWS Media 122

Dynatrace

NOVEMBER 11, 2020

.” Meaning, you don’t need to worry about OneAgent updates because they’re performed automatically, safely, and promptly as soon as new versions are available (no manual effort required). Easier rollout thanks to log storage best practices. Easier rollout thanks to log storage best practices.

Best Practices 206

Best Practices Storage Java Benchmarking 206

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. Thanks to the migration to V2, we were able to improve data availability and usability for our consumers significantly.

Data Engineering 173

Data Engineering Engineering Big Data Software Engineering 173

ACM Sigarch

AUGUST 3, 2023

(Editor’s Note: This post was submitted as a rebuttal to Andrew Chien’s July 24 SIGARCH Blog Post ) The recent post “ Why Embodied Carbon is a poor Architecture Design metric, and Operational Carbon remains an important Problem ” by Prof. Chien’s blog post points to a paper by Bashir et al. Therefore, the $1.4B

Energy 98

Energy Architecture Hardware Metrics 98

Scalegrid

JULY 17, 2020

For the purposes of this blog, when we refer to JSON support in PostgreSQL, we will refer to JSONB going forward. JSONB storage has some drawbacks vs. traditional columns: PostreSQL does not store column statistics for JSONB columns. JSONB storage results in a larger storage footprint.

Storage 321

Storage Database Efficiency Processing 321

The Netflix TechBlog

FEBRUARY 9, 2022

The design of a cron job is simple, you take some system command, you pick the schedule to run it on and you are done. While all the above goals are our North Star, we also don’t want to negatively affect fast deployment, high availability and arbitrary life span of any deployed asset. workflow ?—?see

Storage 201

Storage Data Engineering Testing Code 201

Scalegrid

NOVEMBER 29, 2023

This blog post will explore some of the major challenges in database management that businesses can expect, especially when transitioning from traditional database servers. A DBaaS automates several processes, such as using, erasing, and spinning up storage without interventions from IT staff.

Healthcare 130

Healthcare Hardware Database Scalability 130

Official Blog - World Web Technology

NOVEMBER 27, 2023

You may have to put off learning web development and design. You can make a great website without coding or advanced web design skills. Anyone can use a good website builder, even if they don’t know web design. It depends on the best practices of web design. The news is positive. A website builder is an alternative.

Website 59

Website Development Mobile Storage 59

Dynatrace

AUGUST 27, 2020

Dynatrace’s ability to ingest metrics from all 95 AWS services will be available within the next 60 days. Those in the left column are readily available now, with those in the right available soon. Available Now. AWS Storage Gateway. Achieve full observability of all AWS services. Coming Soon. AWS AppSync.

AWS 274

AWS Cloud IoT Database 274

Dynatrace

SEPTEMBER 8, 2023

In part 1 of this blog series , we explored the concept of business observability, its significance, and how real-time visibility aids in making informed decisions. To achieve this, we’ll create a Grail bucket specifically designed to retain data for a duration of 10 years (3,657 days).

Database 277

Database Artificial Intelligence Metrics Monitoring 277

Dynatrace

JANUARY 23, 2024

Why growing AI adoption requires an AI observability strategy – blog While AI adoption brings operational efficiency and innovation for organizations, it also introduces the potential for runaway AI costs. Platform engineering: Empowering key Kubernetes use cases with Dynatrace – blog Digital transformation continues surging forward.

Performance 195

Performance DevOps Innovation Artificial Intelligence 195

The Netflix TechBlog

MARCH 7, 2023

These media focused machine learning algorithms as well as other teams generate a lot of data from the media files, which we described in our previous blog , are stored as annotations in Marken. The solution which we present in this blog is not limited to annotations and can be used for any other domain which uses ES and Cassandra as well.

Media 264

Media Latency Architecture Database 264

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. We designed DynamoDB to operate with at least 99.999% availability. In 2012, we launched Amazon DynamoDB, the successor to Amazon Dynamo.

Availability 145

Availability Performance Scalability AWS 145

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. The post Dynatrace adds support for VPC Flow Logs to Kinesis Data Firehose appeared first on Dynatrace blog. What is Amazon VPC Flow Logs to Kinesis Data Firehose, and why is it important?

Traffic 224

Traffic AWS Network Cloud 224

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. Storing frequently accessed data in faster storage, usually in-memory caching, improves data retrieval speed and overall system performance. Beyond

AWS 256

AWS Efficiency Azure Cloud 256

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host. The Kubernetes experience.

Virtualization 163

Virtualization Infrastructure Monitoring Cloud 163

Percona

MARCH 28, 2023

In this blog post, we will dive deep into WiredTiger’s Logging and Checkpoint mechanism. Every database system has to ensure durability and reliability. MongoDB uses classic Write-Ahead-Logging (WAL) using Journals and Checkpoints. Starting with the basics, why is WAL needed in the first place? wt list -c WiredTigerCheckpoint.33:

Hardware 88

Hardware C++ Storage Cache 88

Dynatrace

JULY 6, 2022

Virtualization has revolutionized system administration by making it possible for software to manage systems, storage, and networks. Design, implement, and tune effective SLOs. The post 5 SRE best practices you can implement today appeared first on Dynatrace blog. This number will likely increase as the SRE discipline matures.

Best Practices 196

Best Practices Open Source Tuning Infrastructure 196

Dynatrace

AUGUST 24, 2020

And because Dynatrace can consume CloudWatch metrics, almost all your AWS usage information is available to you within Dynatrace. Similarly, integrations for Azure and VMware are available to help you monitor your infrastructure both in the cloud and on-premises.

Analytics 249

Analytics Infrastructure AWS Operating System 249

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. This blog post will delve into the techniques leveraged at Netflix to introduce these changes to production.

Traffic 279

Traffic Metrics Systems Strategy 279

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. After being available in an Early Adopter Release, we’re happy to announce that AWS supporting services are now Generally Available (GA). Amazon Simple Storage Service (S3).

AWS 137

AWS Metrics IoT Storage 137