All Things Distributed

MAY 19, 2017

We decided to use our inventive powers to design and build a new database engine that would give database systems such as MySQL and PostgreSQL reliability and performance at scale, at a level that could serve even the most demanding OLTP applications.

Database 117

Database Design Cloud Storage 117

Percona

MAY 29, 2023

pgBackrest on the Main site streams backups and Write Ahead Logs (WALs) to the object storage. Once installed, configure the Custom Resource manifest so that pgBackrest starts using the Object Storage of your choice. Another aspect of automation is to switch the traffic for the application from Main to Standby after promotion.

Storage 120

Storage Cloud Network Traffic 120

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. By default, MongoDB provides a snappy block compression method for storage and network communication.

Storage 108

Storage Network Open Source Latency 108

Percona

APRIL 17, 2023

Since MongoDB usually works with a replica set, it is possible to increase this parameter to get better performance: # edit /etc/mongod.conf storage: journal: enabled: true commitIntervalMs: 300 WiredTiger cache For dedicated servers, it is possible to increase the WiredTiger(WT) cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

FEBRUARY 24, 2023

Benefits of Graviton2 Processors Best price performance for a broad range of workloads Extensive software support Enhanced security for cloud applications Available with managed AWS services Best performance per watt of energy used in Amazon EC2 Storage Continuing with the AWS example, choosing the right storage option will be key to performance.

Cloud 119

Cloud Serverless AWS Storage 119

KeyCDN

FEBRUARY 22, 2023

PWAs are designed to work offline, be fast, and provide a seamless user experience across different devices. Motion UI Motion UI is a design trend involving animation and other interactive elements to create a more dynamic and engaging user experience. They thus adapt to the user's browser, screen size, and device specifications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

Scalegrid

JANUARY 5, 2024

It was initially designed to mitigate the limitations of file management systems, including slow operations, inadequate security, and substantial data redundancy. However, some challenges may arise when scaling a DBMS, such as improper traffic distribution, inefficient database management, and performance issues.

Efficiency 147

Efficiency Storage Database Scalability 147

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. A second job taps the data feed from the first job, does tail sampling of data and writes traces to the storage system.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Scalegrid

JANUARY 12, 2024

Storage is a critical aspect to consider when working with cloud workloads. High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. What is an example of a workload?

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

JUNE 25, 2020

Minimized cross-data center network traffic. Dynatrace Managed Premium High Availability provides cost savings in terms of compute and storage allocations. By utilizing embedded smart routing capabilities, Dynatrace minimizes cross-region network traffic—OneAgent traffic stays within the same network region. How it works.

Availability 253

Availability Hardware Latency Traffic 253

Dynatrace

NOVEMBER 22, 2021

EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. With EC2, Amazon manages the basic compute, storage, networking infrastructure and virtualization layer, and leaves the rest for you to manage: OS, middleware, runtime environment, data, and applications. AWS Lambda.

Best Practices 220

Best Practices AWS Monitoring Serverless 220

Percona

MAY 1, 2023

Recently I was engaged in a MySQL Performance Audit for a customer to help troubleshoot performance issues that led to downtime during periods of high traffic on their AWS RDS MySQL instances. This message is normally a side effect of a storage subsystem that is not capable of keeping up with the number of writes (e.g.,

AWS 120

AWS Hardware Storage Tuning 120

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables). Endpoint monitoring (EM). Endpoints can be physical (i.e., PC, smartphone, server) or virtual (virtual machines, cloud gateways).

Monitoring 213

Monitoring Social Media IoT Metrics 213

Scalegrid

JANUARY 8, 2024

Discover key insights and strategic advice in our article, designed to steer you toward the best cloud solution that fits your company’s priorities. Multicloud harnesses diverse cloud services to boost flexibility, while hybrid cloud merges public and private clouds for enhanced control.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To support the demands of our stakeholders we designed a Domain Specific Language (DSL) that we call an asset generation recipe.

Engineering 165

Engineering Storage Latency Entertainment 165

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. One of the first decisions when integrating with Elasticsearch is designing the indices, their settings and mappings. We also utilize Kafka to process these assets asynchronously without impacting our real time traffic.

Strategy 258

Strategy Cache Analytics Storage 258

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails. This flexibility can be crucial in designing a scalable architecture.

Availability 108

Availability Database Open Source Hardware 108

Scalegrid

JANUARY 8, 2024

Infrastructure Excellence ScaleGrid’s infrastructure is designed to facilitate hosting in your cloud account and provides cost-saving options with AWS or Azure Reserved Instances or GCP. This results in faster response times and reduced network traffic, enhancing the overall efficiency and effectiveness of cloud services.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

NOVEMBER 3, 2022

When a new leader is elected it loads all data from external storage. With traffic growth, a single leader node handling all request volume started becoming overloaded. Designing Data-Intensive Applications is an excellent book that goes into detail about consistency models discussed in this blog post. queries/sec.

Cache 224

Cache Latency Traffic Systems 224

The Netflix TechBlog

NOVEMBER 2, 2021

For example, when we design a new version of VMAF, we need to effectively roll it out throughout the entire Netflix catalog of movies and TV shows. This article explains how we designed microservices and workflows on top of the Cosmos platform to bolster such video quality innovations.

Media 171

Media Innovation Metrics Latency 171

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. It will also allow us to redirect read/write traffic to the primary and read-only traffic to all secondaries.

Traffic 124

Traffic Scalability Database Servers 124

Percona

AUGUST 22, 2023

Load balancing: Traffic is distributed across multiple servers to prevent any one component from becoming overloaded. Load balancers can detect when a component is not responding and put traffic redirection in motion. Architecture for fault-tolerant systems Fault-tolerant information systems are designed to offer 100% availability.

Availability 79

Availability Hardware Open Source Database 79

Percona

SEPTEMBER 1, 2023

To address these challenges, architects must design robust and scalable MongoDB databases and adopt appropriate sharding strategies that can efficiently handle increasing workloads while ensuring continuous availability. 3) Storage engine limitations There are a few storage engine limitations that can be a bottleneck in your use case.

Best Practices 72

Best Practices Traffic Database Servers 72

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target. In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix shares how Amazon EC2 Auto Scaling allows its infrastructure to automatically adapt to changing traffic patterns in order to keep its audience entertained and its costs on target. In this talk, we share how Netflix deploys systems to meet its demands, Ceph’s design for high availability, and results from our benchmarking.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

JULY 7, 2023

Where a high availability design once worked well, it can no longer keep up with more complex requirements. The majority of SPOFs are a consequence of scale, where designs that were once adequate (excellent, even) no longer meet evolving, more complex requirements. Can you afford that recovery time?

Availability 84

Availability Open Source Architecture Database 84

Scalegrid

JANUARY 25, 2024

Understanding Redis Performance Indicators Redis is designed to handle high traffic and low latency with its in-memory data store and efficient data structures. offers the Software Watchdog specifically designed for this purpose. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

Percona

AUGUST 30, 2023

An incremental backup, which is faster and requires less storage than a full backup, captures changes made since the previous backup. Some of them include: Redundant hardware: Both HA and DR use redundant hardware components, including servers and storage devices. It’s suitable for databases with moderate change rates.

Database 88

Database Hardware Open Source Strategy 88

IO River

NOVEMBER 2, 2023

What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Fundamentally, internet traffic can be broadly categorized into static and dynamic content. Let’s analyze how you can achieve this win-win as effectively as possible!‍What

Architecture 52

Architecture Performance Internet Internet 52

Scalegrid

DECEMBER 16, 2019

While adequate for low-traffic applications, small databases, and dev/test environments, we recommend against leveraging shared clusters for your MongoDB production deployments. DigitalOcean specialized in SSD-based virtual machines called Droplets that are broken down into four simple categories. Managed MongoDB Hosting on DigitalOcean.

Azure 187

Azure AWS Latency Database 187

O'Reilly Software

APRIL 30, 2018

Harnessing DNS for traffic steering, load balancing, and intelligent response. When designing cloud architecture, it’s critical to consider that your applications could be affected by failures and that you must be prepared to respond to those failures quickly and effectively.

Cloud 68

Cloud Traffic Internet Internet 68

High Scalability

JULY 20, 2018

DonHopkins : NeWS differs from the current technology stack in that it was all coherently designed at once by James Gosling and David Rosenthal, by taking several steps back and thinking deeply about all the different problems it was trying to solve together. Some are lucky enough to also have a production environment." Not so many this week.

Internet 121

Internet Internet Scalability Automotive 121

Tech News Gather

JUNE 16, 2023

Building a successful UberEats clone requires a well-planned strategy that takes into account various aspects, including market research, feature prioritization, intuitive design, robust development, and targeted marketing campaigns. Choose a robust technology stack that can handle high traffic and accommodate future growth.

Social Media 52

Social Media Tuning Strategy Media 52

Percona

JULY 1, 2023

With its support for MySQL and PostgreSQL, and its automated replication and backup capabilities, it’s designed to deliver high performance, scalability, and availability to meet the needs of mission-critical applications. This eliminates the need for complex or scripted backup procedures and designated backup windows.

AWS 52

AWS Database Serverless Storage 52

CSS - Tricks

SEPTEMBER 21, 2020

Rather than a file (like an image) needing to travel across the world, it comes from a server much geographically closer on a server designed for that job. There has got to be a balance between the propagation and duplicative storage as far as the savings that would be realized by the efficiency of saving requests. Website traffic.

Website 97

Website Energy Storage Efficiency 97

IO River

NOVEMBER 2, 2023

‍What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Fundamentally, internet traffic can be broadly categorized into static and dynamic content. Let’s analyze how you can achieve this win-win as effectively as possible!‍What

Architecture 52

Architecture Performance Internet Internet 52