Scalegrid

MARCH 28, 2024

Introduction Caching serves a dual purpose in web development – speeding up client requests and reducing server load. Redis Revealed: An Overview Redis, a renowned open-source, in-memory remote dictionary server, stands out for its diverse data structures and advanced features. Memcached’s primary strength lies in its simplicity.

Cache 130

Cache Storage Scalability Architecture 130

The Morning Paper

NOVEMBER 15, 2020

Achieving 100 Gbps intrusion prevention on a single server , Zhao et al., This stems from a combination of Jevon’s paradox and the interconnectedness of systems – doing more in one area often leads to a need for more elsewhere too. With more nodes and more coordination comes more complexity, both in design and operation.

Servers 128

Servers Hardware Latency Design 128

Dynatrace

JANUARY 31, 2024

GenAI is prone to erratic behavior due to unforeseen data scenarios or underlying system issues. Dynatrace provides end-to-end observability of AI applications As AI systems grow in complexity, a holistic approach to the observability of AI-powered applications becomes even more crucial.

Cache 212

Cache Azure Infrastructure Monitoring 212

Dynatrace

JANUARY 17, 2024

An AI observability strategy—which monitors IT system performance and costs—may help organizations achieve that balance. AI observability is the use of artificial intelligence to capture the performance and cost details generated by various systems in an IT environment. Additionally, organizations need to consider AI observability.

Strategy 230

Strategy Artificial Intelligence Storage Cloud 230

InfoQ

JANUARY 26, 2024

Discord optimized its platform to serve over one million online users in a single server while maintaining a responsive user experience. By Rafal Gancarz

Servers 103

Servers Tuning Scalability Performance 103

The Netflix TechBlog

JUNE 13, 2023

This is where large-scale system migrations come into play. By collecting and analyzing key performance metrics of the service over time, we can assess the impact of the new changes and determine if they meet the availability, latency, and performance requirements. But what happens when this machinery needs a transformation?

Traffic 279

Traffic Metrics Systems Strategy 279

Dynatrace

DECEMBER 15, 2022

This transition to public, private, and hybrid cloud is driving organizations to automate and virtualize IT operations to lower costs and optimize cloud processes and systems. Besides the traditional system hardware, storage, routers, and software, ITOps also includes virtual components of the network and cloud infrastructure.

Artificial Intelligence 211

Artificial Intelligence DevOps Hardware Virtualization 211

Dynatrace

JULY 24, 2023

Answer-driven DevOps automation goes beyond creating tickets and extends to executing workflows designed to extract ownership information and then route the ticket to the responsible teams. Consider an event-driven automation system designed for incident management. But it doesn’t stop there.

DevOps 228

DevOps Traffic Efficiency Servers 228

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

Smashing Magazine

MAY 16, 2022

Rethinking Server-Timing As A Critical Monitoring Tool. Rethinking Server-Timing As A Critical Monitoring Tool. In the world of HTTP Headers, there is one header that I believe deserves more air-time and that is the Server-Timing header. Setting Server-Timing. Sean Roberts. 2022-05-16T10:00:00+00:00.

Servers 93

Servers Monitoring Cache Network 93

The Netflix TechBlog

AUGUST 29, 2023

Today we have a wealth of tools, both OSS and commercial, all designed for cloud-native environments. To improve availability, we designed systems where components could fail separately and avoid single points of failure. There is a downside to fetching this data on-demand: this adds latency to the first request to a cluster.

Traffic 220

Traffic Latency Cloud C++ 220

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 103

Database Benchmarking Latency C++ 103

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The first generation of this system went live with the streaming launch in 2007. Delivery?—?A

Serverless 228

Serverless Media Latency Social Media 228

Brendan Gregg

JULY 4, 2021

I summarized these topics and more as a plenary conference talk, including my own predictions (as a senior performance engineer) for the future of computing performance, with a focus on back-end servers. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book. Ford, et al., “TCP

Performance 140

Performance Latency Hardware Storage 140

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Scalegrid

JANUARY 8, 2024

Artificial intelligence can automate tasks ranging from: data analysis resource provisioning system maintenance decision-making natural language processing This not only improves accuracy and reliability but also frees up valuable time for IT teams to focus on strategic tasks, such as resource management on platforms like Google Cloud.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

The Netflix TechBlog

FEBRUARY 9, 2021

The whole system was quite complex, and starting to become brittle. The API server orchestrates backend systems to authenticate the user. Upstream systems had to reopen the tokens to identify the user logging in and potentially manage multiple parallel identity data structures, which could easily get out of sync.

Architecture 221

Architecture Latency Servers Website 221

Alex Russell

FEBRUARY 28, 2022

Tim Berners-Lee tweets that 'This is for everyone' at the 2012 Olympic Games opening ceremony using the NeXT computer he used to build the first browser and web server. These steps inform a general description of the interaction loop: The system is ready to receive input. The system is ready to receive input.

Performance 104

Performance Latency Architecture Network 104

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. AWS continues to improve how it handles latency issues. What is AWS Lambda?

Lambda 186

Lambda AWS Serverless Hardware 186

Percona

APRIL 13, 2023

PostgreSQL is a popular open source relational database management system that is widely used for storing and managing data. In PostgreSQL, replication lag can occur due to various reasons such as network latency, slow disk I/O, long-running transactions, etc. What is replication lag?

Latency 80

Latency Tuning Open Source Network 80

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Such demanding use cases place a great value on systems capable of fast and reliable execution, a need that spans across various industry segments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Morning Paper

JANUARY 30, 2020

Edge servers are the middle ground – more compute power than a mobile device, but with latency of just a few ms. The kind of edge server envisaged here might, for example, be integrated with your WiFi access point. As such, web workers are a natural target to offload to a more powerful server.

Mobile 104

Mobile Cloud Latency Games 104

Dynatrace

JUNE 25, 2020

The network latency between cluster nodes should be around 10 ms or less. For Premium HA, this has been extended from 10 ms latency (in the same network region) to around 100 ms network latency due to asynchronous data replication between regions. In the image below, three downed nodes make an entire cluster unavailable.

Availability 253

Availability Hardware Latency Traffic 253

ACM Sigarch

MARCH 25, 2019

How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? The M/M/1 queue will show us a required trade-off among (a) allowing unscheduled task arrivals, (b) minimizing latency, and (c) maximizing throughput.

Systems 53

Systems Latency Performance C++ 53

Percona

JULY 20, 2023

It is very common to see many infrastructure layers standing between a PostgreSQL database and the Application server. At Percona Support, we use pg_gather as the method to collect and study the wait events because it is a standalone SQL script and doesn’t need to install anything on the database systems.

Network 62

Network Performance Latency Servers 62

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. The recently announced CXL3.0

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., Systems built with lots of microservices have different operational characteristics to those built from a small number of monoliths, we’d like to study and better understand those differences.

Open Source 61

Open Source Hardware Benchmarking Systems 61

The Netflix TechBlog

AUGUST 16, 2023

By Arthur Gonigberg , Argha C Plaintext Past When Zuul was designed and developed , there was an inherent assumption that connections were effectively free, given we weren’t using mutual TLS (mTLS). For example, a 16-core box connecting to an 800-server origin would have 12,800 connections.

Traffic 170

Traffic Servers Google Metrics 170

SQL Performance

SEPTEMBER 17, 2019

Many database administrators find themselves having to support instances of SQL Server Reporting Services (SSRS), or at least the backend databases that are required for SSRS. These topics apply to both SQL Server Reporting Services as well as Power BI Report Server. Installation and support of SSRS can be confusing.

Tuning 67

Tuning Servers Database Best Practices 67

High Scalability

SEPTEMBER 8, 2018

The issue is that Anna is now orders of magnitude more efficient than competing systems, in addition to being orders of magnitude faster. The core component in Anna v11 is a monitoring system & policy engine that together enable workload-responsiveness and adaptability.

Storage 199

Storage Performance AWS Efficiency 199

The Netflix TechBlog

SEPTEMBER 8, 2020

For each route we migrated, we wanted to make sure we were not introducing any regressions: either in the form of missing (or worse, wrong) data, or by increasing the latency of each endpoint. Being able to canary a new route let us verify latency and error rates were within acceptable limits. This meant that data that was static (e.g.

Latency 233

Latency Cache Java Traffic 233

The Morning Paper

FEBRUARY 6, 2020

’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

Particular Software

SEPTEMBER 20, 2021

Some will claim that any type of RPC communication ends up being faster (meaning it has lower latency) than any equivalent invocation using asynchronous messaging. But to be fair, we also have to process the messages on the server before we can consider the messaging case to be complete. So we’ll just use “RPC” for short.

Benchmarking 97

Benchmarking Latency Servers Systems 97

The Morning Paper

OCTOBER 26, 2020

As a production system within Microsoft capturing around a quadrillion events and indexing 16 trillion search keys per day it would be interesting in its own right, but there’s a lot more to it than that. These two narratives of reference architecture and ingestion/indexing system are interwoven throughout the paper.

Cloud 104

Cloud Big Data Latency Architecture 104

The Morning Paper

MAY 19, 2019

Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. So what we have here is a glimpse of the limits for low-latency RPCs under load.

Latency 80

Latency Hardware Network Architecture 80

Dynatrace

APRIL 26, 2022

STM generates traffic that replicates the typical path or behavior of a user on a network to measure performance for example, response times, availability, packet loss, latency, jitter, and other variables). PC, smartphone, server) or virtual (virtual machines, cloud gateways). Endpoints can be physical (i.e.,

Monitoring 213

Monitoring Social Media IoT Metrics 213

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). To reduce latency, assets should be generated in an offline fashion and not in real time. Localized images for each of the titles.

Engineering 165

Engineering Storage Latency Entertainment 165