article thumbnail

Comparing Approaches to Durability in Low Latency Messaging Queues

DZone

Little’s Law and Why Latency Matters. In many cases, the assumption is that as long as throughput is high enough, the latency won’t be a problem. However, latency is often a key factor in why the throughput isn’t high enough A significant feature of Chronicle Queue Enterprise is support for TCP replication across multiple servers to ensure the high availability of application infrastructure.

Latency 216
article thumbnail

Simulate Network Latency and Packet Drop In Linux

DZone

There may be a scenario when you want to test an application when the network is slow(we also call it high network latency). Or you are reproducing a customer scenario(having high network latency) where some anomalous behavior is observed. In the Chrome browser, we can easily Simulate a slower network connection. This is very helpful when we are working with web applications. But we can also have non-web applications, like web-service applications, messaging brokers , etc.

Latency 121
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Timestone: Netflix’s High-Throughput, Low-Latency Priority Queueing System with Built-in Support…

The Netflix TechBlog

We see 30K dequeue requests per second (RPS) with a P99 latency of 45ms. enqueue RPS at 25ms P99 latency. We regularly see 5K RPS enqueue bursts at 85ms P99 latency.

Latency 187
article thumbnail

Bandwidth or Latency: When to Optimise for Which

CSS Wizardry

When it comes to network performance, there are two main limiting factors that will slow you down: bandwidth and latency. Latency is defined as…. Where bandwidth deals with capacity, latency is more about speed of transfer 2. As a web user—often transferring lots of smaller files—reductions in latency will almost always be a welcome improvement. and reduction in latency. This lower number is effectively your latency. Put another way, latency cost us 24.6×

Latency 122
article thumbnail

Taskbar Latency and Kernel Calls

Randon ASCII

I work quickly on my computer and I get frustrated when I am forced to wait on an operation that should be fast. A persistent nuisance on my over-powered home laptop is that closing windows on the taskbar is slow. I right-click on an entry, wait for the menu to appear, and then select “Close window”. The mouse movement should be the slow part of this but instead I find that the delay before the menu appears is the longest component.

Latency 66
article thumbnail

Varnish and BBR: Lower Latency OTT Video Delivery

DZone

Currently, publicly available wifi hotspots are the preferred networks for video consumption, but poor network infrastructure also leads to unbearable video buffering and latency. When delivering video over-the-top (OTT), the internet is the principal highway for distributing this content.

Latency 141
article thumbnail

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog. Uber is committed to delivering safer and more reliable transportation across our global markets.

article thumbnail

Cross rack network latency in AWS

n0derunner

The post Cross rack network latency in AWS appeared first on n0derunner. I have VMs running on bare-metal instances. Each bare-metal instance is in a separate rack by design (for fault tolerance). The bandwidth is 25GbE however, the response time between the hosts is so high that I need multiple streams to consume that bandwidth. Compared to my local on-prem lab I need many more streams to. Workloads & Benchmarks aws networking

Latency 40
article thumbnail

Best MySQL DigitalOcean Performance – ScaleGrid vs. DigitalOcean Managed Databases

Scalegrid

Compare Latency. On average, ScaleGrid achieves almost 30% lower latency over DigitalOcean for the same deployment configurations. Latency. Now that we’ve compared throughput performance, let’s take a look at ScaleGrid vs. DigitalOcean latency for MySQL.

Database 137
article thumbnail

Memory Latency on the Intel Xeon Phi x200 “Knights Landing” processor

John McCalpin

The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. It is also important to remember that the latency can be different for each physical address, depending on the location of the requesting core, the location of the coherence agent responsible for that address, and the location of the memory controller for that address. MCDRAM maximum latency (ns) 156.1

Latency 40
article thumbnail

This spring: High-Performance and Low-Latency C++ (Stockholm) and ACCU (Bristol)

Sutter's Mill

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” This intensive three day course will provide developers with the knowledge and skills required to write high-performance and low-latency code on today’s modern systems using modern C++11/14/17.

Latency 62
article thumbnail

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

Scalegrid

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. ScaleGrid’s MySQL on AWS High Performance deployment can provide 2x-3x the throughput at half the latency of Amazon RDS for MySQL with their added advantage of having 2 read replicas as compared to 1 in RDS. MySQL on AWS Latency Performance Test Averages.

AWS 115
article thumbnail

Comparing PostgreSQL DigitalOcean Performance & Pricing – ScaleGrid vs. DigitalOcean Managed Databases

Scalegrid

Compare Latency. lower latency compared to DigitalOcean for PostgreSQL. Now, let’s take a look at the throughput and latency performance of our comparison. Latency. Latency is the average transaction execution time of your PostgreSQL data.

Database 143
article thumbnail

Top 4 Technical Challenges for Fantasy Sports Apps

VoltDB

Hyper-Personalization Latency Scalability data platform fantasy sports fantasy sports apps gaming platforms hyper-personalization latency scalabilityThe post Top 4 Technical Challenges for Fantasy Sports Apps appeared first on Volt Active Data.

Games 52
article thumbnail

Ensure Ideal Performance and Access for All Your Customers, Everywhere [Webinar Sign-up]

DZone

We want to make scale, availability and low latency access to data as easy as possible for everyone, and it’s all about where your data lives. performance high availability cockroachdb low latency distributed data cockroach labs multi-region application multi-region database

Latency 207
article thumbnail

Single threaded DB performance on Nutanix HCI

n0derunner

SQL Server Workloads & Benchmarks aws diskspd fio latency rds sqlserver windowstl;dr A Nutanix cluster can persist a replicated write across two nodes in around 260 uSec (4KB IO using diskspd) which is critical for single-threaded DB write workloads.

article thumbnail

Starting an SRE Team? Stay Away From Uptime.

DZone

google business advice software engineering sre site reliability engineering latency traffic customer satisfaction uptime system healthA good SRE engineer will tell you your service is never down. A great SRE engineer will tell you that’s not what you should be measuring.

Traffic 206
article thumbnail

Latency: Will it undermine the most interesting 5G use cases?

VoltDB

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. This requires 1 ms network latency.

Latency 40
article thumbnail

Latency: Will it undermine the most interesting 5G use cases?

VoltDB

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. This requires 1 ms network latency.

Latency 40
article thumbnail

RSocket vs. gRPC Benchmark

DZone

java performance scalability latency cpu grpc rpc qpsAlmost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out.

article thumbnail

Redis on Azure Performance Benchmark – ScaleGrid for Redis™ vs. Azure Cache

Scalegrid

Performance REDIS Azure benchmark Latency Performance Benchmark Redis Redis Azure ThroughputRedis is an advanced key-value store. In fact, it is the number one key value store and eighth most popular database in the world.

Azure 130
article thumbnail

Native App Network Performance Analysis

DZone

performance latency performance engineering native app web analysis continuous deliver real user measurement client side performance device lab user performanceIntroduction.

Network 176
article thumbnail

Best Practice for Creating Indexes on your MySQL Tables

Scalegrid

95th Percentile Latency. The 95th percentile latency of queries was also 1.8 By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries. But, did you know that adding indexes to your tables in itself is an expensive operation, and may take a long time to complete depending on the size of your tables?

article thumbnail

How Server Location Affects your Users’ Experience

DZone

performance user experience location data website performance monitoring latency monitorSo you finally launched your service worldwide, great!

Servers 135
article thumbnail

Single threaded DB performance on Nutanix HCI

n0derunner

SQL Server Workloads & Benchmarks aws diskspd fio latency rds sqlserver windowstl;dr A Nutanix cluster can persist a replicated write across two nodes in around 250 uSec which is critical for single-threaded DB write workloads.

Metrics 52
article thumbnail

Single threaded DB performance on Nutanix HCI

n0derunner

SQL Server Workloads & Benchmarks aws diskspd fio latency rds sqlserver windowstl;dr A Nutanix cluster can persist a replicated write across two nodes in around 250 uSec which is critical for single-threaded DB write workloads.

Metrics 52
article thumbnail

PostgreSQL Connection Pooling: Part 1 – Pros & Cons

Scalegrid

While there is plenty of well-documented benefits to using a connection pooler, there are some arguments to be made against using one: Introducing a middleware in the communication inevitably introduces some latency. A long time ago, in a galaxy far far away, ‘threads’ were a programming novelty rarely used and seldom trusted. In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice.

article thumbnail

The Best Way to Host MongoDB on DigitalOcean

Scalegrid

We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. They even offer amazingly low latency from Amazon AWS US-East to the DigitalOcean New York datacenter, which is great for applications that are running their front on mid-tier on AWS, but would like to use DigitalOcean for their MongoDB clusters.

article thumbnail

ScyllaDB Trends – How Users Deploy The Real-Time Big Data Database

Scalegrid

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. Released just four years ago in 2015, Scylla has averaged over 220% year-over-year growth in popularity according to DB-Engines.

Big Data 120
article thumbnail

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

High Scalability

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

AWS 128
article thumbnail

The Surprising Effectiveness of Non-Overlapping, Sensitivity-Based Performance Models

John McCalpin

This system also had significantly lower memory latency than many contemporary systems (which were still using front-side bus architectures and separate “NorthBridge” chips). Computer Architecture Performance memory bandwidth memory latency STREAM benchmark

Energy 56
article thumbnail

Uber’s Next Gen Push Platform on gRPC

Uber Engineering

Uber’s API platform team talks about how they built their Next Generation Push Platform on gRPC which helped improve the reliability and latency of messages significantly.

article thumbnail

New Year’s Updates

John McCalpin

This week I updated three of those posts — two really old ones (primarily of interest to computer architecture historians), and one from 2018: July 2012: Local and Remote Memory Latency on AMD Processors in 2-socket and 4-socket servers. Computer Architecture Performance memory bandwidth memory latency Xeon PhiAs part of my attempt to become organized in 2019, I found several draft blog entries that had never been completed and made public.

Servers 40
article thumbnail

Self-Host Your Static Assets

CSS Wizardry

Every new origin we need to visit needs a connection opening, and that can be very costly: DNS resolution, TCP handshakes, and TLS negotiation all add up, and the story gets worse the higher the latency of the connection is. Okay, so not exactly terrifying, but Trainline, a client of mine, found that by reducing latency by 300ms, customers spent an extra £8m a year. On a slower, higher-latency connection, the story is much, mush worse.

Cache 216
article thumbnail

MySQL on Azure Performance Benchmark – ScaleGrid vs. Azure Database

Scalegrid

In this blog post, we compare Azure Database for MySQL vs. ScaleGrid MySQL on Azure so you can see which provider offers the best throughput and latency performance. We measure latency in ms 95th percentile latency. Latency. Latency. Latency.

Azure 233
article thumbnail

Redis vs. Memcached – 2021 Comparison

Scalegrid

Both Redis and Memcached are: NoSQL in-memory data structures Written in C Open source Used to speed up applications Support sub-millisecond latency In 2014, Salvatore wrote an excellent StackOverflow post on […].

Latency 184
article thumbnail

Using Pausers in Event Loops

DZone

Typically in low-latency development, a trade-off must be made between minimizing latency and avoiding excessive CPU utilization.

Latency 130
article thumbnail

Real-World Effectiveness of Brotli

CSS Wizardry

This is because file-size is only one aspect of web performance, and whatever the file-size is, the resource is still sat on top of a lot of other factors and constants—latency, packet loss, etc.

Latency 198
article thumbnail

Invited Talk at SuperComputing 2016!

John McCalpin

Computer Architecture Computer Hardware Performance cache DRAM high performance computing memory bandwidth memory latency STREAM benchmark“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm).

Systems 40
article thumbnail

uBuild: Fast and Safe Building of Thousands of Container Images

Uber Engineering

Our container image build team reveals how they safely build tens of thousands of container images every week to support our microservice architecture, explaining key performance optimizations that reduced build latencies dramatically.

article thumbnail

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

DZone

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. cloud performance sql aws mysql amazon replication latency amazon rds throughputImprove AWS performance! AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

article thumbnail

Expanding the Cloud: Faster, More Flexible Queries with DynamoDB

All Things Distributed

While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. Consistent, rock solid low-latency database performance is important too, because social games are highly interactive. s will exhibit the same latency and throughput performance as those without any indexes. All Things Distributed.

Games 70
article thumbnail

Understanding gRPC Concepts, Use Cases, and Best Practices

DZone

Though we are not worried about computing resources, the latency becomes an overhead. As we are progressing with application development, among various things, there is one primary thing we are less worried about: computing power.