Bandwidth or Latency: When to Optimise for Which

CSS Wizardry

When it comes to network performance, there are two main limiting factors that will slow you down: bandwidth and latency. Latency is defined as…. Where bandwidth deals with capacity, latency is more about speed of transfer 2. As a web user—often transferring lots of smaller files—reductions in latency will almost always be a welcome improvement. and reduction in latency. This lower number is effectively your latency. Put another way, latency cost us 24.6×

Taskbar Latency and Kernel Calls

Randon ASCII

I work quickly on my computer and I get frustrated when I am forced to wait on an operation that should be fast. A persistent nuisance on my over-powered home laptop is that closing windows on the taskbar is slow. I right-click on an entry, wait for the menu to appear, and then select “Close window”. The mouse movement should be the slow part of this but instead I find that the delay before the menu appears is the longest component.

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Varnish and BBR: Lower Latency OTT Video Delivery

DZone

Currently, publicly available wifi hotspots are the preferred networks for video consumption, but poor network infrastructure also leads to unbearable video buffering and latency. When delivering video over-the-top (OTT), the internet is the principal highway for distributing this content. However, OTT streaming delivery requires something faster than what the internet offers in terms of how chunks/fragments are supposed to flow.

Cross rack network latency in AWS

n0derunner

The post Cross rack network latency in AWS appeared first on n0derunner. I have VMs running on bare-metal instances. Each bare-metal instance is in a separate rack by design (for fault tolerance). The bandwidth is 25GbE however, the response time between the hosts is so high that I need multiple streams to consume that bandwidth. Compared to my local on-prem lab I need many more streams to. Workloads & Benchmarks aws networking

SLOG: serializable, low-latency, geo-replicated transactions

The Morning Paper

SLOG: serializable, low-latency, geo-replicated transactions Ren et al., That’s where SLOG (Serializable LOw-latency, Geo-replicated transactions) comes in. SLOG achieves high throughput, strictly serializable ACID transactions at geo-replicated scale for all transactions submitted across the world, all the while achieving low latency for transactions that initiate from a location close to the home region for data they access.

Uber’s Big Data Platform: 100+ Petabytes with Minute Latency

Uber Engineering

To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog. Uber is committed to delivering safer and more reliable transportation across our global markets.

Best MySQL DigitalOcean Performance – ScaleGrid vs. DigitalOcean Managed Databases

Scalegrid

Compare Latency. On average, ScaleGrid achieves almost 30% lower latency over DigitalOcean for the same deployment configurations. To ensure the most accurate results in our performance tests, we run the benchmark four times for each comparison to find the average performance across throughput and latency over read-intensive workloads, balanced workloads, and write-intensive workloads. Latency. Read-Intensive Latency Benchmark. Write-Intensive Latency Benchmark.

Comparing PostgreSQL DigitalOcean Performance & Pricing – ScaleGrid vs. DigitalOcean Managed Databases

Scalegrid

Compare Latency. lower latency compared to DigitalOcean for PostgreSQL. Now, let’s take a look at the throughput and latency performance of our comparison. Latency. Next, we are going to test and compare the latency performance between ScaleGrid and DigitalOcean for PostgreSQL. Latency is the average transaction execution time of your PostgreSQL data. lower latency across all workload types compared to DigitalOcean for PostgreSQL.

Memory Latency on the Intel Xeon Phi x200 “Knights Landing” processor

John McCalpin

The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. It is also important to remember that the latency can be different for each physical address, depending on the location of the requesting core, the location of the coherence agent responsible for that address, and the location of the memory controller for that address. MCDRAM maximum latency (ns) 156.1

This spring: High-Performance and Low-Latency C++ (Stockholm) and ACCU (Bristol)

Sutter's Mill

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” This intensive three day course will provide developers with the knowledge and skills required to write high-performance and low-latency code on today’s modern systems using modern C++11/14/17.

Latency: Will it undermine the most interesting 5G use cases?

VoltDB

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. This requires 1 ms network latency.

Latency: Will it undermine the most interesting 5G use cases?

VoltDB

Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. This requires 1 ms network latency.

RSocket vs. gRPC Benchmark

DZone

java performance scalability latency cpu grpc rpc qpsAlmost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out.

Best Practice for Creating Indexes on your MySQL Tables

Scalegrid

95th Percentile Latency. The 95th percentile latency of queries was also 1.8 By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries. But, did you know that adding indexes to your tables in itself is an expensive operation, and may take a long time to complete depending on the size of your tables?

The Best Way to Host MongoDB on DigitalOcean

Scalegrid

We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. They even offer amazingly low latency from Amazon AWS US-East to the DigitalOcean New York datacenter, which is great for applications that are running their front on mid-tier on AWS, but would like to use DigitalOcean for their MongoDB clusters.

ScyllaDB Trends – How Users Deploy The Real-Time Big Data Database

Scalegrid

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. Released just four years ago in 2015, Scylla has averaged over 220% year-over-year growth in popularity according to DB-Engines.

PostgreSQL Connection Pooling: Part 1 – Pros & Cons

Scalegrid

While there is plenty of well-documented benefits to using a connection pooler, there are some arguments to be made against using one: Introducing a middleware in the communication inevitably introduces some latency. A long time ago, in a galaxy far far away, ‘threads’ were a programming novelty rarely used and seldom trusted. In that environment, the first PostgreSQL developers decided forking a process for each connection to the database is the safest choice.

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

High Scalability

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

AWS 157

How Server Location Affects your Users’ Experience

DZone

performance user experience location data website performance monitoring latency monitorSo you finally launched your service worldwide, great! The next thing you’ll see is thousands and thousands of people flooding into your amazing website from all corners of the world expecting to have the same experience regardless of their location. Here is where things get tricky.

The Surprising Effectiveness of Non-Overlapping, Sensitivity-Based Performance Models

John McCalpin

This system also had significantly lower memory latency than many contemporary systems (which were still using front-side bus architectures and separate “NorthBridge” chips). In the 2007 SPECfp_rate tests, a similar phenomenon was seen, and required the addition of a third component to the model: memory latency. In these tests, we did not have the same ability to vary memory latency that I had with the 2007 Opteron systems.

Self-Host Your Static Assets

CSS Wizardry

Every new origin we need to visit needs a connection opening, and that can be very costly: DNS resolution, TCP handshakes, and TLS negotiation all add up, and the story gets worse the higher the latency of the connection is. Okay, so not exactly terrifying, but Trainline, a client of mine, found that by reducing latency by 300ms, customers spent an extra £8m a year. On a slower, higher-latency connection, the story is much, mush worse.

Cache 219

New Year’s Updates

John McCalpin

This week I updated three of those posts — two really old ones (primarily of interest to computer architecture historians), and one from 2018: July 2012: Local and Remote Memory Latency on AMD Processors in 2-socket and 4-socket servers. Computer Architecture Performance memory bandwidth memory latency Xeon PhiAs part of my attempt to become organized in 2019, I found several draft blog entries that had never been completed and made public.

MySQL on Azure Performance Benchmark – ScaleGrid vs. Azure Database

Scalegrid

In this blog post, we compare Azure Database for MySQL vs. ScaleGrid MySQL on Azure so you can see which provider offers the best throughput and latency performance. We measure latency in ms 95th percentile latency. Latency. Latency. Latency.

Azure 166

Real-World Effectiveness of Brotli

CSS Wizardry

This is because file-size is only one aspect of web performance, and whatever the file-size is, the resource is still sat on top of a lot of other factors and constants—latency, packet loss, etc. Put another way, file-size savings help you to cram data into lower bandwidth, but if you’re latency-bound, the speed at which those admittedly fewer chunks of data arrive will not change.

How to Improve MySQL AWS Performance 2X Over Amazon RDS at The Same Cost

DZone

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. cloud performance sql aws mysql amazon replication latency amazon rds throughputImprove AWS performance! AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

Invited Talk at SuperComputing 2016!

John McCalpin

Computer Architecture Computer Hardware Performance cache DRAM high performance computing memory bandwidth memory latency STREAM benchmark“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm).

MySQL on Azure Performance Benchmark – ScaleGrid vs. Azure Database

High Scalability

In this blog post, we compare Azure Database for MySQL vs. ScaleGrid MySQL on Azure so you can see which provider offers the best throughput and latency performance. We measure latency in ms 95th percentile latency.

Azure 146

Performing a Load Test on SQL Server using Apache JMeter

SQL Shack

This test type enables us to measure the application behaviors under specific conditions so that it enables us to observe a variety of resource consumptions (CPU, memory, latency, response times, etc) and it also helps to […].

PostgreSQL Connection Pooling: Part 1 – Pros & Cons

High Scalability

It is difficult to fault their argument – as it’s absolutely true that: Connection Pool Connection Pooler Connection Pooling Database DevOps Forking Language Library Latency Linux Multithreaded Performance Postgres Web Applications administrator application architecture cluster connection-pool database database performance online website deployment developer failure multilanguage multithreading open source postgresql sql

Why Telcos Need a Real-Time Analytics Strategy

VoltDB

No Compromises Performance Personalization Real-time low latency real-time analytics telco telco strategy telecomHistorically, telco analytics have been limited and difficult. Telco networks and the systems that support those networks are some of the most advanced technology solutions in existence.

Why Telcos Need a Real-Time Analytics Strategy

VoltDB

No Compromises Performance Personalization Real-time Vlog low latency real-time analytics telco telco strategy telecomHistorically, telco analytics have been limited and difficult. Telco networks and the systems that support those networks are some of the most advanced technology solutions in existence.

Best Practice for Creating Indexes on your MySQL Tables

High Scalability

AWS Add Index Azure Create Index Database DevOps EC2 Latency Master-Slave MySQL MySQL Index MySQL Performance MySQL Table Performance Performance Test SELECT Queries administration benchmark benchmarks best platform cloud data management database database replication database scalability deployment ec2 high availability hosting indexing master-slave mysql mysql cluster mysql load nodes optimization scalabitliy sql testing uptime

Dropbox Improves Sync Performance Using a Modified Brotli

InfoQ

This reduced median latency and data transfer by more than 30%, Dropbox engineers Rishabh Jain and Daniel Reiter Horn maintain.

Expanding the Cloud: Faster, More Flexible Queries with DynamoDB

All Things Distributed

While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. Consistent, rock solid low-latency database performance is important too, because social games are highly interactive. s will exhibit the same latency and throughput performance as those without any indexes. All Things Distributed.

Games 67

Reducing Your Database Hosting Costs: DigitalOcean vs. AWS vs. Azure

Scalegrid

Does it affect latency? Yes, you can see an increase in latency. So, if you’re hosting your application in AWS or Azure and move your database to DigitalOcean, you will see an increase in latency. However, the average latencies between AWS US-East and the DigitalOcean New York datacenter locations are typically only 17.4

Azure 207

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption

The Morning Paper

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity.

Time to First Byte: What It Is and Why It Matters

CSS Wizardry

The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. The reason is because mobile networks are, as a rule, high latency connections. If there is one key thing I’m keen for your to take from this post, its is that TTFB is affected by latency. Last mile latency deals with the disproportionate complexity toward the terminus of a connection.

Cloud infrastructure monitoring in action: Dynatrace on Dynatrace

Dynatrace

Sydney, we have a disk write latency problem! It was on August 25 th at 14:00 when Davis initially alerted on a disk write latency issues to Elastic File System (EFS) on one of our EC2 instances in AWS’s Sydney Data Center. Dynatrace news.

Who will watch the watchers? Extended infrastructure observability for WSO2 API Manager

Dynatrace

High latency or lack of responses. You receive an alert message from Dynatrace (your infrastructure observability hub) letting you know that the average response latency of all deployed APIs has tripled. This increase is clearly correlated with the increased response latencies.

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region.

AWS 63

The Fastest Google Fonts

CSS Wizardry

On a high-latency connection, this spells bad news. However, the execution of this header is bound by the response’s TTFB, which on high-latency networks can be very, very high. Put another-other way, this file is latency-bound, not bandwidth-bound.

Google 219

Memory-Optimized TempDB Metadata in SQL Server 2019

SQL Shack

TempDB is one of the biggest sources of latency in […]. Introduction In-memory technologies are one of the greatest ways to improve performance and combat contention in computing today. By removing disk-based storage and the challenge of copying data in and out of memory, query speeds in SQL Server can be improved by orders of magnitude. Migration Performance SQL Server 2019

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. Operation costs are often different based on location and, as such, the pricing for services may vary somewhat between Regions, giving our customers the power to make trade-offs between, for example, cost and latency. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 60