Expert insights. Personalized for you.
Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager. MORE
java performance scalability latency cpu grpc rpc qpsAlmost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out. MORE
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments. MORE
Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” This intensive three day course will provide developers with the knowledge and skills required to write high-performance and low-latency code on today’s modern systems using modern C++11/14/17. MORE
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. Improve AWS performance! MORE
AWS Add Index Azure Create Index Database DevOps EC2 Latency Master-Slave MySQL MySQL Index MySQL Performance MySQL Table Performance Performance Test SELECT Queries administration benchmark benchmarks best platform cloud data management database database replication database scalability deployment ec2 high availability hosting indexing master-slave mysql mysql cluster mysql load nodes optimization scalabitliy sql testing uptime MORE
95th Percentile Latency. The 95th percentile latency of queries was also 1.8 By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries. MORE
Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector? MORE
Citrix platform performance—optimize your Citrix landscape with insights into user load and screen latency per server. Citrix latency represents the end-to-end “screen lag” experienced by a server’s users. ICA latency. Dynatrace news. MORE
Every new origin we need to visit needs a connection opening, and that can be very costly: DNS resolution, TCP handshakes, and TLS negotiation all add up, and the story gets worse the higher the latency of the connection is. MORE
That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. Oh, and in additional to low latency, “ we require access to fresh data.” MORE
While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. All Things Distributed. MORE
How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? Recall that latency —in units of time—is the time it takes to do a task (e.g., MORE
This week I updated three of those posts — two really old ones (primarily of interest to computer architecture historians), and one from 2018: July 2012: Local and Remote Memory Latency on AMD Processors in 2-socket and 4-socket servers. Computer Architecture Performance memory bandwidth memory latency Xeon PhiAs part of my attempt to become organized in 2019, I found several draft blog entries that had never been completed and made public. MORE
To deliver the real-time performance expected from Uber’s users, our mobile apps require low-latency and highly … The post Employing QUIC Protocol to Optimize Uber’s App Performance appeared first on Uber Engineering Blog. Uber operates on a global scale across more than 600 cities, with our apps relying entirely on wireless connectivity from over 4,500 mobile carriers. MORE
SLOG: serializable, low-latency, geo-replicated transactions Ren et al., That’s where SLOG (Serializable LOw-latency, Geo-replicated transactions) comes in. VLDB’19. SLOG is another research system motivated by the needs of the application developer (aka, user!). MORE
How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? Let L denoted the average total latency to handle a task, equal to Q + S. Low latency ? MORE
Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. MORE
I work quickly on my computer and I get frustrated when I am forced to wait on an operation that should be fast. A persistent nuisance on my over-powered home laptop is that closing windows on the taskbar is slow. I right-click on an entry, wait for the menu to appear, and then select “Close window”. MORE
The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. The reason is because mobile networks are, as a rule, high latency connections. MORE
The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. It is also important to remember that the latency can be different for each physical address, depending on the location of the requesting core, the location of the coherence agent responsible for that address, and the location of the memory controller for that address. MCDRAM maximum latency (ns) 156.1 MORE
Computer Architecture Computer Hardware Performance cache DRAM high performance computing memory bandwidth memory latency STREAM benchmark“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm). MORE
Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. MORE
When it comes to network performance, there are two main limiting factors that will slow you down: bandwidth and latency. Latency is defined as…. Where bandwidth deals with capacity, latency is more about speed of transfer 2. and reduction in latency. more than latency. MORE
We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. They even offer amazingly low latency from Amazon AWS US-East to the DigitalOcean New York datacenter, which is great for applications that are running their front on mid-tier on AWS, but would like to use DigitalOcean for their MongoDB clusters. MORE
From 11:48 to 12:10 latency for at least 50% of requests was significantly higher from us-east1 and us-central1 to GCS regional buckets in us-east1, us-central1, and europe-west2. From 11:48 to 12:03 latency was also elevated for europe-west2 to europe-west2 regional bucket access. MORE
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. ScaleGrid’s MySQL on AWS High Performance deployment can provide 2x-3x the throughput at half the latency of Amazon RDS for MySQL with their added advantage of having 2 read replicas as compared to 1 in RDS. MySQL on AWS Latency Performance Test Averages. MORE
This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. MORE
Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. The desire for CPU efficiency and lower latencies is easy to understand. Snap: a microkernel approach to host networking Marty et al., MORE
Although this response has a 0B filesize, we will always take the latency hit on every single page view (and this response is basically 100% latency). com , which introduces yet more latency for the connection setup. MORE
However, there is excitement around Starlink for other reasons – namely, the implications it might have for internet speed and latency – even by just a small amount (20 milliseconds on average). Starlink’s Goal: Reduce Internet Latency. Elon Musk’s need for speed. MORE
It is difficult to fault their argument – as it’s absolutely true that: Connection Pool Connection Pooler Connection Pooling Database DevOps Forking Language Library Latency Linux Multithreaded Performance Postgres Web Applications administrator application architecture cluster connection-pool database database performance online website deployment developer failure multilanguage multithreading open source postgresql sql MORE
The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The bottom line shows the tail latency impact in the microservices-based applications. MORE
Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. A case for managed and model-less inference serving Yadwadkar et al., HotOS’19. MORE
On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network. MORE
To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog. Uber is committed to delivering safer and more reliable transportation across our global markets. MORE
This system also had significantly lower memory latency than many contemporary systems (which were still using front-side bus architectures and separate “NorthBridge” chips). Computer Architecture Performance memory bandwidth memory latency STREAM benchmark MORE
The performance consists of two aspects: throughput and latency. Humans will wait much longer than an API will since APIs have strict latency expectations due to timeouts. But in most cases in modern applications, the application expectation is far less than the baked-in latency. MORE
While there is plenty of well-documented benefits to using a connection pooler, there are some arguments to be made against using one: Introducing a middleware in the communication inevitably introduces some latency. MORE
Unfortunately, this means that the age-old Telco bugbears will rear their ugly heads again, including latency. 5G, as a fundamental requirement, mandates a 1 millisecond latency from the datasource to its destination. With the 5G revolution, operators will need to manage hundreds of edge deployments, and maintain the physical space and hardware to achieve 1ms of latency. This requires 1 ms network latency. MORE
ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. Released just four years ago in 2015, Scylla has averaged over 220% year-over-year growth in popularity according to DB-Engines. MORE
No Compromises Performance Personalization Real-time Vlog low latency real-time analytics telco telco strategy telecomHistorically, telco analytics have been limited and difficult. Telco networks and the systems that support those networks are some of the most advanced technology solutions in existence. MORE
Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors). If you’ve read the SRE book you’ve probably come across the “four golden signals” (p60): latency, throughput, error rate, and saturation. MORE
Latency Related Topics CSS Wizardry
JANUARY 31, 2019
When it comes to network performance, there are two main limiting factors that will slow you down: bandwidth and latency. Latency is defined as…. Where bandwidth deals with capacity, latency is more about speed of transfer 2. and reduction in latency. more than latency.
Randon ASCII
SEPTEMBER 8, 2019
I work quickly on my computer and I get frustrated when I am forced to wait on an operation that should be fast. A persistent nuisance on my over-powered home laptop is that closing windows on the taskbar is slow. I right-click on an entry, wait for the menu to appear, and then select “Close window”.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
The Morning Paper
SEPTEMBER 3, 2019
SLOG: serializable, low-latency, geo-replicated transactions Ren et al., That’s where SLOG (Serializable LOw-latency, Geo-replicated transactions) comes in. VLDB’19. SLOG is another research system motivated by the needs of the application developer (aka, user!).
Uber Engineering
OCTOBER 17, 2018
To accomplish this, Uber relies heavily on making data-driven decisions at every level, from forecasting rider demand during high traffic events to identifying and addressing bottlenecks … The post Uber’s Big Data Platform: 100+ Petabytes with Minute Latency appeared first on Uber Engineering Blog. Uber is committed to delivering safer and more reliable transportation across our global markets.
Scalegrid
OCTOBER 24, 2019
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. ScaleGrid’s MySQL on AWS High Performance deployment can provide 2x-3x the throughput at half the latency of Amazon RDS for MySQL with their added advantage of having 2 read replicas as compared to 1 in RDS. MySQL on AWS Latency Performance Test Averages.
Sutter's Mill
FEBRUARY 13, 2017
Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” This intensive three day course will provide developers with the knowledge and skills required to write high-performance and low-latency code on today’s modern systems using modern C++11/14/17.
John McCalpin
DECEMBER 6, 2016
The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. It is also important to remember that the latency can be different for each physical address, depending on the location of the requesting core, the location of the coherence agent responsible for that address, and the location of the memory controller for that address. MCDRAM maximum latency (ns) 156.1
Scalegrid
NOVEMBER 20, 2019
95th Percentile Latency. The 95th percentile latency of queries was also 1.8 By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries.
DZone
JUNE 2, 2019
java performance scalability latency cpu grpc rpc qpsAlmost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out.
Scalegrid
DECEMBER 16, 2019
We ran performance tests for MongoDB on DigitalOcean vs. AWS vs. Azure and found that DigitalOcean performance was in line with, if not better, on both high throughput and low latency in the deployment. They even offer amazingly low latency from Amazon AWS US-East to the DigitalOcean New York datacenter, which is great for applications that are running their front on mid-tier on AWS, but would like to use DigitalOcean for their MongoDB clusters.
Scalegrid
NOVEMBER 25, 2019
ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. ScyllaDB is an open-source distributed NoSQL data store, reimplemented from the popular Apache Cassandra database. Released just four years ago in 2015, Scylla has averaged over 220% year-over-year growth in popularity according to DB-Engines.
Scalegrid
OCTOBER 17, 2019
While there is plenty of well-documented benefits to using a connection pooler, there are some arguments to be made against using one: Introducing a middleware in the communication inevitably introduces some latency.
High Scalability
OCTOBER 29, 2019
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.
John McCalpin
APRIL 2, 2020
This system also had significantly lower memory latency than many contemporary systems (which were still using front-side bus architectures and separate “NorthBridge” chips). Computer Architecture Performance memory bandwidth memory latency STREAM benchmark
CSS Wizardry
MAY 31, 2019
Every new origin we need to visit needs a connection opening, and that can be very costly: DNS resolution, TCP handshakes, and TLS negotiation all add up, and the story gets worse the higher the latency of the connection is.
John McCalpin
JANUARY 9, 2019
This week I updated three of those posts — two really old ones (primarily of interest to computer architecture historians), and one from 2018: July 2012: Local and Remote Memory Latency on AMD Processors in 2-socket and 4-socket servers. Computer Architecture Performance memory bandwidth memory latency Xeon PhiAs part of my attempt to become organized in 2019, I found several draft blog entries that had never been completed and made public.
DZone
OCTOBER 31, 2019
As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. Improve AWS performance!
John McCalpin
OCTOBER 16, 2016
Computer Architecture Computer Hardware Performance cache DRAM high performance computing memory bandwidth memory latency STREAM benchmark“Memory Bandwidth and System Balance in HPC Systems” If you are planning to attend the SuperComputing 2016 conference in Salt Lake City next month, be sure to reserve a spot on your calendar for my talk on Wednesday afternoon (4:15pm-5:00pm).
High Scalability
OCTOBER 18, 2019
It is difficult to fault their argument – as it’s absolutely true that: Connection Pool Connection Pooler Connection Pooling Database DevOps Forking Language Library Latency Linux Multithreaded Performance Postgres Web Applications administrator application architecture cluster connection-pool database database performance online website deployment developer failure multilanguage multithreading open source postgresql sql
VoltDB
JUNE 9, 2017
No Compromises Performance Personalization Real-time Vlog low latency real-time analytics telco telco strategy telecomHistorically, telco analytics have been limited and difficult. Telco networks and the systems that support those networks are some of the most advanced technology solutions in existence.
High Scalability
DECEMBER 3, 2019
AWS Add Index Azure Create Index Database DevOps EC2 Latency Master-Slave MySQL MySQL Index MySQL Performance MySQL Table Performance Performance Test SELECT Queries administration benchmark benchmarks best platform cloud data management database database replication database scalability deployment ec2 high availability hosting indexing master-slave mysql mysql cluster mysql load nodes optimization scalabitliy sql testing uptime
CSS Wizardry
AUGUST 7, 2019
The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. The reason is because mobile networks are, as a rule, high latency connections.
All Things Distributed
APRIL 17, 2013
While DynamoDB already allows you to perform low-latency queries based on your tableâ??s This gives you the ability to perform richer queries while still meeting the low-latency demands of responsive, scalable applications. All Things Distributed.
SQL Shack
JULY 10, 2019
TempDB is one of the biggest sources of latency in […]. Introduction In-memory technologies are one of the greatest ways to improve performance and combat contention in computing today.
The Morning Paper
MAY 19, 2019
Last week we learned about the [increased tail-latency sensitivity of microservices based applications with high RPC fan-outs. Seer uses estimates of queue depths to mitigate latency spikes on the order of 10-100ms, in conjunction with a cluster manager.
The Netflix TechBlog
FEBRUARY 20, 2019
Today we are excited to announce latency heatmaps and improved container support for our on-host monitoring solution?—?Vector?—?to Remotely view real-time process scheduler latency and tcp throughput with Vector and eBPF What is Vector?
All Things Distributed
MARCH 2, 2011
Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region.
ACM Sigarch
MARCH 25, 2019
How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? Let L denoted the average total latency to handle a task, equal to Q + S. Low latency ?
CSS Wizardry
AUGUST 13, 2019
Although this response has a 0B filesize, we will always take the latency hit on every single page view (and this response is basically 100% latency). com , which introduces yet more latency for the connection setup.
ACM Sigarch
MARCH 18, 2019
How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency? Can one both minimize latency and maximize throughput for unscheduled work? Recall that latency —in units of time—is the time it takes to do a task (e.g.,
The Morning Paper
NOVEMBER 10, 2019
Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. The desire for CPU efficiency and lower latencies is easy to understand. Snap: a microkernel approach to host networking Marty et al.,
All Things Distributed
DECEMBER 3, 2009
This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.
The Netflix TechBlog
JUNE 4, 2019
Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains.
Uber Engineering
MAY 14, 2019
To deliver the real-time performance expected from Uber’s users, our mobile apps require low-latency and highly … The post Employing QUIC Protocol to Optimize Uber’s App Performance appeared first on Uber Engineering Blog. Uber operates on a global scale across more than 600 cities, with our apps relying entirely on wireless connectivity from over 4,500 mobile carriers.
MachMetrics
OCTOBER 16, 2019
However, there is excitement around Starlink for other reasons – namely, the implications it might have for internet speed and latency – even by just a small amount (20 milliseconds on average). Starlink’s Goal: Reduce Internet Latency. Elon Musk’s need for speed.
The Morning Paper
SEPTEMBER 10, 2019
That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. Oh, and in additional to low latency, “ we require access to fresh data.”
VoltDB
NOVEMBER 10, 2017
The performance consists of two aspects: throughput and latency. Humans will wait much longer than an API will since APIs have strict latency expectations due to timeouts. But in most cases in modern applications, the application expectation is far less than the baked-in latency.
Dynatrace
SEPTEMBER 25, 2019
Citrix platform performance—optimize your Citrix landscape with insights into user load and screen latency per server. Citrix latency represents the end-to-end “screen lag” experienced by a server’s users. ICA latency. Dynatrace news.
The Morning Paper
MAY 12, 2019
The paper examines the implications of microservices at the hardware, OS and networking stack, cluster management, and application framework levels, as well as the impact of tail latency. The bottom line shows the tail latency impact in the microservices-based applications.
The Morning Paper
JUNE 13, 2019
Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. A case for managed and model-less inference serving Yadwadkar et al., HotOS’19.
The Morning Paper
FEBRUARY 6, 2020
On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network.
DZone
JUNE 20, 2019
From 11:48 to 12:10 latency for at least 50% of requests was significantly higher from us-east1 and us-central1 to GCS regional buckets in us-east1, us-central1, and europe-west2. From 11:48 to 12:03 latency was also elevated for europe-west2 to europe-west2 regional bucket access.
The Morning Paper
JULY 4, 2019
Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors). If you’ve read the SRE book you’ve probably come across the “four golden signals” (p60): latency, throughput, error rate, and saturation.
112 
Let's personalize your content