John McCalpin

APRIL 25, 2023

To understand what is happening here, we need to understand the way memory bandwidth interacts with memory latency and the concurrency (parallelism) of memory accesses. Stay tuned! That is the topic of the next blog entry. (“Real Soon Now”) Can this problem be fixed? On a VE20B (8 cores, 1.6

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

JUNE 13, 2019

As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

SQL Performance

APRIL 27, 2020

Gen 5 is the primary hardware option now for most regions since Gen 4 is aging out. This way they can know that there is always a minimum compute level available, and they can always automatically scale to a designated compute level. New Hardware Configuration for Provisioned Compute Tier. GB per vCore.

Azure 55

Azure Database Serverless Hardware 55

The Morning Paper

MARCH 17, 2020

higher latency and lower bandwidth)… We have found the actual behavior of Optane DIMMs to be more complicated and nuanced than the "slower, persistent DRAM" label would suggest. The read latency for Optane is 2x-3x higher than DRAM. Optane DIMMs are here! Optane memory is also more pattern-dependent than DRAM.

Scalability 59

Scalability Latency Cache Media 59

The Morning Paper

MAY 21, 2019

This boils down to a single digit µs latency toleration in the tail for far memory, and in addition to security and privacy concerns, rules out remote memory solutions. Thus we’re fundamentally trading (de)-compression latency at access time for the ability to pack more data in memory. ML-based auto-tuning. Evaluation.

Software 78

Software Software Google Hardware 78

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 76

Entertainment Internet Internet Design 76

Abhishek Tiwari

JULY 12, 2018

Here are 8 fallacies of data pipeline The pipeline is reliable Topology is stateless Pipeline is infinitely scalable Processing latency is minimum Everything is observable There is no domino effect Pipeline is cost­-effective Data is homogeneous The pipeline is reliable The inconvenient truth is that pipeline is not reliable.

Latency 63

Latency Analytics Scalability Engineering 63

John McCalpin

JANUARY 22, 2018

Each of the two vector units can issue one FMA instruction per cycle, assuming that there are enough independent accumulators to tolerate the 6-cycle dependent-operation latency. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software. jb.B1.8.

Latency 40

Latency Hardware Code Testing 40

SQL Server According to Bob

JANUARY 11, 2020

Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. Example 1: ​​ Hardware failure (CPU board) Battery backup on the caching controller maintained the data. Important Always consult with your hardware manufacturer for proper stable media strategies.

Servers 40

Servers Cache Media Hardware 40

SQL Server According to Bob

JANUARY 11, 2020

​​ With new ​​ innovations ​​ come ​​ new terms, designs, ​​ and ​​ algorithms. This is different from ​​ the reference count design ​​ that was ​​ used in SQL Server 7.0 and ​​ 2000.

Servers 40

Servers Cache Database Media 40

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 107

Performance Network Latency Servers 107