High Scalability

DECEMBER 7, 2018

It's HighScalability time: This is your 1500ms latency in real life situations - pic.twitter.com/guot8khIPX. Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. — Ivo Mägi (@ivomagi) November 27, 2018. Do you like this sort of Stuff? Please support me on Patreon.

Internet 163

Internet Internet Scalability Blockchain 163

ACM Sigarch

MAY 31, 2023

Berger (Microsoft) shared the state of memory systems in the public cloud and projected two use cases of CXL-based disaggregated memories in the cloud ( IEEE Micro and ASPLOS’23 ). even lowered the latency by introducing a multi-headed device that collapses switches and memory controllers. The recently announced CXL3.0

Latency 52

Latency Hardware Cache Architecture 52

High Scalability

AUGUST 17, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. It would mean a great deal to me. They'll love you even more.

Internet 105

Internet Internet Scalability Games 105

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. This is currently part of our FlameCommander UI, which also runs flame graphs across the cloud. For a more recent example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2

Latency 145

Latency Cache Energy Systems 145

The Morning Paper

JUNE 13, 2019

Making queries to an inference engine has many of the same throughput, latency, and cost considerations as making queries to a datastore, and more and more applications are coming to depend on such queries. The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50.

Hardware 58

Hardware Latency Serverless Energy 58

High Scalability

MARCH 1, 2019

Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It was made possible by using a low latency of 0.1 seconds, the lower the latency, the more responsive the robot. If you are a developer building your own platform (AppEngine, Cloud Foundry, or Heroku clone), then Kubernetes is for you.

Internet 33

Internet Internet Scalability Blockchain 33

High Scalability

MAY 10, 2019

I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. Quotable Stuff: @mjpt777 : APIs to IO need to be asynchronous and support batching otherwise the latency of calls dominate throughput and latency profile under burst conditions. hubblesite ). Do you like this sort of Stuff?

Internet 31

Internet Internet Scalability Energy 31

Dynatrace

JANUARY 17, 2024

Growing AI adoption brings rising cloud costs There are three key reasons that AI costs can spiral out of control: AI consumes additional resources. Running artificial intelligence models and querying data requires massive amounts of computational resources in the cloud, which results in higher cloud costs. Use containerization.

Strategy 226

Strategy Artificial Intelligence Storage Cloud 226

Scalegrid

FEBRUARY 8, 2024

Key Takeaways Distributed storage systems benefit organizations by enhancing data availability, fault tolerance, and system scalability, leading to cost savings from reduced hardware needs, energy consumption, and personnel. This integration enhances the flexibility of cloud services while bolstering their computational and storage functions.

Storage 130

Storage Systems Big Data Azure 130

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. This is currently part of our FlameCommander UI, which also runs flame graphs across the cloud. As an extreme example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2

Open Source 40

Open Source Latency Cache Energy 40

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy 52

Energy Metrics Cloud Operating System 52

The Morning Paper

NOVEMBER 15, 2020

So while scale out has seen the majority of attention in the cloud era, it’s good to remind ourselves periodically just what we really can do on a single box or even a single thread. This makes the whole system latency sensitive. FPGAs are chosen because they are both energy efficient and available on SmartNICs).

Servers 128

Servers Hardware Latency Design 128