Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Comments ().

AWS 60

AWS Cloud Latency Storage 60

All Things Distributed

DECEMBER 14, 2011

Expanding the Cloud â?? This new Region has been highly requested by companies worldwide, and it provides low-latency access to AWS services for those who target customers in South America. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â??

AWS 114

AWS Latency Storage Big Data 114

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet. This portrayal can be a desirable and useful abstraction when discussing cloud services at the application and end-user level. Comments ().

AWS 61

AWS Cloud Latency Storage 61

Scalegrid

JANUARY 12, 2024

What is workload in cloud computing? Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. The environments, which were previously isolated, are now working seamlessly under central control.

Cloud 130

Cloud Virtualization Storage Efficiency 130

All Things Distributed

JULY 11, 2011

As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Recent Entries.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. This new region, which is located on the West Coast of the US, helps US government agencies and contractors move more of their workloads to the cloud by implementing a number of US government-specific regulatory requirements. Cloud First. Cloud Firstâ?? Comments ().

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

NOVEMBER 19, 2010

Here are some the links I shared this week on twitter and facebook : Cloud Computing. There were blog posts by Jeff Barr The Cluster GPU Instance and James Hamilton HPC in the Cloud with GPGPUs , as well as my background posting: Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances.

AWS 67

AWS Cloud Benchmarking Storage 67

High Scalability

DECEMBER 21, 2018

What could be better than a book on the cloud? Explain the Cloud Like I'm 10. swardley: X : What's going to happen in cloud in 2019? 2) Cloud will decentralise in terms of provision not power i.e. Me : Nothing special. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Don't be late.

Internet 137

Internet Internet Scalability Serverless 137

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. It would mean a great deal to me. They'll love you even more. There are a few more quotes. Not so many this week.

Internet 121

Internet Internet Scalability Automotive 121

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Amazon Simple Storage Service (S3). Dynatrace news.

AWS 135

AWS Metrics IoT Storage 135

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Therefore, the ability to view a real-time map of your applications, services, and cloud resources is key to your success. Amazon Simple Storage Service (S3). Dynatrace news.

AWS 132

AWS Metrics IoT Storage 132

All Things Distributed

OCTOBER 2, 2017

" Of course, no technology change happens in isolation, and at the same time NoSQL was evolving, so was cloud computing. The requirements for a fully hosted cloud database service needed to be at an even higher bar than what we had set for our Amazon internal system.

Internet 128

Internet Internet AWS Performance 128

O'Reilly Software

APRIL 30, 2018

When designing cloud architecture, it’s critical to consider that your applications could be affected by failures and that you must be prepared to respond to those failures quickly and effectively. Managed DNS, as your gateway to the internet, can provide improved resilience to ensure your applications are always available.

Cloud 68

Cloud Traffic Internet Internet 68

All Things Distributed

APRIL 9, 2015

AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. Amazon EFS is a fully-managed service that makes it easy to set up and scale shared file storage in the AWS Cloud. With Amazon EFS, there is no minimum fee or setup costs, and customers pay only for the storage they use.

Lambda 122

Lambda Cloud IoT AWS 122

Percona

JULY 17, 2023

A survey of 90,240 companies using MongoDB listed the leading uses as Technology and Services (23%), Computer Software (16%), and Internet (6%). Redis can handle a high volume of operations per second, making it useful for running applications that require low latency. And MongoDB is popular across industries.

Open Source 79

Open Source Database Scalability Software 79

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale. Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

High Scalability

SEPTEMBER 14, 2018

Hey, it's HighScalability time: The Cloud Native Interactive Landscape is fecund. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. changelog ). Do you like this sort of Stuff?

Internet 30

Internet Internet Scalability Education 30

All Things Distributed

JUNE 21, 2018

We are increasingly seeing customers wanting to build Internet-scale applications that require diverse data models. Use cases such as gaming, ad tech, and IoT lend themselves particularly well to the key-value data model where the access patterns require low-latency Gets/Puts for known key values. Purpose-built databases.

Database 167

Database AWS Games Latency 167

All Things Distributed

OCTOBER 12, 2016

Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency. This allows for faster failover times while minimizing latency. The client keeps a map of Redis nodes, which is updated in case of failover.

Scalability 130

Scalability Analytics Cache AWS 130

All Things Distributed

JUNE 21, 2017

As we said at the time, DynamoDB was a result of 15 years of learning in the area of large scale non-relational databases and cloud services. Based on this experience and learning, we built DynamoDB to be a fast, highly scalable NoSQL database to meet the needs of Internet-scale applications. " Canon INC.

Speed 121

Speed Cache Latency AWS 121

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. The key factor is that the whole data structure resides in the same location (node), facilitating the operations.

Traffic 127

Traffic Scalability Database Servers 127

All Things Distributed

NOVEMBER 15, 2010

Expanding the Cloud - Adding the Incredible Power of the Amazon EC2 Cluster GPU Instances. For example, the most fundamental abstraction trade-off has always been latency versus throughput. The throughput of this pipeline is more important than the latency of the individual operations. Expanding the Cloud â?? Comments ().

AWS 136

AWS Latency Programming Architecture 136

All Things Distributed

FEBRUARY 24, 2010

Achieving strict consistency can come at a cost in update or read latency, and may result in lower throughput. Lowest read latency. Higher read latency. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Consistent read. No stale reads.

AWS 69

AWS Latency Database Scalability 69

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Xen's biggest user is the Amazon EC2 cloud, which has over one million customers, and appears to be a custom version (it self identifies as version "3.4.3.amazon").

Virtualization 76

Virtualization AWS Engineering Hardware 76

Dotcom-Montior

MARCH 6, 2022

Some of those factors include the following: URL Test Location Browser (Chrome, Firefox, Internet Explorer, mobile browsers etc…) Connection Number of Tests Repeat View Elements Used in Waterfall Charts Interactive Slider : The Interactive Slider is an indicator of the performance of each element in terms of milliseconds. Waiting time.

Performance 52

Performance Cache Website Speed 52

Dotcom-Montior

MAY 6, 2020

Browser (Chrome, Firefox, Internet Explorer, mobile browsers etc…). To boost the bandwidth availability, the user should keep the images on a cloud server. Waterfall charts allow the user to discover how latency is influencing the speed of the website. Some of those factors include the following: URL. Test Location. Connection.

Performance 53

Performance Cache Website Speed 53

Testsigma

FEBRUARY 12, 2021

The Internet of Things is generally referred to as IoT which encompasses computers, cars, houses or some other technological system related. Automation Via Distributed Cloud. It is expected that the Cloud Computing pattern will grow further by being a distributed cloud in 2020. IoT Test Automation. Signup for free now.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%. Thus, it "hides" latency (both in the network and on the server) from clients.

Performance 104

Performance Cache Metrics Network 104

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145