Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

## References I've reproduced the talk references below, so you can click on links: - [Gregg 08] Brendan Gregg, “ZFS L2ARC,” [link] Jul 2008 - [Gregg 10] Brendan Gregg, “Visualizations for Performance Analysis (and More),” [link] 2010 - [Greenberg 11] Marc Greenberg, “DDR4: Double the speed, double the latency? Ford, et al., “TCP

Performance 52

Performance Latency Hardware Storage 52

O'Reilly

JANUARY 16, 2024

I’m personally interested in this topic since I am a professor who researches human-computer interaction, user experience design, and cognitive science , so AI voice interfaces are fascinating to me. I’ve recently been brainstorming ideas for how to design such a system and how to deal with the practical challenges of scaling and maintenance.

Entertainment 73

Entertainment Internet Internet Design 73

Testsigma

JANUARY 30, 2021

With the rapidly increasing use of smartphones and ease of access to the internet across the globe, testing has spread across vast platforms. The applications are designed using the same code base as Desktop like HTML, Javascript, and CSS. The application should be designed in such a way that it compels users to revisit the site again.

Mobile 52

Mobile Testing Website Internet 52

All Things Distributed

DECEMBER 5, 2010

DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. DNS is an absolutely critical piece of the internet infrastructure. The Domain Name System is a wonderful practical piece of technology; it is a fundamental building block of our modern internet.

Cloud 117

Cloud Internet Internet AWS 117

Particular Software

JUNE 3, 2019

Everyone who is old enough to remember the sound of connecting to the Internet with a dial-up modem or of AOL announcing that "You've got mail" is acutely aware that there is an upper limit to how fast something can be downloaded, and it never seems to be as fast as we would like it. We'll never be satisfied.

Latency 40

Latency Speed Network Strategy 40

All Things Distributed

MARCH 2, 2011

Japanese companies and consumers have become used to low latency and high-speed networking available between their businesses, residences, and mobile devices. The advanced Asia Pacific network infrastructure also makes the AWS Tokyo Region a viable low-latency option for customers from South Korea. Recent Entries. Amazon DynamoDB â??

AWS 112

AWS Cloud Games Latency 112

All Things Distributed

DECEMBER 14, 2011

This new Region has been highly requested by companies worldwide, and it provides low-latency access to AWS services for those who target customers in South America. The new Sao Paulo Region provides better latency to South America, which enables AWS customers to deliver higher performance services to their South American end-users.

AWS 114

AWS Latency Storage Big Data 114

VoltDB

JUNE 1, 2017

These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments. Bear in mind that the internet currently takes 4ms from New York to Philadelphia.

Hardware 56

Hardware Latency Virtualization Cloud 56

Smashing Magazine

AUGUST 3, 2021

This liberal attitude is known as Postel’s Law, which is conveyed superbly by Jeremy Keith in Resilient Web Design : “Even if there are errors in the HTML or CSS, the browser will still attempt to process the information, skipping over any pieces that it can’t parse.”. On design systems, CSS/JS and UX. JavaScript is less forgiving.

Network 145

Network Engineering Availability Monitoring 145

Tim Kadlec

JUNE 24, 2014

Since it’s one of my favorite topics, I decided to share my notes: 34% of US adults use a smartphone as their primary means of internet access. Mobile networks add a tremendous amount of latency. Performance cops (developers or designers who enforce performance) is not sustainable. We are not our end users.

Google 49

Google Performance Latency Internet 49

All Things Distributed

JULY 13, 2010

Cluster Computer Instances for Amazon EC2 are a new instance type specifically designed for High Performance Computing applications. Other industries using Amazon EC2 for HPC-style workloads include pharmaceuticals, oil exploration, industrial and automotive design, media and entertainment, and more. Recent Entries.

Cloud 118

Cloud AWS Automotive Latency 118

VoltDB

JUNE 1, 2017

These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Latency Optimizers” – need support for very large federated deployments. Bear in mind that the internet currently takes 4ms from New York to Philadelphia.

Hardware 40

Hardware Latency Virtualization Cloud 40

High Scalability

JULY 20, 2018

DonHopkins : NeWS differs from the current technology stack in that it was all coherently designed at once by James Gosling and David Rosenthal, by taking several steps back and thinking deeply about all the different problems it was trying to solve together. Some are lucky enough to also have a production environment." Not so many this week.

Internet 121

Internet Internet Scalability Automotive 121

All Things Distributed

DECEMBER 3, 2009

This new Region consists of multiple Availability Zones and provides low-latency access to the AWS services from for example the Bay Area. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. blog comments powered by Disqus. Contact Info. Werner Vogels. CTO - Amazon.com. Other places.

AWS 60

AWS Cloud Latency Storage 60

High Scalability

DECEMBER 21, 2018

Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms.” Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading).

Internet 137

Internet Internet Scalability Serverless 137

SQL Performance

SEPTEMBER 17, 2019

In the early days of SSRS, a requirement was to also install and configure Internet Information Services (IIS). Consideration for backing up your Report Designer files such as; rdl,rds,dv,ds, rptproj, and.sln files should be given. Disk latency for ReportServer and ReportServerTempDB are very important. Rssvrpolicy.config.

Tuning 67

Tuning Servers Database Best Practices 67

All Things Distributed

JULY 11, 2011

As a part of that process, we also realized that there were a number of latency sensitive or location specific use cases like Hadoop, HPC, and testing that would be ideal for Spot. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Recent Entries. Driving Storage Costs Down for AWS Customers.

AWS 85

AWS Storage Cloud Big Data 85

All Things Distributed

APRIL 28, 2010

Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet. There are four main reasons to do so: Performance - For many applications and services, data access latency to end users is important. The new Singapore Region offers customers in APAC lower-latency access to AWS services.

AWS 61

AWS Cloud Latency Storage 61

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The design of the in-stream processing engine itself was driven by the following requirements: SQL-like functionality. Fault-tolerance. Additive State and Sketches.

Big Data 154

Big Data Processing Lambda Database 154

All Things Distributed

AUGUST 16, 2011

There are different considerations when deciding where to allocate resources with latency and cost being the two obvious ones, but compliance sometimes plays an important role as well. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud Cloud Readyâ??; Recent Entries.

AWS 111

AWS Government Big Data Cloud 111

Tim Kadlec

AUGUST 14, 2018

The area he was in was served by satellite internet access, and experienced significant latency (a floor of 506 milliseconds) and packet loss (between 50-80% was typical). HTTPS, which by design prevents man-in-the-middle attacks, utterly breaks local caching servers.

Cache 64

Cache Mobile Servers Latency 64

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Congrats to the Heroku team for officially serving 100,000 apps. Recent Entries.

AWS 67

AWS Cloud Benchmarking Storage 67

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

IO River

NOVEMBER 2, 2023

Fundamentally, internet traffic can be broadly categorized into static and dynamic content. Yes, it’s a single file, but that’s not how it’s stored on the internet. BandwidthImagine the internet as a ramified web of pipelines, each varying in size. A video, being a digital asset, is also based on these two parts.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

Fundamentally, internet traffic can be broadly categorized into static and dynamic content. Yes, it’s a single file, but that’s not how it’s stored on the internet. This type of traffic originates directly from the server, making it more challenging to handle due to latency and server load considerations; it’s hard but not impossible.

Architecture 52

Architecture Performance Internet Internet 52

The Morning Paper

JANUARY 23, 2020

Trade-offs under pressure: heuristics and observations of teams resolving internet service outages , Allspaw, Masters thesis, Lund University 2015. 1:18pm a key observation was made that an API call to populate the homepage sidebar saw a huge jump in latency.

Internet 53

Internet Internet Cache Engineering 53

The Netflix TechBlog

FEBRUARY 18, 2022

While a mobile device is almost always connected to the internet and reachable, a smart TV is only online while in use. Scaling Policies To address the thundering herd problem and to keep latencies under acceptable thresholds, the cluster scale-up policies are configured to be more aggressive than the scale-down policies.

Systems 334

Systems Traffic Architecture Mobile 334

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Metrics for each service instance are presented in detailed charts—see the example for ECS below.

AWS 135

AWS Metrics IoT Storage 135

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Metrics for each service instance are presented in detailed charts—see the example for ECS below.

AWS 132

AWS Metrics IoT Storage 132

Smashing Magazine

AUGUST 20, 2021

Piecing together a website using a WYSIWYG editor and seeing the code it generated was a fascinating and educational experience that sparked an initial interest in web design. I had my website with funny photos and links to favorite websites live on the internet, and better yet, I could edit directly on the server. More after jump!

Ecommerce 139

Ecommerce Website Government Internet 139

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Amazon DynamoDB offers low, predictable latencies at any scale.

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

JULY 17, 2023

Instead of the table-based structure of relational databases, MongoDB stores data in documents and collections, a design for handling large amounts of unstructured data and for real-time web applications. Redis can handle a high volume of operations per second, making it useful for running applications that require low latency.

Open Source 75

Open Source Database Scalability Software 75

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. DynamoDB Streams simplifies and improves this design pattern with a distributed systems approach. DynamoDB Cross-region Replication.

Database 167

Database Lambda AWS IoT 167

Scalegrid

JANUARY 12, 2024

High availability storage options within the context of cloud computing involve highly adaptable storage solutions specifically designed for storing vast amounts of data while providing easy access to it. Storage is a critical aspect to consider when working with cloud workloads. Additionally.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. However, it is extremely challenging to actually deploy them at Internet scale.

Transportation 145

Transportation Internet Internet Network 145

Smashing Magazine

AUGUST 22, 2021

This is because HTTP/3 and QUIC mainly help deal with the somewhat uncommon yet potentially high-impact problems that can arise on today’s Internet. Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Congestion Control.

Performance 105

Performance Network Latency Servers 105