High Scalability

AUGUST 17, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. 12 million requests / hour with sub-second latency, ~300GB of throughput / day. It would mean a great deal to me. They'll love you even more.

Internet 105

Internet Internet Scalability Games 105

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

NOVEMBER 13, 2018

Organizations across Italy have been using the AWS Cloud for over a decade, using AWS Regions located outside of Italy. We have offices in Rome and Milan, where we continue to help Italian customers of all sizes move to the AWS Cloud. The company decided it wanted the scalability, flexibility, and cost benefits of working in the cloud.

AWS 167

AWS Energy Automotive Traffic 167

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 100.00 ^C.

Cache 105

Cache C++ AWS Latency 105

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. 41 33680 53408 0 78 100.0%

Cache 40

Cache C++ AWS Systems 40

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. portability between cloud and on-premises. direct access to raw block storage [18] without the abstraction of a filesystem for workloads that require consistent I/O performance and low latency. better cluster resource utilization.

Big Data 63

Big Data Storage Benchmarking Hardware 63

Percona

AUGUST 10, 2018

sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 sec < 2018-08-06 07:22:35.199 EDT > LOG: automatic analyze of table "vactest.scott.employee" system usage: CPU 0.00s/0.02u sec elapsed 0.15 1 second = 1000 milliseconds).

Tuning 44

Tuning Cache Database Storage 44

High Scalability

DECEMBER 21, 2018

What could be better than a book on the cloud? Explain the Cloud Like I'm 10. swardley: X : What's going to happen in cloud in 2019? 2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. Do you like this sort of Stuff? Please support me on Patreon.

Internet 137

Internet Internet Scalability Serverless 137

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

High Scalability

JULY 20, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. It would mean a great deal to me. They'll love you even more. It doesn't scale down to the point that is ridiculous and painful.

Internet 121

Internet Internet Scalability Automotive 121

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Serverless 228

Serverless Media Latency Social Media 228

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. to the broader community.

Performance 211

Performance Latency Open Source Metrics 211

All Things Distributed

DECEMBER 12, 2018

They can run applications in Sweden, serve end users across the Nordics with lower latency, and leverage advanced technologies such as containers, serverless computing, and more. In addition, we are working with the venture capital community, startup accelerators, and incubators to help startups grow in the cloud. " Hemnet.

AWS 124

AWS Cloud Games Serverless 124

Abhishek Tiwari

DECEMBER 27, 2017

With the arrival of new cloud-native tools and platform, ETL is becoming obsolete. There are several emerging data trends that will define the future of ETL in 2018. In 2018, we anticipate that ETL will either lose relevance or the ETL process will disintegrate and be consumed by new data architectures.

Big Data 49

Big Data Artificial Intelligence Storage Hardware 49

All Things Distributed

APRIL 4, 2017

The new AWS EU (Stockholm) Region will have three Availability Zones and will be ready for customers to use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. AWS Partner Network (APN) Consulting Partners in the Nordics help customers migrate to the cloud.

AWS 116

AWS Airlines Latency Games 116

High Scalability

SEPTEMBER 14, 2018

Hey, it's HighScalability time: The Cloud Native Interactive Landscape is fecund. And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. changelog ). Do you like this sort of Stuff?

Internet 30

Internet Internet Scalability Education 30

Percona

JULY 1, 2023

This post was originally published in July 2018 and was updated in July 2023. Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. What are the differences between Aurora and RDS? How do I choose which one to use?

AWS 52

AWS Database Serverless Storage 52

Adrian Cockcroft

NOVEMBER 18, 2019

OPN220 Build robotic cloud simulations with ROS and AWS RoboMaker Join Camilo Buscaron, AWS Principal Open Source Technologist, and Katherine Scott, Developer Advocate, Open Robotics in this workshop to use Gazebo, a 3D simulator, and Robot Operating System (ROS) on AWS RoboMaker and learn how to spin up robotic simulations.

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

OPN220 Build robotic cloud simulations with ROS and AWS RoboMaker Join Camilo Buscaron, AWS Principal Open Source Technologist, and Katherine Scott, Developer Advocate, Open Robotics in this workshop to use Gazebo, a 3D simulator, and Robot Operating System (ROS) on AWS RoboMaker and learn how to spin up robotic simulations.

Open Source 40

Open Source AWS Lambda Serverless 40

High Scalability

JANUARY 24, 2019

Need cloud? Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). Stand under Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). For the first time in history, a VC-backed startup in 2018 was more likely to sell to a PE buyer than a fellow VC-backed company. 3D map of a fly's brain ).

Internet 29

Internet Internet Scalability Games 29

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Delta is used in production since 2018 for datastore synchronization and event processing use cases in Netflix studio applications. All aboard the Databus!:

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Delta is used in production since 2018 for datastore synchronization and event processing use cases in Netflix studio applications. All aboard the Databus!:

Database 212

Database Traffic Transportation Open Source 212

Alex Russell

MARCH 6, 2021

A silver lining on this dark cloud is that mobile JavaScript payload growth paused in 2020. India became a 4G-centric market sometime in 2018. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge.

Performance 124

Performance Network Cache Metrics 124

Testsigma

FEBRUARY 12, 2021

Automation Via Distributed Cloud. Gartner describes the distributed cloud as the delivery of cloud resources across various physical sites, but it remains the responsibility of the public cloud operator to administer, maintain and grow. Try Testsigma and experience the benefits of cloud-based test automation.

Artificial Intelligence 92

Artificial Intelligence Software Software IoT 92

Smashing Magazine

JANUARY 6, 2020

Globally in 2018–2019, according to the IDC, 87% of all shipped mobile phones are Android devices. Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. In 2018, the Alliance of Open Media has released a new promising video format called AV1. 265 codec (the evolution of H.264)

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. In 2018, the Alliance of Open Media has released a new promising video format called AV1. Thus, it "hides" latency (both in the network and on the server) from clients. AV1 has compression similar to H.265 Same with Etag.

Performance 104

Performance Cache Network Metrics 104

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145