High Scalability

OCTOBER 19, 2018

cpeterso : Your quote reminds me of cybernetics' Law of Requisite Variety: "If a system is to be stable, the number of states of its control mechanism must be greater than or equal to the number of states in the system being controlled.". adrianco : The AWS EC2 NTP service has been backed by atomic clocks for the last few years.

Internet 123

Internet Internet Scalability Lambda 123

All Things Distributed

JUNE 20, 2017

Today, I am very excited to announce our plans to open a new AWS Region in Hong Kong! The new region will give Hong Kong-based businesses, government organizations, non-profits, and global companies with customers in Hong Kong, the ability to leverage AWS technologies from data centers in Hong Kong.

AWS 146

AWS Logistics Cloud Social Media 146

Brendan Gregg

JULY 15, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 111

Systems Performance Education Technology 111

All Things Distributed

DECEMBER 18, 2017

Today, I'm happy to announce that the AWS EU (Paris) Region, our 18th technology infrastructure Region globally, is now generally available for use by customers worldwide. This is why tens of thousands of French customers already use AWS in Regions around the world.

AWS 112

AWS Artificial Intelligence Education Energy 112

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 140

Performance Latency Hardware Storage 140

High Scalability

DECEMBER 21, 2018

2) Cloud will decentralise in terms of provision not power i.e. Amazon will "invade" more of those holdouts with AWS Outpost. odrotbohm : I’ve seen microservice based systems more deranged after 2 years than any 1,5 decades old monolith could ever have been. Me : Nothing special. 3) Serverless will rocket. If you plan for it.

Internet 137

Internet Internet Scalability Serverless 137

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 116

AWS Airlines Latency Games 116

High Scalability

AUGUST 17, 2018

coryodaniel : Rewrote an #AWS APIGateway & #lambda service that was costing us about $16000 / month in #elixir. cablelounger : OH: To use AWS offerings, you really need in-house dev-ops expertise vs GCP, they make dev ops transparent to you I've a lot of experience with AWS and mostly agree with the first point.

Internet 105

Internet Internet Scalability Games 105

High Scalability

SEPTEMBER 21, 2018

Too often, those who already hold power, those who are least able to recognize the flaws in our current systems, are the ones who decide our technological future. They'll love you even more. More quotes.

Internet 126

Internet Internet Scalability Traffic 126

High Scalability

JULY 20, 2018

The third wing of the architecture piece is the “domain specific system-on-chip.” tef : You can use a message broker to glue systems together, but never use one to cut systems apart. CompSciFact : 'Fancy algorithms are slow when n is small, and n is usually small.' -- Rob Pike. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Adrian Cockcroft

NOVEMBER 18, 2019

AWS Developer Relations on how the shift from Robot Operating System (ROS) 1 to ROS 2 will change the landscape for all robot lovers. OPN205-R Contributing to the AWS Construct Library (repeats) Using and loving the AWS Cloud Development Kit and want to help make it better? Alejandra Olvera-Novack?—?AWS

Open Source 40

Open Source AWS Lambda Serverless 40

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. We’ve had nearly 4 million visits to the blog in 2018: thank you! As 2018 moves into 2019, let’s take a quick look back at some of the most popular posts on the blog this year. And making lists. Top 10 Most Read.

Database 40

Database Tuning Performance AWS 40

O'Reilly

FEBRUARY 18, 2020

Growth is still strong for such a large topic, but usage slowed in 2018 (+13%) and cooled significantly in 2019, growing by just 7%. But sustained interest in cloud migrations—usage was up almost 10% in 2019, on top of 30% in 2018—gets at another important emerging trend. ML + AI are up, but passions have cooled. Security is surging.

Software Architecture 132

Software Architecture DevOps Data Engineering Architecture 132

High Scalability

MARCH 22, 2019

µs of replication latency on lossy Ethernet, which is faster than or comparable to specialized replication systems that use programmable switches, FPGAs, or RDMA.". BrentToderian : What city went from 14% of all trips by bike in 2001, to 22% by 2012, then leaped to 30% in 3 years by 2015, & 35% by 2018? We achieve 5.5

Internet 134

Internet Internet Scalability Wireless 134

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! Based in Bahrain, this will be the first Region for AWS in the Middle East. This news marks the 22nd AWS Region we have announced globally. 2017 continues a busy year for AWS in the Middle East.

Cloud 152

Cloud Education Energy Government 152

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 avg-cpu: %user %nice %system %iowait %steal %idle 14.86 avg-cpu: %user %nice %system %iowait %steal %idle 14.95 100.00 ^C. . ## 5. 17 48011 [.].

Cache 105

Cache C++ AWS Latency 105

Brendan Gregg

JULY 14, 2019

BPF (eBPF) tracing is a superpower that can analyze everything, and I'll show you how in my upcoming book BPF Performance Tools: Linux System and Application Observability , coming soon from Addison Wesley. I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 40

Systems Performance Education Technology 40

All Things Distributed

APRIL 11, 2018

Last year at re:Invent, we launched AWS Fargate , and today, I want to explore how Fargate fundamentally changes the landscape of container technology. This is the vision behind AWS Fargate. With AWS Fargate, you can provision resources to run your containers at a much finer grain than with an EC2 instance. Getting Started.

Cloud 148

Cloud AWS Innovation Traffic 148

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

High Scalability

NOVEMBER 16, 2018

AWS Redshift FTW! Cook’s criticisms infuriated Mr. Zuckerberg, who later ordered his management team to use only Android phones — arguing that the operating system had far more users than Apple’s.). yishengdd : However from my own experience, AWS Amplify is 10x better than Google Firebase. ” (Mr.

Internet 28

Internet Internet Scalability Energy 28

All Things Distributed

NOVEMBER 21, 2018

Clearly, they're updating their systems far more frequently than they did on-premises, which changes the nature of engineering problems the team needs to prioritize. Note: You need valid AWS credentials to access the public S3 data. Script users should update the DDL file with their own AWS keys to load the TPC-DS data.

Cloud 135

Cloud Benchmarking Performance AWS 135

The Morning Paper

MARCH 1, 2020

Firecracker is the virtual machine monitor (VMM) that powers AWS Lambda and AWS Fargate, and has been used in production at AWS since 2018. The first version of AWS Lambda was built using Linux containers. All of the existing approaches we just examined involve trade-offs that AWS didn’t want to make.

Serverless 101

Serverless Virtualization Lambda AWS 101

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. 2018-11-08T12:30:30+01:00. But since this article is about connecting an application running on the server with AWS S3, we don’t consider this solution. Connecting To AWS Through The SDK. Leonardo Losoviz.

AWS 44

AWS Servers Storage Cloud 44

The Netflix TechBlog

FEBRUARY 20, 2019

Having the right metrics available on demand and at a high resolution is key to understanding how a system behaves and helps to quickly troubleshoot performance issues. Historically the focus of our tooling and platform has been on AWS EC2, but with more users making the migration, we need to provide better support for container use cases.

Performance 211

Performance Latency Open Source Metrics 211

The Symphonia

DECEMBER 7, 2018

So another AWS re:Invent has come and gone and . We spent most of our time chatting to various folk about what they are doing with AWS now, and where they hope to proceed in 2019. AWS, for many organizations, is becoming the core, trusted, platform of how they work. To receive the email version please subscribe here.

Lambda 40

Lambda Serverless AWS Blockchain 40

Percona

SEPTEMBER 13, 2018

You can download the log file of your choice using either the Amazon RDS console OR you can use the following AWS CLI command to achieve the same: $ aws rds download-db-log-file-portion --db-instance-identifier perconasupport --starting-token 0 --output text --log-file-name slowquery/mysql-slowquery.log.2018-09-03.09 2018-09-03.09

C++ 42

C++ AWS Open Source Testing 42

O'Reilly

MAY 19, 2020

AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

Speed Curve

FEBRUARY 5, 2024

Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Amazon Cloudfront You can add server-timing headers via opt-in via the AWS Console as mentioned in this post. In practice, it looks something like this: server-timing: processing_time; dur=123.4; However, wider adoption has only just started to take off.

Servers 57

Servers Cache Retail Benchmarking 57

The Morning Paper

APRIL 7, 2019

You might also want to look at git-secrets which does this for AWS keys, and is extensible with additional patterns. In one case, we found what we believe to be AWS credentials for a major website relied upon by millions of college applications in the United States, possibly leaked by a contractor. For example: ( Enlarge ).

Google 76

Google AWS Website Government 76

Brendan Gregg

AUGUST 29, 2021

1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 avg-cpu: %user %nice %system %iowait %steal %idle 14.81 avg-cpu: %user %nice %system %iowait %steal %idle 14.86 avg-cpu: %user %nice %system %iowait %steal %idle 14.95 41 33680 53408 0 78 100.0%

Cache 40

Cache C++ AWS Systems 40

Percona

JULY 2, 2023

This blog was originally written in September 2018 and was updated in June 2023. In setting up our demonstration system, we use pg_basebackup and continuous archiving. In this post, we cover the methods used to achieve an enterprise-grade backup strategy for the PostgreSQL cluster.

Strategy 52

Strategy Database Storage Open Source 52

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Some of DBLog’s features are: Processes captured log events in-order.

Database 197

Database Traffic Transportation Open Source 197

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2018: MongoDB announces that it is moving from GNU AGPLv3 licensing to the Service Side Public License (SSPL). Is MongoDB free for commercial use?

Open Source 81

Open Source Programming Database Servers 81

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. Some of DBLog’s features are: Processes captured log events in-order.

Database 212

Database Traffic Transportation Open Source 212