All Things Distributed

FEBRUARY 18, 2013

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - Introducing AWS OpsWorks, a Powerful Application Management Solution. As with all the AWS Application Management services AWS OpsWorks is provided at no additional charge. AWS OpsWorks Unique Features. Comments ().

AWS 157

AWS Cloud Architecture Infrastructure 157

Scalegrid

JANUARY 8, 2024

Hybrid clouds have the potential to evolve into multi-cloud systems reducing the risk of downtime significantly – ScaleGrid’s solutions are designed specifically with these obstacles in mind guaranteeing seamless operation between private and public clouds. This approach offers flexibility in managing resources effectively.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. As I'm interested in the relative comparison I can just compare the total runtimes (the "real" time) for the same result. Running this on the two systems saw similar results. us on Ubuntu.

Speed 126

Speed Java AWS Virtualization 126

The Netflix TechBlog

SEPTEMBER 24, 2021

Lastly, the packager kicks in, adding a system layer to the asset, making it ready to be consumed by the clients. There are existing distributed file systems for the cloud as well as off-the-shelf FUSE modules for S3. MezzFS borrows from how operating systems handle page faults. when it updates the ‘mdat’ size)?

Cloud 237

Cloud Media Storage Cache 237

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. Now, thousands of customers are trying Amazon SageMaker and building ML models on top of their data lakes in AWS. In machine learning, more is usually more. Data always keeps being accrued.

Scalability 159

Scalability Hardware AWS Tuning 159

Dynatrace

MAY 16, 2019

The survey had eight questions related to current team effectiveness and system stability. Here’s a quick graphical comparison of the Pivotal Dev-to-Ops ratio, that of the Dynatrace elite category, and the average ratio identified by the survey. GitHub, Bitbucket, or AWS CodeCommit for version control.

Innovation 190

Innovation Cloud DevOps Best Practices 190

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. HPCG is led by Japan’s RIKEN Fugaku system at 16 petaflops, which is 3% of it’s peak capacity. Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

The Morning Paper

AUGUST 29, 2019

If you’re moving an OLAP workload to the cloud (AWS in the context of this paper), what DBMS setup should you go with? We focused on OLAP-oriented parallel data warehouse products available for AWS and restricted our attention to commercially available systems. Choosing a cloud DBMS: architectures and tradeoffs Tan et al.,

Architecture 76

Architecture Cloud Storage Serverless 76

The Netflix TechBlog

FEBRUARY 20, 2019

Having the right metrics available on demand and at a high resolution is key to understanding how a system behaves and helps to quickly troubleshoot performance issues. Historically the focus of our tooling and platform has been on AWS EC2, but with more users making the migration, we need to provide better support for container use cases.

Performance 211

Performance Latency Open Source Metrics 211

O'Reilly

SEPTEMBER 15, 2021

Cloud certifications, specifically in AWS and Microsoft Azure, were most strongly associated with salary increases. As we’ll see later, cloud certifications (specifically in AWS and Microsoft Azure) were the most popular and appeared to have the largest effect on salaries. Certified Information Systems Security Professional a.k.a.

Azure 145

Azure Social Media Programming AWS 145

All Things Distributed

AUGUST 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. All Things Distributed. Comments (). Total Cost of Ownership.

AWS 118

AWS Hardware Traffic Best Practices 118

O'Reilly

MAY 19, 2020

AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. Technical leads and architects (about 11%) are next, followed by software and systems architects (9+%). Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. As I'm interested in the relative comparison I can just compare the total runtimes (the "real" time) for the same result. Running this on the two systems saw similar results.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. As I'm interested in the relative comparison I can just compare the total runtimes (the "real" time) for the same result. Running this on the two systems saw similar results. us on Ubuntu.

Speed 40

Speed Java AWS Virtualization 40

Percona

MAY 2, 2023

As a MongoDB user, it’s crucial to ensure that your data is safe and secure in the event of a disaster or system failure. Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks. Why are MongoDB database backups important?

Best Practices 52

Best Practices Database Storage Servers 52

The Morning Paper

JUNE 16, 2019

Specifically, scalable, parallel streaming dataflow computing systems now support partially-stateful and dynamically-changing dataflows. By reasoning about all users’ queries as a joint dataflow, the system can detect such sharing: when identical dataflow paths exist, they can be merged.

Database 90

Database Cache Benchmarking Efficiency 90

Percona

DECEMBER 20, 2018

Now that Database-as-a-service (DBaaS) is in high demand, there is one question regarding AWS services that cannot always be answered easily : When should I use Aurora and when RDS MySQL ? I found the comparison of InnoDB vs. MyISAM quite interesting, and I’ll use it in this post. About ZFS Performance. Tuning InnoDB Primary Keys.

Database 40

Database Tuning Performance AWS 40

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. It’s now time to put our race-logic encoded decision trees in the context of an end-to-end system. ASPLOS’19. Introducing race logic.

Energy 52

Energy Hardware Efficiency Architecture 52

O'Reilly

MARCH 23, 2023

It can pretend to be an operating system. While there will be a lot of institutional resistance (an attempt to use ChatGPT as a lawyer in a real trial was stopped), it is easy to imagine a day when an AI system handles routine tasks like real estate closings. And some of these things are mind blowing. Or a text adventure game.

Google 103

Google Open Source Programming Code 103

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 76

Virtualization AWS Engineering Hardware 76

Smashing Magazine

OCTOBER 22, 2019

This will require you to update your image optimization strategy and adopt a tool called ImageKit , but it shouldn’t take much work from you to get this new system in place. So, today, let’s focus on how you can still design with as many images as you want without slowing down your website. Source: Unsplash ) ( Large preview ).

Mobile 63

Mobile Media Website Storage 63

Smashing Magazine

JANUARY 11, 2021

Alternatively, you can also use: Addy Osmani’s Chrome UX Report Compare Tool , Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing). Note that new CrUX datasets are released on the second Tuesday of each month. Large preview ).

Performance 145

Performance Cache Media Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing). Are web fonts optimized?

Performance 104

Performance Cache Network Metrics 104

Smashing Magazine

JANUARY 6, 2020

Alternatively, you can also use Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing). Paddy Ganti’s script constructs two URLs (one normal and one blocking the ads), prompts the generation of a video comparison via WebPageTest and reports a delta.

Performance 145

Performance Cache Network Metrics 145