All Things Distributed

SEPTEMBER 14, 2020

A great example of this approach to innovation and problem solving is the creation of the AWS Nitro System (Nitro System), the underlying platform for our EC2 instances. Now, with the Nitro System, we can offer the best price performance in the cloud, the most secure environment, and a faster pace of innovation.

Virtualization 87

Virtualization AWS Systems Innovation 87

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

Adrian Cockcroft

JANUARY 17, 2022

photo taken by Adrian Cockcroft A year ago I did a talk at re:Invent called Architecture Trends and Topics for 2021 , so I thought it was worth seeing how they played out and updating them for the coming year. There were five trends and topics for 2021, Serverless First, Chaos Engineering, Wardley Mapping, Huge Hardware, Sustainability.

Serverless 98

Serverless Hardware AWS Architecture 98

Dynatrace

JUNE 15, 2023

Incorporating cloud application security practices is an effective way for organizations to avoid application security risks, ensure a smoothly running software development lifecycle (SDLC), and establish an overall strong security posture. However, open source software is often a vector for security vulnerabilities.

Cloud 179

Cloud Open Source Architecture Monitoring 179

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Open-source software drives a vibrant Kubernetes ecosystem. Java, Go, and Node.js

Open Source 345

Open Source Java Operating System Programming 345

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. It allows for the breaking up of heavy monolithic architectures into multiple serverless “functions.” Understand and optimize your architecture. Dynatrace news. Azure Functions in a nutshell.

Serverless 238

Serverless Azure Monitoring Lambda 238

Percona

JULY 1, 2023

Now that Database-as-a-service (DBaaS) is in high demand, there are multiple questions regarding AWS services that cannot always be answered easily: When should I use Aurora and when should I use RDS MySQL ? Amazon Aurora is a proprietary, cloud-native, fully managed relational database service developed by Amazon Web Services (AWS).

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

MAY 12, 2019

An open-source benchmark suite for microservices and their hardware-software implications for cloud & edge systems Gan et al., A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! Hardware implications.

Open Source 61

Open Source Hardware Benchmarking Systems 61

Dynatrace

NOVEMBER 15, 2021

Log monitoring, log analysis, and log analytics are more important than ever as organizations adopt more cloud-native technologies, containers, and microservices-based architectures. Driving this growth is the increasing adoption of hyperscale cloud providers (AWS, Azure, and GCP) and containerized microservices running on Kubernetes.

Analytics 211

Analytics Monitoring Artificial Intelligence DevOps 211

cdemi

FEBRUARY 20, 2017

Let's talk about the elephant in the room; Serverless doesn't really mean that there are no Software or Hardware servers. It just means that from Software Development perspective, servers are abstracted and outsourced to another entity, so you don't need to worry about it. Amazon: AWS Lambda. Advantages. Disadvantages.

Serverless 64

Serverless Architecture Lambda Azure 64

Dynatrace

NOVEMBER 22, 2022

Cloud service providers, such as Amazon Web Services (AWS) , can offer infrastructure with five-nines availability by deploying in multiple availability zones and replicating data between regions. They also need a way to track all the services running on their distributed architectures, from multicloud environments to the edge.

Infrastructure 185

Infrastructure Availability Systems Retail 185

Dynatrace

OCTOBER 1, 2021

As dynamic systems architectures increase in complexity and scale, IT teams face mounting pressure to track and respond to conditions and issues across their multi-cloud environments. Dynatrace news. As teams begin collecting and working with observability data, they are also realizing its benefits to the business, not just IT.

Metrics 363

Metrics Open Source Monitoring Infrastructure 363

The Netflix TechBlog

JANUARY 13, 2022

Batch Pensive Batch Pensive Architecture Batch workflows in the data platform run using a Scheduler service that launches containers on the Netflix container management platform called Titus to run workflow steps.

Big Data 238

Big Data Infrastructure Metrics Hardware 238

Dynatrace

OCTOBER 28, 2021

But with the complexity that comes with digital transformation and cloud-native architecture, teams need a way to make sure applications can withstand the “chaos” of production. Practitioners subject software to a controlled, simulated crisis to test for unstable behavior. Dynatrace news. Chaos engineers ask why.

Engineering 228

Engineering Entertainment Cloud Infrastructure 228

Dynatrace

AUGUST 12, 2020

As companies strive to innovate and deliver faster, modern software architecture is evolving at near the speed of light. It allows for the breaking up of heavy monolithic architectures into multiple serverless “functions.” Understand and optimize your architecture. Dynatrace news. Azure Functions in a nutshell.

Serverless 142

Serverless Azure Monitoring Lambda 142

Dynatrace

MAY 1, 2020

The investment continues—we’re anticipating an upcoming release of the AWS Graviton2 processor , which has already been announced to be significantly more powerful than its predecessor. Other distributions like Debian and Fedora are available as well, in addition to other software like VMware, NGINX, Docker, and, of course, Java.

Java 133

Java Hardware Tuning Metrics 133

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

Dynatrace

SEPTEMBER 30, 2021

Cloud services platforms like AWS, Azure, and GCP are reshaping how organizations deliver value to their customers, making cloud migration an increasingly attractive option for running applications. They need enough hardware to serve their anticipated volume and keep things running smoothly without buying too much or too little.

Cloud 167

Cloud Traffic Best Practices Strategy 167

All Things Distributed

AUGUST 16, 2012

The best practices that we are collecting in the AWS Economics Center are there to help our customers get a total view on their IT cost such that they can accurately compare on-premise and cloud. The AWS Economics Center now features the TCO of Web Applications whitepaper. Total Cost of Ownership and the Return on Agility. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. Shell leverages AWS for big data analytics to help achieve these goals.

Cloud 129

Cloud Energy AWS Healthcare 129

Brendan Gregg

FEBRUARY 28, 2023

link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 56

Hardware Latency Virtualization Cloud 56

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. Every VFX studio has a slightly different architecture and workflow, and a one-size-fits-all solution often isn’t enough to bridge the gap.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Testsigma

MAY 19, 2021

Infrastructure as a Service is the term used for those cloud-based solutions that provide complete infrastructure to the users including all the overheads, hardware, and networking facilities. These may include operating systems and other software on the machine. Software as a Service (SaaS). Source: Twitter. is a bad idea.

DevOps 59

DevOps Cloud Artificial Intelligence Infrastructure 59

All Things Distributed

JULY 13, 2010

During my academic career, I spent many years working on HPC technologies such as user-level networking interfaces, large scale high-speed interconnects, HPC software stacks, etc. There is no more need for hardware tinkering to keep the clusters up and running (I spent many nights doing this; there is no glory in it). until today.

Cloud 118

Cloud AWS Automotive Latency 118

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

All Things Distributed

DECEMBER 20, 2017

These examples underline that the purpose of software today is not solely to support business processes, but that software solutions have broadly become an essential element in multiple business areas. This is done through software and IT services that are delivered through software APIs. More than mere support.

Artificial Intelligence 79

Artificial Intelligence Social Media Logistics AWS 79

VoltDB

JUNE 1, 2017

Hardware Optimizers” want to get the maximum utilization out of hardware. These systems were designed to have a lifetime of half a decade or more, and rapidly changing hardware meant that the initial deployment had to be sized for 5-7 years out. Attendees could be broken down into several distinct groups.

Hardware 40

Hardware Latency Virtualization Cloud 40

Nick Desaulniers

APRIL 6, 2020

has given me much fulfilment and a long list of truly awful bugs to recount. halt (); Some sort of very early exception handler; better to sit busy in an infinite loop than run off and destroy hardware or corrupt data, I suppose. Recent work. May I present to you episode I; “ Off by Two.” halt_loop: while ( true ).

C++ 67

C++ Hardware Code Virtualization 67

Brendan Gregg

FEBRUARY 28, 2023

link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Percona

APRIL 17, 2023

The swap issue is explained in the excellent article by Jeremy Cole at the Swap Insanity and NUMA Architecture. There is an issue with this, which causes the OS to swap even with memory available. The report focuses on MySQL, but it is valid for MongoDB as well. This is because the setting has no use in modern PCIe/NVMe devices.

Best Practices 52

Best Practices Design Tuning Database 52

Percona

JULY 26, 2023

It is recommended to upgrade your stack as soon as possible to take advantage of improvements and any security-related software updates. To make this process work more efficiently and ensure a smooth failover, it is important to have the same hardware configuration on all the nodes of the replica set.

Database 84

Database Servers Storage Strategy 84

High Scalability

OCTOBER 24, 2022

Limit the cloud services a cloud provider can offer and you limit the quality of the software we can build. Each cloud-native evolution is about using the hardware more efficiently. Building software is not moving freight. It would make the job of building quality software even harder and slower and more expensive.

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. This is a given, whether you are using the highest quality hardware or lowest cost components.

AWS 144

AWS Hardware Retail Virtualization 144

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. Let me expand on each one of them. DynamoDB Streams.

Database 167

Database Lambda AWS IoT 167

Smashing Magazine

JANUARY 6, 2020

On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Still, after all these years, keeping progressive enhancement as the guiding principle of your front-end architecture and deployment is a safe bet. Use progressive enhancement as a default.

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

On the other hand, we have hardware constraints on memory and CPU due to JavaScript parsing times (we’ll talk about them in detail later). Keeping progressive enhancement as the guiding principle of your front-end architecture and deployment is a safe bet. Consider using PRPL pattern and app shell architecture.

Performance 103

Performance Cache Metrics Network 103