All Things Distributed

JANUARY 23, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS Storage Gateway. Today Amazon Web Services has launched the AWS Storage Gateway, making the power of secure and reliable cloud storage accessible from customersâ?? s storage infrastructure.

Storage 115

Storage AWS Virtualization Cloud 115

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. Such demanding use cases place a great value on systems capable of fast and reliable execution, a need that spans across various industry segments.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. On-Premises Data Center A hybrid cloud architecture necessitates that an organization retains full authority over its physical or virtual infrastructure within the private cloud segment.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Dynatrace

JANUARY 16, 2023

As Kubernetes adoption increases and it continues to advance technologically, Kubernetes has emerged as the “operating system” of the cloud. Kubernetes is emerging as the “operating system” of the cloud. Accordingly, the remaining 27% of clusters are self-managed by the customer on cloud virtual machines.

Open Source 343

Open Source Java Operating System Programming 343

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

Dynatrace

AUGUST 11, 2022

Cloud providers then manage physical hardware, virtual machines, and web server software management. Cloud providers such as Google, Amazon Web Services, and Microsoft also followed suit with frameworks such as Google Cloud Functions , AWS Lambda , and Microsoft Azure Functions. How does function as a service work? Limited visibility.

Development 250

Development Serverless Best Practices Lambda 250

Dynatrace

SEPTEMBER 7, 2022

VPC Flow Logs is an Amazon service that enables IT pros to capture information about the IP traffic that traverses network interfaces in a virtual private cloud, or VPC. With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost.

Traffic 215

Traffic AWS Network Cloud 215

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs.

AWS 212

AWS Strategy Storage Metrics 212

Dynatrace

NOVEMBER 3, 2022

These containers are software packages that include all the relevant dependencies needed to run software on any system. Instead, enterprises manage individual containers on virtual machines (VMs). Container-based software isn’t tied to a platform or operating system, so IT teams can move or reconfigure processes easily.

Serverless 218

Serverless Azure Hardware Transportation 218

Dynatrace

AUGUST 24, 2020

To make this possible, the application code should be instrumented with telemetry data for deep insights, including: Metrics to find out how the behavior of a system has changed over time. Traces help find the flow of a request through a distributed system. Dynatrace VMware and virtualization documentation .

Analytics 240

Analytics Infrastructure AWS Operating System 240

Dynatrace

MAY 26, 2021

From May 17 to May 18, 2021, the Open-Source Engineering team at Dynatrace attended the virtual observability conference, o11yfest. The second focused on the OTel community, with more technical talks by representatives from companies like AWS, Elastic, and more. Trace-based sampling can help you save storage costs.

AWS 147

AWS Strategy Storage Metrics 147

Dynatrace

NOVEMBER 23, 2020

Nevertheless, there are related components and processes, for example, virtualization infrastructure and storage systems (see image below), that can lead to problems in your Kubernetes infrastructure. Configuring storage in Kubernetes is more complex than using a file system on your host.

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought provoking.

Performance 140

Performance Latency Hardware Storage 140

Dynatrace

OCTOBER 11, 2021

In a time when modern microservices are easier to deploy, GCF, like its counterparts AWS Lambda and Microsoft Azure Functions , gives development teams an agility boost for delivering value to their customers quickly with low overhead costs. What is Google Cloud Functions? Using GCF within a video analysis workflow. Image courtesy of Google.

Google 221

Google Cloud Serverless Azure 221

Dynatrace

AUGUST 24, 2020

Metrics to find out how the behavior of a system has changed over time . Traces help find the flow of a request through a distributed system . To provide actionable answers monitoring systems store, baseline, and analyze telemetry data. Dynatrace VMware and virtualization documentation .

Analytics 135

Analytics Infrastructure AWS Operating System 135

Scalegrid

JANUARY 8, 2024

Artificial intelligence can automate tasks ranging from: data analysis resource provisioning system maintenance decision-making natural language processing This not only improves accuracy and reliability but also frees up valuable time for IT teams to focus on strategic tasks, such as resource management on platforms like Google Cloud.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. Build evolvable systems. Systems need to keep running even if the “house is on fire.”

AWS 144

AWS Hardware Retail Virtualization 144

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 61

Tuning AWS Best Practices Network 61

Adrian Cockcroft

APRIL 18, 2018

In reality, in any non-trivial installation, there are multiple tools collecting, storing and displaying overlapping sets of metrics from many types of systems and different levels of abstraction. For each resource there’s usually an underlying or bare metal version, a virtualized resource and sometimes also a containerized resource.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work.

Tuning 52

Tuning AWS Best Practices Network 52

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. Therefore, before we attempt to measure our database performance, we should know the system or cloud instance to be tested in detail. Operating System: Ubuntu 22.04

Performance 54

Performance Benchmarking Cache Storage 54

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. WordPress is a content management system (CMS) used to build and manage websites and web applications.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. The importance of relationships.

Database 134

Database Logistics Availability Social Media 134

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 128

Internet Internet AWS Performance 128

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. But since this article is about connecting an application running on the server with AWS S3, we don’t consider this solution. Leonardo Losoviz. 2018-11-08T12:30:30+01:00. 2019-04-29T18:34:58+00:00. Creating The Bucket.

AWS 44

AWS Servers Storage Cloud 44

All Things Distributed

JULY 19, 2012

Werner Vogels weblog on building scalable and robust distributed systems. AWS customers are bringing their most demanding workloads onto the cloud. With PV virtualization we are seeing between 10,000 and 85,000 IOPS for 4k random writes and with HVM between 9,000 and 75,000. All Things Distributed. Expanding The Cloud â??

Cloud 129

Cloud Performance AWS Virtualization 129

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. Note that my predictions in this talk may be wrong, but they should be thought-provoking.

Performance 52

Performance Latency Hardware Storage 52

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍AutomationCode-based systems also shine in automation.

Open Source 52

Open Source DevOps AWS Azure 52

Brendan Gregg

FEBRUARY 28, 2023

This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person! CXL in a way allows a custom memory controller to be added to a system, to increase memory capacity, bandwidth, and overall performance. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Percona

APRIL 17, 2023

In this blog post, we will discuss the best practices on the MongoDB ecosystem applied at the Operating System (OS) and MongoDB levels. Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100.

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. Bar-Yam, Journal of Systems Science and Complexity.

Operating System 144

Operating System Cache AWS Scalability 144

Adrian Cockcroft

APRIL 5, 2023

The usual technique for modeling fuzzy systems is Monte Carlo analysis, which computes with distributions rather than precise values. Energy data can be obtained from power delivery systems in datacenters or from intelligent plugs or power strips. At the one minute granularity security concerns are minimized.

Energy 52

Energy Metrics Cloud Operating System 52

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. This level of granularity is not found in UI-managed systems.

Open Source 40

Open Source DevOps AWS Azure 40

Percona

DECEMBER 20, 2018

Now that Database-as-a-service (DBaaS) is in high demand, there is one question regarding AWS services that cannot always be answered easily : When should I use Aurora and when RDS MySQL ? We’ll note how some of the Linux parameter settings used OS tuning may vary according to different system types: physical, virtual or cloud.

Database 40

Database Tuning Performance AWS 40

Adrian Cockcroft

JUNE 21, 2022

Photo by Adrian I spent six years at Cambridge Consultants, building some interesting systems, managing our Sun workstations and learning a lot, but by then Sun had opened a sales office across the street, and I wanted to find out what they were going to release next, before everyone else. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52