Dynatrace

NOVEMBER 23, 2020

While speeding up development processes and reducing complexity does make the lives of Kubernetes operators easier, the inherent abstraction and automation can lead to new types of errors that are difficult to find, troubleshoot, and prevent. Configuring storage in Kubernetes is more complex than using a file system on your host.

Virtualization 161

Virtualization Infrastructure Monitoring Cloud 161

Scalegrid

JANUARY 8, 2024

Key Takeaways AI integration in cloud computing increases operational efficiency by automating processes, optimizing resource allocation, and improving scalability, leading to cost savings and allowing IT teams to concentrate on strategic initiatives. Discover how AI is reshaping the cloud and what this means for the future of technology.

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

All Things Distributed

OCTOBER 16, 2019

Already, IoT is delivering deep and precise insights to improve virtually every aspect of our lives. Because these IoT devices are powered by microprocessors or microcontrollers that have limited processing power and memory, they often rely heavily on AWS and the cloud for processing, analytics, storage, and machine learning.

IoT 126

IoT Healthcare Internet Internet 126

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Virtual Memory. Storage I/O. Alex Maestretti (security) co-presented SecOps 2021 Today: Using AWS Services to Deliver SecOps. schedtool –B PID. vm.swappiness = 0 # from 60. Huge Pages.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Virtual Memory. Storage I/O. Alex Maestretti (security) co-presented SecOps 2021 Today: Using AWS Services to Deliver SecOps. schedtool –B PID. vm.swappiness = 0 # from 60. Huge Pages.

Tuning 52

Tuning AWS Best Practices Network 52

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics.

AWS 111

AWS Government Big Data Cloud 111

HammerDB

APRIL 19, 2023

Regardless of whether the computing platform to be evaluated is on-prem, containerized, virtualized, or in the cloud, it is crucial to consider several essential factors. As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components.

Performance 54

Performance Benchmarking Cache Storage 54

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. When providing some functionality for processing a file uploaded by the user, the file must be available to the process throughout the execution. Leonardo Losoviz. 2018-11-08T12:30:30+01:00. 2019-04-29T18:34:58+00:00.

AWS 44

AWS Servers Storage Cloud 44

Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

JULY 19, 2012

AWS customers are bringing their most demanding workloads onto the cloud. Customers are also bringing workloads on AWS that require dedicated and high performance IO for which we are now introducing a new Amazon EC2 instance type, the High I/O Quadruple Extra Large (hi1.4xlarge), to meet their needs. Comments (). Scaling to Infinityâ??

Cloud 129

Cloud Performance AWS Virtualization 129

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

All Things Distributed

DECEMBER 18, 2012

After the AWS re: Invent conference I spent two weeks in Europe for the last customer visits of the year. Although there are still a few very exciting AWS news updates to happen this year. May 28 - Virtual Time and Global States of Distributed Systems , Friedemann Mattern, Parallel and Distributed Algorithms, North-Holland (1989) , p.

Operating System 144

Operating System Cache AWS Scalability 144

Adrian Cockcroft

APRIL 18, 2018

For each resource there’s usually an underlying or bare metal version, a virtualized resource and sometimes also a containerized resource. This is true for CPU, network, memory and storage, and also for bare metal, virtual machines, containers, processes, functions and threads.

Monitoring 40

Monitoring Systems Virtualization Metrics 40

Scalegrid

MARCH 14, 2024

Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution. On-Premises Data Center A hybrid cloud architecture necessitates that an organization retains full authority over its physical or virtual infrastructure within the private cloud segment.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. Each dimension has progressed through these stages: 1.

Virtualization 40

Virtualization AWS Hardware Storage 40

Adrian Cockcroft

JUNE 21, 2022

I saw Erik Fisher last time I was in Budapest, and Constantin Gonzalez later became one of the first AWS solutions architects in Germany, too many names to mention. I’d helped eBay recover from capacity related outages in 1999 and had setup their capacity planning processes. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Netflix TechBlog

SEPTEMBER 24, 2021

By Xiaomei Liu , Rosanna Lee , Cyril Concolato Introduction Behind the scenes of the beloved Netflix streaming service and content, there are many technology innovations in media processing. Packaging has always been an important step in media processing. Uploading and downloading data always come with a penalty, namely latency.

Cloud 237

Cloud Media Storage Cache 237

Scalegrid

JANUARY 12, 2024

Various forms can take shape when discussing workloads within the realm of cloud computing environments – examples include order management databases, collaboration tools, videoconferencing systems, virtual desktops, and disaster recovery mechanisms. Storage is a critical aspect to consider when working with cloud workloads.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

SEPTEMBER 7, 2022

VPC Flow Logs is an Amazon service that enables IT pros to capture information about the IP traffic that traverses network interfaces in a virtual private cloud, or VPC. With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost.

Traffic 215

Traffic AWS Network Cloud 215

Dynatrace

AUGUST 27, 2020

Unlike other competitors in the market, the Dynatrace Software Intelligence Platform is purpose-built for dynamic enterprise cloud environments such as AWS, with full automation and AI at the core. Achieve full observability of all AWS services. The AWS services listed below are adding upon the services already released.

AWS 270

AWS Cloud IoT Database 270

Dynatrace

AUGUST 24, 2020

But there are other related components and processes (for example, cloud provider infrastructure) that can cause problems in applications running on Kubernetes. Dynatrace AWS monitoring gives you an overview of the resources that are used in your AWS infrastructure along with their historical usage. OneAgent and its Operator .

Analytics 241

Analytics Infrastructure AWS Operating System 241

Dynatrace

NOVEMBER 3, 2022

With the significant growth of container management software and services, enterprises need to find ways to simplify the process. CaaS automates the processes of hosting, deploying, and managing container technologies. Instead, enterprises manage individual containers on virtual machines (VMs). Process portability.

Serverless 218

Serverless Azure Hardware Transportation 218

Dynatrace

OCTOBER 11, 2021

In a time when modern microservices are easier to deploy, GCF, like its counterparts AWS Lambda and Microsoft Azure Functions , gives development teams an agility boost for delivering value to their customers quickly with low overhead costs. GCF also has relevance in IoT and file processing tasks. What is Google Cloud Functions?

Google 222

Google Cloud Serverless Azure 222

Dynatrace

AUGUST 24, 2020

But there are other related components and processes ( for example, cloud provider infrastructure ) that can cause problems in applications running on Kubernetes. Dynatrace AWS m onitoring gives you an overview of the resources that are used in your AWS infrastructure along with their historical usage.

Analytics 135

Analytics Infrastructure AWS Operating System 135

All Things Distributed

MARCH 11, 2016

The epoch of AWS is the launch of Amazon S3 on March 14, 2006, now almost 10 years ago. Given that AWS is a pioneer in building and operating these services world-wide, these lessons have been of crucial importance to our business. AWS helps its customers do this too.

AWS 144

AWS Hardware Retail Virtualization 144

KeyCDN

FEBRUARY 22, 2023

Chatbots and virtual assistants Chatbots and virtual assistants are becoming more common on websites and web applications as they provide an efficient and convenient way for users to interact with a business. These technologies can answer questions, provide customer support, or even complete transactions.

Artificial Intelligence 111

Artificial Intelligence Development Serverless Website 111

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform is a revolution in the way we handle infrastructure.

Open Source 52

Open Source DevOps AWS Azure 52

Percona

APRIL 17, 2023

Operating System (OS) settings Swappiness Swappiness is a Linux kernel setting that influences the behavior of the Virtual Memory manager when it needs to allocate a swap, ranging from 0-100. Without further ado, let’s start with the OS settings. A setting of 100 determines it to swap aggressively to disk. 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

O'Reilly

MAY 19, 2020

AWS is far and away the cloud leader, followed by Azure (at more than half of share) and Google Cloud. But most Azure and GCP users also use AWS; the reverse isn’t necessarily true. It encompasses private clouds, the IaaS cloud—also host to virtual private clouds (VPC)—and the PaaS and SaaS clouds. Amazon and AWS Ascendant.

Cloud 141

Cloud Serverless AWS Architecture 141

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform is a revolution in the way we handle infrastructure.

Open Source 40

Open Source DevOps AWS Azure 40

Adrian Cockcroft

APRIL 5, 2023

Energy data at the entire machine or raw cloud instance level needs to be apportioned to virtual machines or cloud instances which run an operating system, and to pods, containers and processes running applications and background activities that consume CPU, memory and I/O resources.

Energy 52

Energy Metrics Cloud Operating System 52

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

Brendan Gregg

SEPTEMBER 5, 2017

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). On Linux, containers are a combination of namespaces (restricting what a process sees) and cgroups (similar to Solaris resource controls). amazon").

Virtualization 76

Virtualization AWS Engineering Hardware 76

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Dynatrace

AUGUST 5, 2019

In this role, I am leading a global team that works closely with our strategic partners such as AWS, Microsoft, Google, Pivotal, Red Hat and others. Before starting any migration project, you must have a good overview of all your hosts, processes, services and technologies. Also accessible through the Smartscape API.

Cloud 31

Cloud Traffic Database Network 31

Smashing Magazine

JANUARY 11, 2021

Micro-optimizations are great for keeping performance on track, but it’s critical to have clearly defined targets in mind — measurable goals that would influence any decisions made throughout the process. Also, as Patrick Meenan suggested, it’s worth to plan out a loading sequence and trade-offs during the design process.

Performance 145

Performance Cache Media Metrics 145