Adrian Cockcroft

NOVEMBER 26, 2023

The Pantheon in Rome — Extremely sustainable architecture — photo by Adrian I wrote a medium post after AWS re:Invent 2022 summarizing the (lack of) news and all the talks related to Sustainability. This includes providing the efficient, resilient services AWS customers expect, while minimizing their environmental footprint.

AWS 52

AWS Energy IoT Best Practices 52

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) But the ephemeral storage service for intermediate data is not based on S3.

Storage 112

Storage Engineering Cache Serverless 112

Dynatrace

SEPTEMBER 17, 2019

Instead of presenting you with a handful of random screenshots from our demo environment I reached out to Robert, a close friend of mine, who leads a development team with the current task to re-architect and re-platform their multi-tenant SaaS-based eCommerce platform. PostgreSQL & Elastic for data storage. REDIS for caching.

AWS 127

AWS Monitoring Ecommerce Lambda 127

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud 120

Cloud Serverless AWS Storage 120

Dynatrace

SEPTEMBER 7, 2022

With Amazon Web Services, the main sources from which to ingest logs—Simple Storage Service, or S3, and CloudWatch —come with an additional cost. As of today’s announcement, AWS and Dynatrace strengthen their commitment to their customers to continue to deliver quality and value. The Dynatrace VPC Flow Log analysis capability.

Traffic 214

Traffic AWS Network Cloud 214

Dynatrace

JUNE 26, 2020

With today’s high expectations for the speed and availability of applications, you need a deep understanding of real user experiences to make the best business decisions. Dynatrace Synthetic Monitoring ensures that your application is available and performs well from anywhere in the world to meet your SLAs. Virginia (AWS) ?,

Monitoring 256

Monitoring Azure AWS Traffic 256

Dynatrace

MAY 6, 2021

Contact Dynatrace ONE if you wish to enable Cluster-side screenshot storage on pre-1.216 fresh-installed Clusters. Self-service update packages management is now available. You can safe your disk space and have more control over what’s available to your cluster . Now only valid versions are available to choose.

Operating System 229

Operating System AWS Metrics Storage 229

Scalegrid

MARCH 14, 2024

Public Cloud Infrastructure Third-party providers run public cloud services, delivering a broad array of offerings like computing power, storage solutions, and network capabilities that enhance the functionality of a hybrid cloud architecture. We will examine each of these elements in more detail. It should offer user-friendly operation.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Scalegrid

JANUARY 8, 2024

Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. The company utilizes public cloud resources such as Amazon Web Services (AWS) for streaming purposes and maintains on-premises infrastructure for content creation and processing.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Dynatrace

DECEMBER 16, 2020

All steps are fully automated, from source code being compiled to binaries, to the upload of the binaries to the AWS infrastructure where they are available for customers to download. Every storage location involving data at rest is encrypted as well. No manual, error-prone steps are involved. Continuous improvements.

Software 232

Software Software Development AWS 232

Scalegrid

JANUARY 12, 2024

While managing cloud workloads offers numerous benefits, it also presents several challenges such as security risks, compliance issues, and resource optimization, which can be addressed effectively with tools like ScaleGrid, offering features like encryption, disaster recovery, and real-time resource optimization for diverse databases.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Scalegrid

DECEMBER 16, 2019

While you may assume a great majority of the cloud database deployments are run on AWS, Azure, or Google Cloud Platform, small to medium-sized businesses in particular are gravitating towards the developer-friendly cloud provider, DigitalOcean , for their hosting for MongoDB® needs. DigitalOcean Advantages for MongoDB. DigitalOcean Droplets.

Azure 187

Azure AWS Latency Database 187

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Cloud-hosted Kubernetes clusters are on par to overtake on-premises deployments in 2023.

Open Source 342

Open Source Java Operating System Programming 342

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Casey Rosenthal (traffic and chaos) Models of Availability. John Bennett (networking) co-presented How Netflix Monitors Applications in Near Real-Time with Amazon Kinesis.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Casey Rosenthal (traffic and chaos) Models of Availability. John Bennett (networking) co-presented How Netflix Monitors Applications in Near Real-Time with Amazon Kinesis.

Tuning 52

Tuning AWS Best Practices Network 52

All Things Distributed

OCTOBER 16, 2019

Because these IoT devices are powered by microprocessors or microcontrollers that have limited processing power and memory, they often rely heavily on AWS and the cloud for processing, analytics, storage, and machine learning. Sometimes an internet connection is weak or not available at all, as is often the case in remote locations.

IoT 126

IoT Healthcare Internet Internet 126

The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! To sustain this data growth at Netflix, it has deployed open-source software Ceph using AWS services to achieve the required SLOs of some of the post-production workflows.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

MARCH 28, 2023

repo1-path=/var/lib/pgbackrest_repo1 --repo2-path=/var/lib/pgbackrest_repo2 If the first repo is unavailable and the second repo is available, then, in this case, the pgBackRest will continue copying/archiving the wal files to the second repo. One can configure both repositories in different storage.

Servers 84

Servers Azure AWS Cloud 84

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. Today AWS announced the launch of the AWS GovCloud (US) Region. The concept of regions gives AWS customers control over the placement of their resources and services. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems.

AWS 111

AWS Government Big Data Cloud 111

Smashing Magazine

NOVEMBER 8, 2018

Sharing Data Among Multiple Servers Through AWS S3. Sharing Data Among Multiple Servers Through AWS S3. When providing some functionality for processing a file uploaded by the user, the file must be available to the process throughout the execution. A simple upload and save operation presents no issues. Leonardo Losoviz.

AWS 44

AWS Servers Storage Cloud 44

The Netflix TechBlog

JULY 30, 2019

In this blog, we would like to present the latest updates to Conductor, address some of the frequently asked questions and thank the community for their contributions. Our cluster size ranges from 12–18 instances of AWS EC2 m4.4xlarge instances, typically running at ~30% capacity. *?—?Cassandra

Lambda 189

Lambda Media Open Source Metrics 189

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

IO River

NOVEMBER 2, 2023

It’s not just limited to cloud resources like AWS and Azure; Terraform is versatile, extending its capabilities to key performance areas like Content Delivery Network (CDN) management, ensuring efficient content delivery and optimal user experience.‍Started ‍Terraform, on the other hand, presents a stark contrast.

Open Source 52

Open Source DevOps AWS Azure 52

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. I won’t cover all the features but show just enough that you’ll want to see more of what you can learn to accomplish for yourself.

Database 106

Database Benchmarking Latency C++ 106

Adrian Cockcroft

APRIL 5, 2023

The challenge is that accurate data isn’t available immediately, and cloud providers currently only provide monthly carbon data, with several months lag. I published a paper and presentation in 2006 that discusses the complexities of measuring CPU utilization. At the one minute granularity security concerns are minimized.

Energy 52

Energy Metrics Cloud Operating System 52

IO River

NOVEMBER 2, 2023

In fact, Amazon Web Services (AWS) paved the way with its service, CloudFormation, which introduced the concept of Infrastructure as Code (IaC). Taking inspiration from AWS's CloudFormation, HashiCorp introduced Terraform with a broader vision. Terraform, on the other hand, presents a stark contrast.

Open Source 40

Open Source DevOps AWS Azure 40

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. There is an issue with this, which causes the OS to swap even with memory available. Spoiler alert: This post focuses on MongoDB 3.6.X 25.84 - Total 21.04

Best Practices 52

Best Practices Design Tuning Database 52

All Things Distributed

JULY 3, 2011

Next to customer visits I will take part in a number of events organized by AWS and by our partners. This week in Japan there are three public events planned: July 4 - AWS HPC Night at Fuji Soft Hall in Akihabara. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events.

AWS 67

AWS Storage Big Data Cloud 67

The Symphonia

JUNE 19, 2018

Some in-depth and unusual client work (want to encrypt a petabyte of S3 storage? I was fortunate to be both presenting a 2-day workshop (on AWS Serverless Architectures and Continuous Deployment) as well as hosting a full-day Serverless track of talks. Unlike the temperature outside. Great stuff!

Serverless 40

Serverless AWS DevOps Open Source 40

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 135

Analytics Cloud Healthcare Retail 135

Adrian Cockcroft

JUNE 21, 2022

I also learned how marketing worked, and began to build my presentation and training skills as I was sent around the world by Sun to teach workshops and speak at events. At one point we had two conflicting high availability products from different teams, who weren’t cooperating. He hasn’t changed.

Tuning 52

Tuning Benchmarking Engineering C++ 52

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Enprowess

JANUARY 12, 2022

Other benefits: It has other benefits like a Quicker launch to the market, Easier distribution, saving device power and storage, seamless maintenance, and updating. 24*7 Availability : Chatbots are available 24×7 and can respond to your customer’s queries as fast as possible. Famous PWA Use Examples. Image Source. Image Source.

Blockchain 59

Blockchain IoT Development Serverless 59

The Morning Paper

MAY 28, 2019

We don’t talk about energy as often as we probably should on this blog, but it’s certainly true that our data centres and various IT systems consume an awful lot of it. The evaluation is performed using the MNIST dataset, since that has the most results available in the literature for comparison. ASPLOS’19.

Energy 52

Energy Hardware Efficiency Architecture 52

Adrian Cockcroft

NOVEMBER 11, 2019

This is why most AWS regions have three availability zones. When there’s three ways to succeed, we still have two ways to succeed when a failure is present, and if data is corrupted, we can tell which of the three is the odd one out. There is no need to retry and no extra time taken when a failure is present.

Latency 52

Latency Engineering Systems Hardware 52

Adrian Cockcroft

NOVEMBER 11, 2019

This is why most AWS regions have three availability zones. When there’s three ways to succeed, we still have two ways to succeed when a failure is present, and if data is corrupted, we can tell which of the three is the odd one out. There is no need to retry and no extra time taken when a failure is present.

Latency 53

Latency Engineering Systems Hardware 53

The Netflix TechBlog

DECEMBER 3, 2019

both for compute and storage. Netflix has been one of the largest users of Amazon Web Services (AWS) for many years and we have accumulated plenty of operational experience and expertise in dealing with the cloud, AWS in particular. For more details, read this page about Metaflow’s integration with AWS.

Open Source 232

Open Source AWS Infrastructure Energy 232