Availability, Energy, Software and Storage - Technology Performance Pulse

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage

Storage Systems Big Data Azure

Don’t follow the sun: Scheduling compute workloads to chase green energy can be counter-productive

Adrian Cockcroft

APRIL 7, 2023

Sunset in Morocco — photo taken by Adrian We want to reduce carbon emissions of our compute and storage workloads, and one way of doing this is to choose a time and place where the “grid mix” of energy consumed is less carbon intensive. The computers you stopped using aren’t following the sun.

Energy

Energy AWS Azure Cloud

Observability engineering: Getting Prometheus metrics right for Kubernetes with Dynatrace and Kepler

Dynatrace

DECEMBER 18, 2023

An essential observability engineering tool Prometheus is an open-source telemetry database service that records and stores custom software metrics and provides a standardized interface to pull (in Prometheus terms, “scrape”) data using HTTP requests. There are quite a few metrics we won’t immediately need for our use case of energy usage.

Metrics

Metrics Engineering Energy Tuning

Dynatrace Perform 2024 Guide: Deriving business value from AI data analysis

Dynatrace

JANUARY 23, 2024

AI data analysis can help development teams release software faster and at higher quality. Another key theme at Dynatrace Perform 2024 is organizations’ growing adoption of platform engineering , which helps accelerate the delivery of software applications. To learn more about platform engineering, explore the following resources.

Performance

Performance DevOps Innovation Artificial Intelligence

Implementing AWS well-architected pillars with automated workflows

Dynatrace

SEPTEMBER 13, 2023

In this blog post, we’ll demonstrate how Dynatrace automation and the Dynatrace Site Reliability Guardian can help you implement your applications according to all six AWS Well-Architected pillars by integrating them into your software development lifecycle (SDLC). This workflow uses the Dynatrace Site Reliability Guardian application.

AWS

AWS Efficiency Azure Cloud

AWS re:Invent 2023 guide: Generative AI takes a front seat

Dynatrace

NOVEMBER 20, 2023

The path to achieving unprecedented productivity and software innovation through ChatGPT and other generative AI – blog Paired with causal AI, organizations can increase the impact and safer use of ChatGPT and other generative AI technologies. So, what is artificial intelligence? What is cloud application security?

AWS

AWS Artificial Intelligence Analytics Cloud

Reducing PostgreSQL Costs in the Cloud

Percona

FEBRUARY 24, 2023

Let’s take a look at how to get the benefits you need while spending less, based on the recommendations presented by Dani Guzmán Burgos, our Percona Monitoring and Management (PMM) Tech Lead, on this webinar (now available on demand) hosted in November last year. These color-coded states on panels are available in PMM 2.32.0

Cloud

Cloud Serverless AWS Storage

Proposal for a Realtime Carbon Footprint Standard

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments.

Energy

Energy Metrics Cloud Operating System

Use Parallel Analysis – Not Parallel Query – for Fast Data Access and Scalable Computing Power

ScaleOut Software

JULY 27, 2018

Hosted on commodity clusters or cloud infrastructures, IMDGs harness the power of distributed computing to deliver scalable storage capacity and access throughput, along with integrated high availability. To help ensure fast data access and scalability, IMDGs usually employ a straightforward key/value storage model.

Scalability

Scalability Cache Airlines Healthcare

Progress Delayed Is Progress Denied

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. The information it captures is, however, available going back somewhat further, providing a fuller picture of the trend lines of engine completeness. Count of APIs available from JavaScript by Web Confluence.

Media

Media Games Education Engineering

Use Parallel Analysis – Not Parallel Query – for Fast Data Access and Scalable Computing Power

ScaleOut Software

JULY 27, 2018

Hosted on commodity clusters or cloud infrastructures, IMDGs harness the power of distributed computing to deliver scalable storage capacity and access throughput, along with integrated high availability. To help ensure fast data access and scalability, IMDGs usually employ a straightforward key/value storage model.

Scalability

Scalability Cache Airlines Healthcare

Observations on the Importance of Cloud-based Analytics

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. I have seen our customers do so many radical new things with the analytics tools that our partners and us make available that I have made a few observations I would like to share with you.

Analytics

Analytics Cloud Healthcare Retail

COLD, WARM, HOT … CLEAN, DIRTY, FREE … What Does All This Mean?

SQL Server According to Bob

AUGUST 8, 2016

The CPU has a property of requiring electricity and the physical translation of that energy into CPU activity results in heat. The local SSD used for Buffer Pool Extension is WARM because it is commonly faster than going to the stable storage (COLD, Disk.). Bob Dorr – Principal Software Engineer SQL Server.

Cache

Cache Energy Database Servers

Building a Media Understanding Platform for ML Innovations

The Netflix TechBlog

MARCH 14, 2023

We must quickly surface the most stand-out highlights from the titles available on our service in the form of images and videos in the member experience. We build creator tooling to enable these colleagues to focus their time and energy on creativity. Unfortunately, much of their energy goes into labor-intensive pre-work.

Media

Media Innovation Energy Architecture

Home Screen Advantage

Alex Russell

FEBRUARY 24, 2024

The data loss will be catastrophic for many, as will the removal of foundational features like reliable data storage, app-like UI, settings integration, Push Notifications, and unread counts. It knew this was coming, and special pleading at the 11th hour has big "the dog ate my homework" energy.

Storage

Storage Engineering Games Design

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We would focus our energy solely on improving data scientist productivity by being fanatically human-centric. both for compute and storage. If your workflow supports parallelism, Metaflow takes advantage of all CPU cores available on your development machine.

Open Source

Open Source AWS Infrastructure Energy

Frankenstein Migration: Framework-Agnostic Approach (Part 1)

Smashing Magazine

SEPTEMBER 26, 2019

In software development, the word “migration,” when we need to upgrade or change technology in a project, usually falls under the latter case, unfortunately. And like any other revolution, this approach might have side-effects, issues, and people full of energy to claim that this is not going to work even before they try.

Architecture

Architecture Virtualization Servers Technology

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

DECEMBER 3, 2019

mainly because of mundane reasons related to software engineering. We would focus our energy solely on improving data scientist productivity by being fanatically human-centric. both for compute and storage. If your workflow supports parallelism, Metaflow takes advantage of all CPU cores available on your development machine.

Open Source

Open Source AWS Infrastructure Energy

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

All Things Distributed

DECEMBER 13, 2016

Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide. With the launch of the AWS Europe (London) Region, I look forward to seeing many more innovative use cases enabled by AWS.

AWS

AWS Cloud Artificial Intelligence IoT

State Management and Scheduling with the Amazon EC2 Container Service

All Things Distributed

APRIL 9, 2015

These are challenging problems that engineers building software systems have been trying to solve for a long time. Our customers expect to spin up a pool of compute resources for their clusters on demand and dynamically change the resources available as their jobs change over time. State Management with Amazon ECS.

Energy

Energy AWS Scalability Availability

Technology Performance Pulse

What is a Distributed Storage System

Don’t follow the sun: Scheduling compute workloads to chase green energy can be counter-productive

Trending Sources

Observability engineering: Getting Prometheus metrics right for Kubernetes with Dynatrace and Kepler

Dynatrace Perform 2024 Guide: Deriving business value from AI data analysis

Implementing AWS well-architected pillars with automated workflows

AWS re:Invent 2023 guide: Generative AI takes a front seat

Reducing PostgreSQL Costs in the Cloud

Proposal for a Realtime Carbon Footprint Standard

Use Parallel Analysis – Not Parallel Query – for Fast Data Access and Scalable Computing Power

Progress Delayed Is Progress Denied

Use Parallel Analysis – Not Parallel Query – for Fast Data Access and Scalable Computing Power

Observations on the Importance of Cloud-based Analytics

COLD, WARM, HOT … CLEAN, DIRTY, FREE … What Does All This Mean?

Building a Media Understanding Platform for ML Innovations

Home Screen Advantage

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

Frankenstein Migration: Framework-Agnostic Approach (Part 1)

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

State Management and Scheduling with the Amazon EC2 Container Service

Stay Connected