Analytics, Big Data, Storage and Technology - Technology Performance Pulse

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage

Storage Systems Big Data Azure

Any analysis, any time: Dynatrace Log Management and Analytics powered by Grail

Dynatrace

OCTOBER 4, 2022

Log management and analytics is an essential part of any organization’s infrastructure, and it’s no secret the industry has suffered from a shortage of innovation for several years. Several pain points have made it difficult for organizations to manage their data efficiently and create actual value.

Analytics

Analytics Artificial Intelligence Storage Serverless

Data lakehouse innovations advance the three pillars of observability for more collaborative analytics

Dynatrace

FEBRUARY 16, 2023

The goal is to turn more data into insights so the whole organization can make data-driven decisions and automate processes. Grail data lakehouse delivers massively parallel processing for answers at scale Modern cloud-native computing is constantly upping the ante on data volume, variety, and velocity.

Analytics

Analytics Innovation Metrics Database

What is a data lakehouse? Combining data lakes and warehouses for the best of both worlds

Dynatrace

OCTOBER 4, 2022

A data lakehouse features the flexibility and cost-efficiency of a data lake with the contextual and high-speed querying capabilities of a data warehouse. Data warehouses offer a single storage repository for structured data and provide a source of truth for organizations. How does a data lakehouse work?

Artificial Intelligence

Artificial Intelligence Storage Analytics Government

Data Engineers of Netflix?—?Interview with Pallavi Phadnis

The Netflix TechBlog

OCTOBER 28, 2021

During earlier years of my career, I primarily worked as a backend software engineer, designing and building the backend systems that enable big data analytics. I developed many batch and real-time data pipelines using open source technologies for AOL Advertising and eBay.

Data Engineering

Data Engineering Engineering Big Data Software Engineering

In-Stream Big Data Processing

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. The pipelines can be stateful and the engine’s middleware should provide a persistent storage to enable state checkpointing. Interoperability with Hadoop.

Big Data

Big Data Processing Lambda Database

Advancing Application Performance with NVMe Storage, Part 3

DZone

JUNE 4, 2019

NVMe Storage Use Cases. NVMe storage's strong performance, combined with the capacity and data availability benefits of shared NVMe storage over local SSD, makes it a strong solution for AI/ML infrastructures of any size. There are several AI/ML focused use cases to highlight.

Storage

Storage FinTech Artificial Intelligence Performance

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. Driving Storage Costs Down for AWS Customers. Comments ().

Big Data

Big Data Analytics AWS Scalability

Advancing Application Performance with NVMe Storage, Part 1

DZone

MAY 30, 2019

With big data on the rise and data algorithms advancing, the ways in which technology has been applied to real-world challenges have grown more automated and autonomous. Financial analysis with real-time analytics is used for predicting investments and drives the FinTech industry's needs for high-performance computing.

Artificial Intelligence

Artificial Intelligence Social Media FinTech Storage

What is container orchestration?

Dynatrace

MARCH 24, 2023

Container technology enables organizations to efficiently develop cloud-native applications or to modernize legacy applications to take advantage of cloud services. Apache Mesos with the Marathon DC/OS is popular for large-scale production clusters running existing workloads on big data systems, such as Hadoop, Kafka, and Spark.

Infrastructure

Infrastructure Open Source Operating System Cloud

What is ITOps? Why IT operations is more crucial than ever in a multicloud world

Dynatrace

DECEMBER 15, 2022

As more organizations adopt cloud-native technologies, traditional approaches to IT operations have been evolving. Complex cloud computing environments are increasingly replacing traditional data centers. In fact, Gartner estimates that 80% of enterprises will shut down their on-premises data centers by 2025. So, what is ITOps?

Artificial Intelligence

Artificial Intelligence DevOps Hardware Virtualization

Redis vs Memcached in 2024

Scalegrid

MARCH 28, 2024

With these goals in mind, two in-memory data stores, Redis and Memcached, have emerged as the top contenders. This article will explore how they handle data storage and scalability, perform in different scenarios, and, most importantly, how these factors influence your choice. Data transfer technology.

Cache

Cache Storage Scalability Architecture

The Need for Real-Time Device Tracking

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT

IoT Analytics Big Data Architecture

Mastering Hybrid Cloud Strategy

Scalegrid

MARCH 14, 2024

Integrating technology from private and public clouds and on-premises resources within one hybrid cloud platform creates an integrated IT infrastructure that leverages the strengths of each component. We will examine each of these elements in more detail.

Strategy

Strategy Cloud Artificial Intelligence Infrastructure

Bulldozer: Batch Data Moving from Data Warehouse to Online Key-Value Stores

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. How Bulldozer leverages Spark, Protobuf and KV DAL for moving the data.

Latency

Latency Storage Big Data Tuning

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

The Amazon.com 2010 Shareholder Letter Focusses on Technology. In the 2010 Shareholder Letter Jeff Bezos writes about the unique technologies developed at Amazon.com over the years. Given that I have frequently written about many of these technologies on this blog I asked investor relations to be allowed to reprint it here.

Technology

Technology Technology AWS Storage

Expanding the Cloud: Introducing Amazon QuickSight

All Things Distributed

OCTOBER 7, 2015

However, the data infrastructure to collect, store and process data is geared toward developers (e.g., In AWS’ quest to enable the best data storage options for engineers, we have built several innovative database solutions like Amazon RDS, Amazon RDS for Aurora, Amazon DynamoDB, and Amazon Redshift. Big data challenges.

Cloud

Cloud Big Data AWS Analytics

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

All Things Distributed

DECEMBER 13, 2016

Today, I'm happy to announce that the AWS Europe (London) Region, our 16th technology infrastructure region globally, is now generally available for use by customers worldwide. The British Government is also helping to drive innovation and has embraced a cloud-first policy for technology adoption.

AWS

AWS Cloud Artificial Intelligence IoT

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

All Things Distributed

MAY 18, 2010

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage. Today a new storage option for Amazon S3 has been launched: Amazon S3 Reduced Redundancy Storage (RRS). This new storage option enables customers to reduce their costs by storing non-critical, reproducible data at lower levels of redundancy. Comments ().

Storage

Storage Cloud AWS Scalability

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

For example, the parameters for a ventilator could include its identifier, make and model, current location, status (in use, in storage, broken), time in use, technical issues and repairs, and contact information. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins.

Logistics

Logistics Analytics Scalability Cloud

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

For example, the parameters for a ventilator could include its identifier, make and model, current location, status (in use, in storage, broken), time in use, technical issues and repairs, and contact information. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins.

Logistics

Logistics Analytics Scalability Cloud

Dutch Enterprises and The Cloud

All Things Distributed

SEPTEMBER 6, 2013

Shell leverages AWS for big data analytics to help achieve these goals. Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands.

Cloud

Cloud Energy AWS Healthcare

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. With this new functionality AWS Import/Export now supports importing data directly into Amazon EBS snapshots. Driving Storage Costs Down for AWS Customers. At werner.ly Syndication. or rss feed.

AWS

AWS Cloud Storage Internet

Software Testing Trends 2021 – What can we expect?

Testsigma

FEBRUARY 12, 2021

The implementation of emerging technologies has helped improve the process of software development, testing, design and deployment. From AI to ML, the shifting technology world is constantly innovating and making significant progress. You will invest more time on technologies instead of bug fixes by implementing DevTestOps.

Artificial Intelligence

Artificial Intelligence Software Software IoT

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. The scalability, flexibility and the elasticity of AWS makes it an ideal environment for the agencies to run their analytics. Driving Storage Costs Down for AWS Customers. At werner.ly

AWS

AWS Government Big Data Cloud

New AWS feature: Run your website from Amazon S3 - All Things.

All Things Distributed

FEBRUARY 17, 2011

Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics.

AWS

AWS Website Storage Servers

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. Driving Storage Costs Down for AWS Customers. Comments ().

AWS

AWS Internet Internet Storage

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics.

Servers

Servers Social Media AWS Website

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Latency Storage Big Data

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. At werner.ly

AWS

AWS Database Storage Scalability

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

Cloud

Cloud Cache AWS Storage

Music to my Ears - All Things Distributed

All Things Distributed

MARCH 28, 2011

The scalability, reliability and durability requirements for Cloud Drive are very high which is why they decided to make use of the Amazon Simple Storage Service (S3) as the core component of their service. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. More details at [link].

AWS

AWS Cloud Storage Internet

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Retail Innovation Strategy

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Storage Big Data Servers

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Storage Big Data Scalability

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

Wireless

Wireless AWS Internet Internet

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Storage Big Data Scalability

Simplifying IT - Create Your Application with AWS CloudFormation.

All Things Distributed

FEBRUARY 25, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Cloud Scalability Storage

5 Terabyte Object Support in Amazon S3 - All Things Distributed

All Things Distributed

DECEMBER 9, 2010

By supporting such large object sizes, Amazon S3 better enables a variety of interesting big data use cases. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. At werner.ly Syndication. Subscribe to this weblogs.

AWS

AWS Big Data Scalability Storage

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Storage Cloud Big Data

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

Internet

Internet Internet AWS Scalability

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Driving down the cost of Big-Data analytics. The Amazon.com 2010 Shareholder Letter Focusses on Technology. At werner.ly he posts material that doesnt belong on this blog or on twitter. Syndication. or rss feed.

AWS

AWS Storage Big Data Cloud

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

All Things Distributed

APRIL 19, 2010

Amazon Cloudfront is the Content Delivery Network (CDN) that is dead simple to use both from a technology and a business point of view. From a technology point it literally takes a single button click in the console or a single API call to have your content CDN enabled. Driving Storage Costs Down for AWS Customers. At werner.ly

Media

Media AWS Storage Big Data

What is a Distributed Storage System

Any analysis, any time: Dynatrace Log Management and Analytics powered by Grail

Trending Sources

Data lakehouse innovations advance the three pillars of observability for more collaborative analytics

What is a data lakehouse? Combining data lakes and warehouses for the best of both worlds

Data Engineers of Netflix?—?Interview with Pallavi Phadnis

In-Stream Big Data Processing

Advancing Application Performance with NVMe Storage, Part 3

Driving down the cost of Big-Data analytics - All Things Distributed

Advancing Application Performance with NVMe Storage, Part 1

What is container orchestration?

What is ITOps? Why IT operations is more crucial than ever in a multicloud world

Redis vs Memcached in 2024

The Need for Real-Time Device Tracking

Mastering Hybrid Cloud Strategy

Bulldozer: Batch Data Moving from Data Warehouse to Online Key-Value Stores

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Expanding the Cloud: Introducing Amazon QuickSight

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Dutch Enterprises and The Cloud

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

Software Testing Trends 2021 – What can we expect?

The AWS GovCloud (US) Region - All Things Distributed

New AWS feature: Run your website from Amazon S3 - All Things.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

No Server Required - Jekyll & Amazon S3 - All Things Distributed

Introducing the AWS South America - All Things Distributed

Job Openings in AWS - Senior Leader in Database Services - All.

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Music to my Ears - All Things Distributed

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

From the Archives - Gapingvoid's Nobody Cares - All Things.

DROAM - Dreaming about Cheap Data Roaming - All Things.

Reboot - All Things Distributed

Simplifying IT - Create Your Application with AWS CloudFormation.

5 Terabyte Object Support in Amazon S3 - All Things Distributed

Spot Instances - Increased Control - All Things Distributed

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

APAC Summer Tour - All Things Distributed

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

Stay Connected