Big Data, Cloud, Database and Storage - Technology Performance Pulse

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data.

Big Data

Big Data Database Artificial Intelligence Open Source

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage

Storage Systems Big Data Azure

What is cloud monitoring? How to improve your full-stack visibility

Dynatrace

JANUARY 11, 2023

In fact, according to a Dynatrace global survey of 1,300 CIOs , 99% of enterprises utilize a multicloud environment and seven cloud monitoring solutions on average. What is cloud monitoring? Cloud monitoring is a set of solutions and practices used to observe, measure, analyze, and manage the health of cloud-based IT infrastructure.

Cloud

Cloud Monitoring Best Practices Infrastructure

Mastering Hybrid Cloud Strategy

Scalegrid

MARCH 14, 2024

Mastering Hybrid Cloud Strategy Are you looking to leverage the best private and public cloud worlds to propel your business forward? A hybrid cloud strategy could be your answer. This approach allows companies to combine the security and control of private clouds with public clouds’ scalability and innovation potential.

Strategy

Strategy Cloud Artificial Intelligence Infrastructure

Redis vs Memcached in 2024

Scalegrid

MARCH 28, 2024

Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios. can enhance Redis by handling management tasks, backups, and scalability, facilitating global reach and easy cloud integration for global businesses. Data transfer technology. 3d render.

Cache

Cache Storage Scalability Architecture

Kubernetes in the wild report 2023

Dynatrace

JANUARY 16, 2023

Modern, cloud-native computing is impossible to separate from containers and Kubernetes adoption. As Kubernetes adoption increases and it continues to advance technologically, Kubernetes has emerged as the “operating system” of the cloud. Kubernetes moved to the cloud in 2022. Kubernetes moved to the cloud in 2022.

Open Source

Open Source Java Operating System Programming

Conducting log analysis with an observability platform and full data context

Dynatrace

APRIL 20, 2023

With more automated approaches to log monitoring and log analysis, however, organizations can gain visibility into their applications and infrastructure efficiently and with greater precision—even as cloud environments grow. Further, business leaders must often determine whether the data is relevant for the business and if they can afford it.

Analytics

Analytics Infrastructure Storage Efficiency

Helios: hyperscale indexing for the cloud & edge – part 1

The Morning Paper

OCTOBER 26, 2020

Helios: hyperscale indexing for the cloud & edge , Potharaju et al., On the surface this is a paper about fast data ingestion from high-volume streams, with indexing to support efficient querying. Cloud-native systems represent by far the largest, most distributed, computing systems in our history. PVLDB’20.

Cloud

Cloud Big Data Latency Architecture

Data lakehouse innovations advance the three pillars of observability for more collaborative analytics

Dynatrace

FEBRUARY 16, 2023

Grail data lakehouse delivers massively parallel processing for answers at scale Modern cloud-native computing is constantly upping the ante on data volume, variety, and velocity. To solve this problem, Dynatrace launched Grail, its causational data lakehouse , in 2022.

Analytics

Analytics Innovation Metrics Database

Expanding the Cloud ? Managing Cold Storage with Amazon Glacier

All Things Distributed

AUGUST 20, 2012

Expanding the Cloud â?? Managing Cold Storage with Amazon Glacier. With the introduction of Amazon Glacier , IT organizations now have a solution that removes the headaches of digital archiving and provides extremely low cost storage. Data is retrieved by scheduling a job, which typically completes within 3 to 5 hours.

Storage

Storage Cloud AWS Media

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud. Driving Storage Costs Down for AWS Customers. Expanding the Cloud â??

Big Data

Big Data Analytics AWS Cloud

Reduce RPO, Encrypt Backups, and More in 1.15.0 Release of Percona Operator for MongoDB

Percona

OCTOBER 18, 2023

release , we added support for physical backups and restores to significantly reduce Recovery Time Objective ( RTO ), especially for big data sets. However, the problem of losing data between backups – in other words, Recovery Point Objective (RPO) – for physical backups was not solved. spec: backup: enabled: true.

Best Practices

Best Practices Storage AWS Big Data

The Need for Real-Time Device Tracking

ScaleOut Software

JULY 19, 2021

Incoming data is saved into data storage (historian database or log store) for query by operational managers who must attempt to find the highest priority issues that require their attention. The best they can usually do in real-time using general purpose tools is to filter and look for patterns of interest.

IoT

IoT Analytics Big Data Architecture

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Expanding the Cloud - Introducing Amazon ElastiCache. There are many success stories about the effectiveness of caching in many different scenarios; next to helping applications achieving fast and predictable performance, it often protects databases from requests bursts and brownouts under overload conditions. Expanding the Cloud â??

Cloud

Cloud Cache AWS Storage

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

Expanding the Cloud - AWS Import/Export Support for Amazon EBS. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems.

AWS

AWS Cloud Storage Internet

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Expanding the Cloud â??

AWS

AWS Database Storage Scalability

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo) Region. A local AWS Region enables companies to deploy a global cloud platform for their operations. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? All Things Distributed.

AWS

AWS Cloud Games Latency

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements. Comments ().

AWS

AWS Cloud Java Scalability

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

All Things Distributed

JULY 13, 2010

Expanding the Cloud - Cluster Compute Instances for Amazon EC2. Today, Amazon Web Services took very an important step in unlocking the advantages of cloud computing for a very important application area. Unlocking the benefits of the cloud for the HPC community. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud

Cloud AWS Automotive Latency

A case for ELT

Abhishek Tiwari

DECEMBER 22, 2017

Cheap storage and on-demand compute in the cloud coupled with the emergence of new big data frameworks and tools are forcing us to rethink the whole ETL and data warehousing architecture. Then we perform frequent batch ETL from application databases to a data warehouse. Classic ETL.

Big Data

Big Data Retail Storage Google

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

All Things Distributed

DECEMBER 5, 2010

Expanding the Cloud with DNS - Introducing Amazon Route 53. Amazon Route 53 sets itself apart from other DNS services that are being offered in several ways: A familiar cloud business model : A complete self-service environment with no sales people in the loop. Driving Storage Costs Down for AWS Customers. Comments ().

Cloud

Cloud Internet Internet AWS

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. These questions can be answered using the latest data as it streams in from the field. What are real-time digital twins and why are they useful here?

Logistics

Logistics Analytics Scalability Cloud

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

An innovative new software approach called “real-time digital twins” running on a cloud-hosted, highly scalable, in-memory computing platform can help address this challenge. These questions can be answered using the latest data as it streams in from the field. What are real-time digital twins and why are they useful here?

Logistics

Logistics Analytics Scalability Cloud

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Recent Entries.

Servers

Servers Social Media AWS Website

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. This new region, which is located on the West Coast of the US, helps US government agencies and contractors move more of their workloads to the cloud by implementing a number of US government-specific regulatory requirements. Cloud First. Cloud Firstâ?? Cloud Readyâ??;

AWS

AWS Government Big Data Cloud

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Expanding the Cloud â?? Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Comments ().

AWS

AWS Latency Storage Big Data

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

DECEMBER 3, 2009

Expanding the Cloud - New AWS Region: US-West (Northern California). Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? All Things Distributed. Comments ().

AWS

AWS Cloud Latency Storage

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

All Things Distributed

APRIL 28, 2010

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore) Region. Customers can now store their data and run their applications from our Singapore location in the same way they do from our other U.S. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet. Comments ().

AWS

AWS Cloud Latency Storage

Even more amazing papers at VLDB 2019 (that I didn’t have space to cover yet)

The Morning Paper

SEPTEMBER 19, 2019

MongoDB is an important database, and this paper explains the tunable (per-operation) consistency models that MongoDB provides and how they are implemented under the covers. We hear a lot from Google and Microsoft about their cloud platforms, but not quite so much from the other key industry players. Industry papers. Research papers.

Blockchain

Blockchain Hardware Google Analytics

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Recent Entries. APAC Summer Tour.

AWS

AWS Internet Internet Storage

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS

AWS Retail Innovation Strategy

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

Wireless

Wireless AWS Internet Internet

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS

AWS Storage Big Data Servers

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

All Things Distributed

DECEMBER 13, 2009

Expanding the Cloud - Amazon EC2 Spot Instances. Consistently we have lowered compute, storage and bandwidth prices based on such cost savings. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Driving down the cost of Big-Data analytics.

Cloud

Cloud AWS Storage Innovation

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

Internet

Internet Internet AWS Scalability

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS

AWS Storage Big Data Scalability

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS

AWS Storage Cloud Big Data

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â?? Expanding the Cloud - Introducing Amazon ElastiCache. Expanding the Cloud - Introducing Amazon ElastiCache.

AWS

AWS Storage Big Data Scalability

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

July 5 - Cloud IT Leadership seminar on Business Continuity in partnership with Deloitte. July 6 - ASIS2011 - the Symposium on Cloud, ASP and Saas organized by Nikkei. Next weekend I will travel to Australia where we will have two " Navigating the Cloud with AWS" Events. Driving Storage Costs Down for AWS Customers.

AWS

AWS Storage Cloud Big Data

Fast key-value stores: an idea whose time has come and gone

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. We’ve seen similar high marshalling overheads in big data systems too.) See e.g. ‘ caching data with Spring.’

Cache

Cache Latency Google Lambda

I am looking for new application and platform services - All Things.

All Things Distributed

APRIL 23, 2010

The ecosystem of new application and platform services in the cloud is the future of application development. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Expanding the Cloud â??

AWS

AWS Storage Cloud Big Data

Around the World in 28 Days - All Things Distributed

All Things Distributed

SEPTEMBER 30, 2010

Visiting future customers is equally exiting as you get a change to understand their current architecture, if it is a migration, and how they plan to exploit cloud services in their new setup. It is equally important to give customers advice about which applications you think should not move to the cloud or at least not yet.

AWS

AWS Storage Cloud Best Practices

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

All Things Distributed

NOVEMBER 19, 2010

Here are some the links I shared this week on twitter and facebook : Cloud Computing. Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Expanding the Cloud â?? Recent Entries.

AWS

AWS Cloud Benchmarking Storage

Powerful New Amazon EC2 Boot Features - All Things Distributed

All Things Distributed

DECEMBER 3, 2009

with new security patches installed), or add new user data. While the instance is stopped it does not accrue any usage hours and customers are only charged for the storage associated with the Amazon EBS volume. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway.

AWS

AWS Storage Operating System Cloud

What is Greenplum Database? Intro to the Big Data Database

What is a Distributed Storage System

Trending Sources

What is cloud monitoring? How to improve your full-stack visibility

Mastering Hybrid Cloud Strategy

Redis vs Memcached in 2024

Kubernetes in the wild report 2023

Conducting log analysis with an observability platform and full data context

Helios: hyperscale indexing for the cloud & edge – part 1

Data lakehouse innovations advance the three pillars of observability for more collaborative analytics

Expanding the Cloud ? Managing Cold Storage with Amazon Glacier

Driving down the cost of Big-Data analytics - All Things Distributed

Reduce RPO, Encrypt Backups, and More in 1.15.0 Release of Percona Operator for MongoDB

The Need for Real-Time Device Tracking

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

Job Openings in AWS - Senior Leader in Database Services - All.

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

A case for ELT

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

No Server Required - Jekyll & Amazon S3 - All Things Distributed

The AWS GovCloud (US) Region - All Things Distributed

Introducing the AWS South America - All Things Distributed

Expanding the Cloud - New AWS Region: US-West (Northern.

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

Even more amazing papers at VLDB 2019 (that I didn’t have space to cover yet)

Hacking with AWS at The Next Web Hackaton - All Things Distributed

Driving Bandwidth Cost Down for AWS Customers. - All Things.

DROAM - Dreaming about Cheap Data Roaming - All Things.

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

From the Archives - Gapingvoid's Nobody Cares - All Things.

Spot Instances - Increased Control - All Things Distributed

Reboot - All Things Distributed

APAC Summer Tour - All Things Distributed

Fast key-value stores: an idea whose time has come and gone

I am looking for new application and platform services - All Things.

Around the World in 28 Days - All Things Distributed

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

Powerful New Amazon EC2 Boot Features - All Things Distributed

Stay Connected