Analytics, Big Data, Scalability and Servers - Technology Performance Pulse

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

MAY 13, 2020

It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment.

Big Data

Big Data Database Artificial Intelligence Open Source

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage

Storage Systems Big Data Azure

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud.

Big Data

Big Data Analytics AWS Cloud

Redis vs Memcached in 2024

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios. Data transfer technology.

Cache

Cache Storage Scalability Architecture

What is container orchestration?

Dynatrace

MARCH 24, 2023

Using Marathon, its data center operating system (DC/OS) plugin, Mesos becomes a full container orchestration environment that, like Kubernetes and Docker Swarm, discovers services, balances loads, and manages application containers. Mesos also supports other orchestration engines, including Kubernetes and Docker Swarm.

Infrastructure

Infrastructure Open Source Operating System Cloud

The Need for Real-Time Device Tracking

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT

IoT Analytics Big Data Architecture

Use Digital Twins for the Next Generation in Telematics

ScaleOut Software

NOVEMBER 24, 2020

Real-Time Digital Twins Can Add Important New Capabilities to Telematics Systems and Eliminate Scalability Bottlenecks. Every few seconds, the application servers collect batches of snapshots and write them to the database where they can be queried by dispatchers managing the fleet.

Analytics

Analytics Architecture Scalability Software Architecture

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. No Server Required - Jekyll & Amazon S3. If you have a largely static site you can rely on the enormous power of S3 to make serving your content highly scalable and storing it extremely durable. No Server Required. All Things Distributed.

Servers

Servers Social Media AWS Website

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. AWS GovCloud (US) will be used by several of these agencies to help them with their Bigger-than-Big-Data needs.

AWS

AWS Government Big Data Cloud

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Caching has become a standard component in many applications to achieve a fast and predictable performance, but maintaining a collection of cache servers in a reliable and scalable manner is not a simple task. Driving down the cost of Big-Data analytics.

Cloud

Cloud Cache AWS Storage

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Werner Vogels weblog on building scalable and robust distributed systems. In a follow up to the last blog post I have removed the last two dependencies this blog had on running a server somewhere: comments are now served by Disqus and search is now handled by Bing. Driving down the cost of Big-Data analytics.

AWS

AWS Storage Big Data Servers

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Latency Storage Big Data

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Cloud Storage Internet

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Database Storage Scalability

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Retail Innovation Strategy

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Big Data Scalability

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Elastic Beanstalk makes it easy for developers to deploy and manage scalable and fault-tolerant applications on the AWS cloud. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics.

AWS

AWS Cloud Java Operating System

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. DROAM - Dreaming about Cheap Data Roaming. The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

Wireless

Wireless AWS Internet Internet

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Often these namespaces are hierarchical in nature such that it becomes easier to manage them and to decentralize control, which makes the system more scalable. There are two main types of DNS servers: authoritative servers and caching resolvers.

Cloud

Cloud Internet Internet AWS

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Internet Internet Storage

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

Internet

Internet Internet AWS Scalability

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Big Data Scalability

Should You Use ClickHouse as a Main Operational Database?

Percona

JANUARY 14, 2019

What if we use ClickHouse (which is a columnar analytical database) as our main datastore? Well, typically, an analytical database is not a replacement for a transactional or key/value datastore. However, ClickHouse is super efficient for timeseries and provides “sharding” out of the box (scalability beyond one node).

Database

Database Analytics Blockchain Healthcare

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Cloud Big Data

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Big Data Cloud

I am looking for new application and platform services - All Things.

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Cloud Big Data

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Cluster Compute Instances for Amazon EC2 change the HPC game for two important reasons: Access to scalable on-demand capacity. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics.

Cloud

Cloud AWS Automotive Latency

Around the World in 28 Days - All Things Distributed

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Cloud Best Practices

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Cloud Latency Storage

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. Comments ().

AWS

AWS Cloud Benchmarking Storage

Powerful New Amazon EC2 Boot Features - All Things Distributed

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Storage Operating System Cloud

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

AWS

AWS Cloud Latency Storage

40+ Best Web Development Blogs of 2018

KeyCDN

OCTOBER 2, 2018

Its blog articles will definitely come in handy as your projects scale, but they’re also great reading for those who simply want to understand the philosophies behind specific dev practices in the front end or server side. CSSWizardy CSSWizardy is a good place to learn about scalable CSS practices and robust coding in general.

Development

Development Website Design Code

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

All Things Distributed

DECEMBER 13, 2009

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

Cloud

Cloud AWS Storage Innovation

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

All Things Distributed

DECEMBER 13, 2016

With the launch of the AWS Europe (London) Region, AWS can enable many more UK enterprise, public sector and startup customers to reduce IT costs, address data locality needs, and embark on rapid transformations in critical new areas, such as big data analysis and Internet of Things. Fraud.net is a good example of this.

AWS

AWS Cloud Artificial Intelligence IoT

New AWS feature: Run your website from Amazon S3 - All Things.

All Things Distributed

FEBRUARY 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Since a few days ago this weblog serves 100% of its content directly out of the Amazon Simple Storage Service (S3) without the need for a web server to be involved. I had held out implementing an alternative to my simple blog server that had. Comments ().

AWS

AWS Website Storage Servers

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

All Things Distributed

APRIL 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The storage systems weve pioneered demonstrate extreme scalability while maintaining tight control over performance, availability, and cost. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

Technology

Technology Technology AWS Storage

Music to my Ears - All Things Distributed

All Things Distributed

MARCH 28, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The scalability, reliability and durability requirements for Cloud Drive are very high which is why they decided to make use of the Amazon Simple Storage Service (S3) as the core component of their service. Driving down the cost of Big-Data analytics.

AWS

AWS Cloud Storage Internet

Simplifying IT - Create Your Application with AWS CloudFormation.

All Things Distributed

FEBRUARY 25, 2011

Werner Vogels weblog on building scalable and robust distributed systems. They had taken the approach that they would not only be offering their software as a scalable multi-tenant product but also as a single tenant environment for customers that want to have their own isolated environment. Driving down the cost of Big-Data analytics.

AWS

AWS Cloud Scalability Storage

5 Terabyte Object Support in Amazon S3 - All Things Distributed

All Things Distributed

DECEMBER 9, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Big Just Got Bigger - 5 Terabyte Object Support in Amazon S3. Amazon S3 has always been a scalable, durable and available data repository for almost any customer workload. Driving down the cost of Big-Data analytics.

AWS

AWS Big Data Scalability Storage

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

All Things Distributed

MAY 18, 2010

Werner Vogels weblog on building scalable and robust distributed systems. This new storage option enables customers to reduce their costs by storing non-critical, reproducible data at lower levels of redundancy. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

Storage

Storage Cloud AWS Scalability

Choosing Consistency - All Things Distributed

All Things Distributed

FEBRUARY 24, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are many factors that come into play when you need to meet stringent availability and performance requirements under ultra-scalable conditions. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Choosing Consistency.

AWS

AWS Latency Database Scalability

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

All Things Distributed

APRIL 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Driving down the cost of Big-Data analytics. No Server Required - Jekyll & Amazon S3. No Server Required - Jekyll & Amazon S3. Comments ().

Media

Media AWS Storage Big Data

What is Greenplum Database? Intro to the Big Data Database

What is a Distributed Storage System

Trending Sources

Driving down the cost of Big-Data analytics - All Things Distributed

Redis vs Memcached in 2024

What is container orchestration?

The Need for Real-Time Device Tracking

Use Digital Twins for the Next Generation in Telematics

No Server Required - Jekyll & Amazon S3 - All Things Distributed

The AWS GovCloud (US) Region - All Things Distributed

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

Introducing the AWS South America - All Things Distributed

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

Job Openings in AWS - Senior Leader in Database Services - All.

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

From the Archives - Gapingvoid's Nobody Cares - All Things.

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

DROAM - Dreaming about Cheap Data Roaming - All Things.

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

Reboot - All Things Distributed

Should You Use ClickHouse as a Main Operational Database?

Spot Instances - Increased Control - All Things Distributed

APAC Summer Tour - All Things Distributed

I am looking for new application and platform services - All Things.

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

Around the World in 28 Days - All Things Distributed

Expanding the Cloud - New AWS Region: US-West (Northern.

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

Powerful New Amazon EC2 Boot Features - All Things Distributed

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

40+ Best Web Development Blogs of 2018

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

Expanding the AWS Cloud: Introducing the AWS Europe (London) Region

New AWS feature: Run your website from Amazon S3 - All Things.

The Amazon.com 2010 Shareholder Letter Focusses on Technology.

Music to my Ears - All Things Distributed

Simplifying IT - Create Your Application with AWS CloudFormation.

5 Terabyte Object Support in Amazon S3 - All Things Distributed

Expanding the Cloud - Amazon S3 Reduced Redundancy Storage.

Choosing Consistency - All Things Distributed

Amazon Cloudfront is Streaming Media 2010 Editor's pick - All.

Stay Connected