Analytics, Big Data, Database and Systems - Technology Performance Pulse

In-Stream Big Data Processing

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs.

Big Data

Big Data Processing Lambda Database

Driving down the cost of Big-Data analytics - All Things Distributed

All Things Distributed

AUGUST 18, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Driving down the cost of Big-Data analytics. The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud.

Big Data

Big Data Analytics AWS Cloud

What is Greenplum Database? Intro to the Big Data Database

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. It can scale towards a multi-petabyte level data workload without a single issue, and it allows access to a cluster of powerful servers that will work together within a single SQL interface where you can view all of the data.

Big Data

Big Data Database Artificial Intelligence Open Source

The Need for Real-Time Device Tracking

ScaleOut Software

JULY 19, 2021

Real-Time Device Tracking with In-Memory Computing Can Fill an Important Gap in Today’s Streaming Analytics Platforms. The Limitations of Today’s Streaming Analytics. How are we managing the torrent of telemetry that flows into analytics systems from these devices? The list goes on.

IoT

IoT Analytics Big Data Architecture

RSA Guide 2023: Cloud application security remains core challenge for organizations

Dynatrace

APRIL 11, 2023

Log4Shell required many organizations to take devices and applications offline to prevent malicious attackers from gaining access to IT systems and sensitive data. As a result, organizations need to be vigilant in identifying and addressing vulnerabilities to protect their systems and data.

Cloud

Cloud DevOps Open Source Retail

What is a Distributed Storage System

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage

Storage Systems Big Data Azure

What is IT operations analytics? Extract more data insights from more sources

Dynatrace

MAY 1, 2023

With 99% of organizations using multicloud environments , effectively monitoring cloud operations with AI-driven analytics and automation is critical. IT operations analytics (ITOA) with artificial intelligence (AI) capabilities supports faster cloud deployment of digital products and services and trusted business insights.

Analytics

Analytics Artificial Intelligence Big Data Open Source

Use Digital Twins for the Next Generation in Telematics

ScaleOut Software

NOVEMBER 24, 2020

Real-Time Digital Twins Can Add Important New Capabilities to Telematics Systems and Eliminate Scalability Bottlenecks. The volume of incoming telemetry challenges current telematics systems to keep up and quickly make sense of all the data. Current Telematics Architecture.

Analytics

Analytics Architecture Scalability Software Architecture

Job Openings in AWS - Senior Leader in Database Services - All.

All Things Distributed

AUGUST 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. The ideal candidate will be someone who has built and ran large scale distributed systems and/or databases.

AWS

AWS Database Storage Scalability

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins.

Logistics

Logistics Analytics Scalability Cloud

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

ScaleOut Software

APRIL 3, 2020

What’s missing is a flexible, fast, and easy-to-use software system that can be quickly adapted to track these assets in real time and provide immediate answers for logistics managers. Within seconds, the software performs aggregate analysis of this data for all real-time digital twins.

Logistics

Logistics Analytics Scalability Cloud

Why test data management is more important than you think

Testsigma

MAY 7, 2020

IBM Big Data and Analytics Hub website cited a case study, where a US insurance company was estimating 15% of their testing efforts to be just test data collection for the backend system and the frontend system. The test data management for the company had become a big problem and had to be solved.

Testing

Testing Storage Database Processing

The AWS GovCloud (US) Region - All Things Distributed

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Government and Big Data. One particular early use case for AWS GovCloud (US) will be massive data processing and analytics. AWS GovCloud (US) will be used by several of these agencies to help them with their Bigger-than-Big-Data needs.

AWS

AWS Government Big Data Cloud

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. There are many success stories about the effectiveness of caching in many different scenarios; next to helping applications achieving fast and predictable performance, it often protects databases from requests bursts and brownouts under overload conditions.

Cloud

Cloud Cache AWS Storage

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Import/Export is an important tool for customers to accelerate moving large amounts of data into the AWS storage systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS

AWS Cloud Storage Internet

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements.

AWS

AWS Cloud Java Operating System

Introducing the AWS South America - All Things Distributed

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Expanding the Cloud â??

AWS

AWS Latency Storage Big Data

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

All Things Distributed

MARCH 2, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Cloud Games Latency

Driving Bandwidth Cost Down for AWS Customers. - All Things.

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Retail Innovation Strategy

No Server Required - Jekyll & Amazon S3 - All Things Distributed

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon S3 is much more than just storage; the network and distributed systems infrastructure to ensure that content can be served fast and at high rates without customers impacting each other, is amazing. Job Openings in AWS - Senior Leader in Database Services.

Servers

Servers Social Media AWS Website

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

All Things Distributed

FEBRUARY 23, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Big Data Servers

Hacking with AWS at The Next Web Hackaton - All Things Distributed

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. It is likely that the Amazon Web Services will be used by many of the participants for their compute, storage, database and other cloud resource needs. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Comments ().

AWS

AWS Internet Internet Storage

From the Archives - Gapingvoid's Nobody Cares - All Things.

All Things Distributed

FEBRUARY 27, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Big Data Scalability

Data Movement in Netflix Studio via Data Mesh

The Netflix TechBlog

JULY 26, 2021

This happens at an unprecedented scale and introduces many interesting challenges; one of the challenges is how to provide visibility of Studio data across multiple phases and systems to facilitate operational excellence and empower decision making. End-to-End Schema Evolution Schema is a key component of Data Mesh.

Big Data

Big Data Government Analytics Processing

Redis vs Memcached in 2024

Scalegrid

MARCH 28, 2024

Advanced Redis Features Showdown Big data center concept, cloud database, server power station of the future. Data transfer technology. Cube or box Block chain of abstract financial data. Additionally, it provides robust native support for geospatial data, enhancing applications like maps and location services.

Cache

Cache Storage Scalability Architecture

DROAM - Dreaming about Cheap Data Roaming - All Things.

All Things Distributed

JANUARY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. DROAM - Dreaming about Cheap Data Roaming. The one thing that I have always struggled with during my travels are the data plans of the cell phone companies. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications.

Wireless

Wireless AWS Internet Internet

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. Naming is one of the fundamental concepts in Distributed Systems. By Werner Vogels on 05 December 2010 02:00 PM.

Cloud

Cloud Internet Internet AWS

Mastering Hybrid Cloud Strategy

Scalegrid

MARCH 14, 2024

Understanding Hybrid Cloud Strategy A hybrid cloud merges the capabilities of public and private clouds into a singular, coherent system. This combination allows for the fluid movement of data and applications across different environments, facilitating shared workloads seamlessly. The tool must be compatible with your current systems.

Strategy

Strategy Cloud Artificial Intelligence Infrastructure

Reboot - All Things Distributed

All Things Distributed

SEPTEMBER 29, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Big Data Scalability

Spot Instances - Increased Control - All Things Distributed

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Cloud Big Data

APAC Summer Tour - All Things Distributed

All Things Distributed

JULY 3, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. APAC Summer Tour.

AWS

AWS Storage Big Data Cloud

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

Internet

Internet Internet AWS Scalability

I am looking for new application and platform services - All Things.

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Cloud Big Data

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Not just for HPC but for mission critical enterprise systems such as OLTP. Dedicated High Performance Compute clusters require significant capital investments and their procurement often has longer lead times than many enterprise class server systems.

Cloud

Cloud AWS Automotive Latency

Around the World in 28 Days - All Things Distributed

All Things Distributed

SEPTEMBER 30, 2010

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Storage Cloud Best Practices

Expanding the Cloud - New AWS Region: US-West (Northern.

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

AWS

AWS Cloud Latency Storage

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

All Things Distributed

NOVEMBER 19, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Big news this week was of course the launch of Cluster GPU instances for Amazon EC2. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Comments ().

AWS

AWS Cloud Benchmarking Storage

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. There are four main reasons to do so: Performance - For many applications and services, data access latency to end users is important. You need to be able to place your systems in locations where you can minimize the distance to your most important customers.

AWS

AWS Cloud Latency Storage

Powerful New Amazon EC2 Boot Features - All Things Distributed

All Things Distributed

DECEMBER 3, 2009

Werner Vogels weblog on building scalable and robust distributed systems. A wide variety of operating systems and software configurations is available for use. with more memory or CPU), a different operating system (e.g., with new security patches installed), or add new user data. All Things Distributed. Comments ().

AWS

AWS Storage Operating System Cloud

40+ Best Web Development Blogs of 2018

KeyCDN

OCTOBER 2, 2018

It’s awesome for discovering how grid systems, CSS animation, Big Data, etc all play roles in real-world web design. Subjects like version control, crowdfunding, database selection and code editor choices are essential to efficient modern workflows, and this is a good place to start learning about them.

Development

Development Website Design Code

Probabilistic Data Structures for Web Analytics and Data Mining

Highly Scalable

MAY 1, 2012

Statistical analysis and mining of huge multi-terabyte data sets is a common task nowadays, especially in the areas like web analytics and Internet advertising. Analysis of such large data sets often requires powerful distributed data stores like Hadoop and heavy data processing with techniques like MapReduce.

Analytics

Analytics Traffic Big Data Efficiency

Bulldozer: Batch Data Moving from Data Warehouse to Online Key-Value Stores

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The data warehouse is not designed to serve point requests from microservices with low latency.

Latency

Latency Storage Big Data Tuning

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

All Things Distributed

DECEMBER 13, 2009

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Job Openings in AWS - Senior Leader in Database Services. Driving down the cost of Big-Data analytics. All Things Distributed. Comments ().

Cloud

Cloud AWS Storage Innovation

What is APM?

Dynatrace

JUNE 1, 2020

The variables that can impact the performance of an application vary; from coding errors or ‘bugs’ in the software, database slowdowns, hosting and network performance, to operating system and device type support. User Experience and Business Analytics ery user journey and maximize business KPIs.

Artificial Intelligence

Artificial Intelligence Social Media Monitoring IoT

In-Stream Big Data Processing

Driving down the cost of Big-Data analytics - All Things Distributed

Trending Sources

What is Greenplum Database? Intro to the Big Data Database

The Need for Real-Time Device Tracking

RSA Guide 2023: Cloud application security remains core challenge for organizations

What is a Distributed Storage System

What is IT operations analytics? Extract more data insights from more sources

Use Digital Twins for the Next Generation in Telematics

Job Openings in AWS - Senior Leader in Database Services - All.

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Track Thousands of Assets in a Time of Crisis Using Real-Time Digital Twins

Why test data management is more important than you think

The AWS GovCloud (US) Region - All Things Distributed

Expanding the Cloud - Introducing Amazon ElastiCache - All Things.

Expanding the Cloud - AWS Import/Export Support for Amazon EBS.

AWS Elastic Beanstalk: A Quick and Simple Way into the Cloud - All.

Introducing the AWS South America - All Things Distributed

Expanding the Cloud - Introducing the AWS Asia Pacific (Tokyo.

Driving Bandwidth Cost Down for AWS Customers. - All Things.

No Server Required - Jekyll & Amazon S3 - All Things Distributed

Free at Last - A Fully Self-Sustained Blog Running in Amazon S3.

Hacking with AWS at The Next Web Hackaton - All Things Distributed

From the Archives - Gapingvoid's Nobody Cares - All Things.

Data Movement in Netflix Studio via Data Mesh

Redis vs Memcached in 2024

DROAM - Dreaming about Cheap Data Roaming - All Things.

Expanding the Cloud with DNS - Introducing Amazon Route 53 - All.

Mastering Hybrid Cloud Strategy

Reboot - All Things Distributed

Spot Instances - Increased Control - All Things Distributed

APAC Summer Tour - All Things Distributed

New Route 53 and ELB features: IPv6, Zone Apex, WRR and more.

I am looking for new application and platform services - All Things.

Expanding the Cloud - Cluster Compute Instances for Amazon EC2.

Around the World in 28 Days - All Things Distributed

Expanding the Cloud - New AWS Region: US-West (Northern.

This week in review: GPUs, Zombies, Biomimicry and Tom Waits.

Expanding the Cloud - Opening the AWS Asia Pacific (Singapore.

Powerful New Amazon EC2 Boot Features - All Things Distributed

40+ Best Web Development Blogs of 2018

Probabilistic Data Structures for Web Analytics and Data Mining

Bulldozer: Batch Data Moving from Data Warehouse to Online Key-Value Stores

Expanding the Cloud - Amazon EC2 Spot Instances - All Things.

What is APM?

Stay Connected