SQL Performance

JULY 8, 2021

It’s also a good way to not overwhelm the database servers … usually. Searching is everywhere on the internet. That kind of feedback is necessary to help build maintainable, scalable solutions. Michael J Swart is a passionate database professional and blogger who focuses on database development and software architecture.

Design 92

Design Software Architecture Database Servers 92

The Netflix TechBlog

AUGUST 30, 2021

The challenge, then, is to be able to ingest and process these events in a scalable manner, i.e., scaling with the number of devices, which will be the focus of this blog post. System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform.

Latency 213

Latency Traffic Transportation Cloud 213

O'Reilly

MAY 25, 2021

GPT-3 is essentially an auto-complete bot whose underlying Machine Learning (ML) model has been trained on vast quantities of text available on the Internet. These projects have created language models that are based on focused datasets (for example, models designed to be more accurate for academic papers, developer forum discussions, etc.).

Social Media 138

Social Media Media Internet Internet 138

Scalegrid

MAY 13, 2020

Greenplum Database is a massively parallel processing (MPP) SQL database that is built and based on PostgreSQL. Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. What is an MPP Database?

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

All Things Distributed

MARCH 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Over the past years The Next Web Conference has become a premier conference on internet life and its technologies. Up to 200 developers and designers will get together to hack up interesting applications using the Internets APIs and SDKs.

AWS 93

AWS Internet Internet Storage 93

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! Whether it’s database or message queues it’s a really weird combo of licenses and features for hostage. Don’t waste your developers’ time trying to shave off nickels and dimes from your bill. See you in the New Year. I'd really appreciate it.

Internet 137

Internet Internet Scalability Serverless 137

All Things Distributed

MAY 24, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Elastic Load Balancing now provides support for EC2 Security Groups such that customers that hosts their Internet accessible application instances behind ELB can build security rules that for example restrict traffic to only the ELB instances that front them.

Internet 114

Internet Internet AWS Scalability 114

High Scalability

JUNE 29, 2018

kellabyte : Recently I got to work on a project that really stressed Amazon AWS scalability. Mark Lapedus : Costs of developing a complex chip could run as high as $1.5B, while power/performance benefits are likely to decrease. kellabyte : LOL at racking up an AWS bill of $140,000 in 4 hours of compute time. You want to talk scale?

Scalability 131

Scalability Internet Internet Wireless 131

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. DNS is one of the fundamental building blocks of internet applications and was high on the wish list of our customers for some time already. DNS is an absolutely critical piece of the internet infrastructure. All Things Distributed. Comments ().

Cloud 117

Cloud Internet Internet AWS 117

All Things Distributed

JANUARY 19, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Flexibility is one of the key principles of Amazon Web Services - developers can select any programming language and software package, any operating system, any middleware and any database to build systems and applications that meet their requirements.

AWS 115

AWS Cloud Java Operating System 115

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. There are many success stories about the effectiveness of caching in many different scenarios; next to helping applications achieving fast and predictable performance, it often protects databases from requests bursts and brownouts under overload conditions.

Cloud 117

Cloud Cache AWS Storage 117

All Things Distributed

JULY 7, 2011

Werner Vogels weblog on building scalable and robust distributed systems. AWS Import/Export transfers data off of storage devices using Amazons high-speed internal network and bypassing the Internet. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS 96

AWS Cloud Storage Internet 96

High Scalability

JUNE 15, 2018

1.6x : better deep learning cluster scheduling on k8s; 100,000 : Large-scale Diverse Driving Video Database; 3rd : reddit popularity in the US; 50% : increase in Neural Information Processing System papers, AI bubble? JoeEmison : Another thing that serverless architectures change: how do you software development. Hungry for more?

Internet 113

Internet Internet Scalability Blockchain 113

All Things Distributed

DECEMBER 14, 2011

Werner Vogels weblog on building scalable and robust distributed systems. These companies can now benefit from the fact that the new Sao Paulo Region is similar to all other AWS Regions, which enables software developed for other Regions to be quickly deployed in South America as well. All Things Distributed. Expanding the Cloud â??

AWS 114

AWS Latency Storage Big Data 114

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. We had specializations in hardware, operating systems, databases, graphics, etc.

Tuning 52

Tuning Benchmarking Engineering C++ 52

All Things Distributed

AUGUST 18, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Amazon Elastic MapReduce takes away much of this muck by providing a hosted Hadoop framework that enables businesses, researchers, data analysts, and developers to easily and efficiently spin up resizable clusters for distributed processing of large data sets.

Big Data 111

Big Data Analytics AWS Cloud 111

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. If you have a largely static site you can rely on the enormous power of S3 to make serving your content highly scalable and storing it extremely durable. Cactus is a static website generator developed by Koen Bok of Made By Sofa (recently acquired by Facebook ).

Servers 126

Servers Social Media AWS Website 126

High Scalability

JULY 26, 2018

Without macOS's BSD underpinnings, would it have been as popular with developers as Mac OS X was? Lance Gutteridge : The reason why almost no one encrypts their databases is one of the dirty secrets of IT. Somewhere out there is a parallel universe where BeOS, rather than OpenStep, became the basis for Apple's new OS. Not this week.

Internet 124

Internet Internet Scalability Serverless 124

All Things Distributed

JUNE 29, 2011

Werner Vogels weblog on building scalable and robust distributed systems. For more details see the announcement , the details pages of the services at [link] , and the posting on the AWS developer blog. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS 104

AWS Retail Innovation Strategy 104

ScaleOut Software

JANUARY 9, 2020

It’s not enough just to pick out interesting events from an aggregated data stream and then send them to a database for offline analysis using Spark. What’s needed is the ability to easily track incoming telemetry from each individual store so that issues can be quickly analyzed, prioritized, and handled.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It’s not enough just to pick out interesting events from an aggregated data stream and then send them to a database for offline analysis using Spark. What’s needed is the ability to easily track incoming telemetry from each individual store so that issues can be quickly analyzed, prioritized, and handled.

Logistics 52

Logistics Retail Analytics Azure 52

ScaleOut Software

JANUARY 9, 2020

It’s not enough to just pick out interesting events from an aggregated data stream and then send them to a database for offline analysis using Spark. Traditional platforms for streaming analytics don’t offer the combination of granular data tracking and real-time aggregate analysis that logistics applications such as these require.

Logistics 52

Logistics Retail Analytics Azure 52

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. DynamoDB is the result of 15 years of learning in the areas of large scale non-relational databases and cloud services. Amazon DynamoDB â?? Comments ().

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 77

Open Source Database Storage Scalability 77

All Things Distributed

JULY 11, 2011

Werner Vogels weblog on building scalable and robust distributed systems. To get started using Spot or for more details visit the Amazon EC2 Spot Instance web page, the AWS developer blog , and the EC2 Release Notes. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Comments ().

AWS 85

AWS Storage Cloud Big Data 85

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. Partitioning and Shuffling.

Big Data 154

Big Data Processing Lambda Database 154

All Things Distributed

JULY 13, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Today, I am very proud to be a part of the Amazon Web Services team as we truly make HPC available as an on-demand commodity for every developer to use. There has been no easy way for developers to do this in Amazon EC2. All Things Distributed.

Cloud 118

Cloud AWS Automotive Latency 118

All Things Distributed

APRIL 23, 2010

Werner Vogels weblog on building scalable and robust distributed systems. The ecosystem of new application and platform services in the cloud is the future of application development. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed. Comments ().

AWS 60

AWS Storage Cloud Big Data 60

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 110

Availability Database Open Source Hardware 110

All Things Distributed

AUGUST 16, 2011

Werner Vogels weblog on building scalable and robust distributed systems. The scalability, flexibility and the elasticity of AWS makes it an ideal environment for the agencies to run their analytics. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. All Things Distributed.

AWS 111

AWS Government Big Data Cloud 111

All Things Distributed

JULY 14, 2015

In just three short years, Amazon DynamoDB has emerged as the backbone for many powerful Internet applications such as AdRoll , Druva , DeviceScape , and Battlecamp. Many happy developers are using DynamoDB to handle trillions of requests every day. Amazon Redshift) and Elasticsearch machines. DynamoDB Cross-region Replication.

Database 167

Database Lambda AWS IoT 167

All Things Distributed

APRIL 28, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Quite often "The Cloud" is portrayed as something magically transparent that lives somewhere in the internet. By placing instances in different Availability Zones, developers can build systems that can survive many complex failure scenarios. Comments ().

AWS 61

AWS Cloud Latency Storage 61

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? The answer for me is simple: Developers want their applications to be well architected and scale effectively. To do this, they need to be able to use multiple databases and data models within the same application.

Database 167

Database AWS Games Latency 167

Scalegrid

JANUARY 12, 2024

Simply put, it’s the set of computational tasks that cloud systems perform, such as hosting databases, enabling collaboration tools, or running compute-intensive algorithms. What is workload in cloud computing? This opens up possibilities not only difficult but almost impossible to attain conventionally!

Cloud 130

Cloud Virtualization Storage Efficiency 130

High Scalability

NOVEMBER 12, 2019

Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet. Stream is currently also hiring Devops and Python/Go developers in Amsterdam. There's also a no questions asked 30-day return policy.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

OCTOBER 29, 2019

Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet. Stream is currently also hiring Devops and Python/Go developers in Amsterdam. There's also a no questions asked 30-day return policy.

Education 22

Education Java Software Engineering Engineering 22

High Scalability

OCTOBER 15, 2019

Grokking the System Design Interview is a popular course on Educative.io (taken by 20,000+ people) that's widely considered the best System Design interview resource on the Internet. Stream is currently also hiring Devops and Python/Go developers in Amsterdam. There's also a no questions asked 30-day return policy.

Education 22

Education Java Engineering Software Engineering 22