All Things Distributed

OCTOBER 2, 2017

Today marks the 10 year anniversary of Amazon's Dynamo whitepaper , a milestone that made me reflect on how much innovation has occurred in the area of databases over the last decade and a good reminder on why taking a customer obsessed approach to solving hard problems can have lasting impact beyond your original expectations.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

JUNE 21, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 21 June 2012 09:00 AM. In the five months since it launched in January, DynamoDB , our fast and scalable NoSQL database service, has been setting AWS growth records. ve already passed our 2012 targets. Comments ().

Games 142

Games Scalability AWS Database 142

SQL Performance

JULY 11, 2019

Connecting to SQL Server 2012 or better, or Azure SQL Database. And recommended system configuration: Two or more cores 8GB or more of memory Operating Systems: Windows (8.1 / Server 2012 R2 or better) macOS (10.13 First, ensure you meet our requirements: Azure Data Studio 1.9.0 or newer ( July announcement post ).NET

Azure 90

Azure Servers Tuning Operating System 90

Scalegrid

JULY 17, 2020

Why should a relational database even care about unstructured data? Often times an external system is providing data as JSON, so it might be a temporary store before data is ingested into other parts of the system. Wave 1: PostgreSQL 9.2 (2012) added support for JSON data type. JSON database in 9.2 JSONB Indexes.

Storage 321

Storage Database Efficiency Processing 321

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). In addition, there are fewer resources, plugins, libraries, third-party tools, and sources of support available than for other, more established database systems.

Open Source 52

Open Source Servers Storage Scalability 52

All Things Distributed

MAY 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 May 2012 02:00 PM. You can then off load the management and scaling of your database and application stack to Amazon RDS and AWS Elastic Beanstalk , and focus on adding value to your customers. All Things Distributed. Comments ().

Cloud 115

Cloud Development AWS Servers 115

All Things Distributed

JULY 16, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 16 July 2012 09:00 AM. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Register for AWS re: Invent. Comments ().

AWS 83

AWS Big Data Media Storage 83

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. As we said at the time, DynamoDB was a result of 15 years of learning in the area of large scale non-relational databases and cloud services. DynamoDB was the first service at AWS to use SSD storage. Fully managed cache for DynamoDB.

Speed 121

Speed Cache Latency AWS 121

SQL Performance

JUNE 21, 2019

This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. I always check backups first when looking at a new system. When looking at backups, I check for recovery model and the current history of backups for each database. DBCC CHECKDB.

Servers 49

Servers Azure Hardware Database 49

All Things Distributed

JULY 19, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed.

Cloud 129

Cloud Performance AWS Virtualization 129

SQL Performance

FEBRUARY 22, 2021

The system table sys.sysprocesses was replaced way back in SQL Server 2005 by a set of dynamic management views (DMVs), most notably sys.dm_exec_requests , sys.dm_exec_sessions , and sys.dm_exec_connections. We recommend that you use the current SQL Server system views instead. Why this is a problem. dm_os_performance_counters.

Latency 57

Latency Servers Monitoring Systems 57

All Things Distributed

SEPTEMBER 25, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 25 September 2012 06:00 PM. Customers can provision up to 10,000 IOPS (input/output operations per second) per database instance to help ensure that their databases can run the most stringent workloads with rock solid, consistent performance.

Cloud 117

Cloud AWS Storage Database 117

All Things Distributed

SEPTEMBER 14, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 14 September 2012 05:00 PM. That goes especially for the interaction between applications and storage engines, and between applications and databases. All Things Distributed. Back-to-the-Future Weekend Reading - CryptDB. Comments ().

Operating System 81

Operating System Storage Scalability Database 81

All Things Distributed

NOVEMBER 28, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 28 November 2012 09:00 AM. Unlike traditional row-based relational databases, which store data for each row sequentially on disk, Amazon Redshift stores each column sequentially. All Things Distributed. Expanding the Cloud â??

Cloud 164

Cloud Storage Architecture Scalability 164

All Things Distributed

OCTOBER 8, 2014

More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying. The original Dynamo paper inspired many database solutions, which are now popularly referred to as NoSQL databases. NoSQL and Flexibility: Document Model.

Availability 145

Availability Performance Scalability AWS 145

SQL Performance

AUGUST 15, 2019

Connecting to SQL Server 2012 or better, or Azure SQL Database. And recommended system configuration: Two or more cores 8GB or more of memory Operating Systems: Windows (8.1 / Server 2012 R2 or better) macOS (10.13 First, ensure you meet our requirements: Azure Data Studio 1.9.0 or newer ( July announcement post ).NET

Azure 50

Azure Servers Tuning Operating System 50

All Things Distributed

FEBRUARY 18, 2013

Werner Vogels weblog on building scalable and robust distributed systems. OpsWorks provides an event-driven configuration system with rich deployment tools that allow you to efficiently manage applications over their lifetime, including support for customizable deployments, rollback, patch management, auto scaling, and auto healing.

AWS 157

AWS Cloud Architecture Infrastructure 157

All Things Distributed

AUGUST 20, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 21 August 2012 12:01 AM. It requires substantial upfront capital investments in cold data storage systems such as tape robots and tape libraries, then thereâ??s All Things Distributed. Expanding the Cloud â?? Comments (). Contact Info.

Storage 122

Storage Cloud AWS Media 122

All Things Distributed

NOVEMBER 8, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 08 November 2012 03:00 PM. For example, AWS customers use SQS for asynchronous communication pipelines, buffer queues for databases, asynchronous work queues, and moving latency out of highly responsive requests paths. Comments ().

Efficiency 104

Efficiency Cloud Games Scalability 104

All Things Distributed

FEBRUARY 22, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 22 February 2012 12:01 AM. Components may take extended periods of time to complete tasks, requests may fail and errors originating from remote systems must be handled. All Things Distributed. Expanding the Cloud â?? Comments ().

Cloud 130

Cloud AWS Java Scalability 130

All Things Distributed

APRIL 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 06 April 2012 06:00 AM. One of the services that is very successful in driving innovation at our customers in this context is Amazon RDS , the Relational Database Service. All Things Distributed. Comments (). hands freeÃ?

Innovation 146

Innovation AWS Education Network 146

All Things Distributed

APRIL 11, 2012

Werner Vogels weblog on building scalable and robust distributed systems. By Werner Vogels on 12 April 2012 12:00 AM. And increasingly, search is applied to data that, though called a "document" for the purposes of search, is really just a record in a database or an object in a NoSQL system. All Things Distributed.

Cloud 149

Cloud AWS Technology Technology 149

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The first was c3.

Virtualization 111

Virtualization AWS Hardware Storage 111

Alex Russell

MARCH 6, 2021

The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. If those specs sound eerily familiar, it's perhaps because they're identical to 2016's $200USD Moto G4 , all the way down to the 2011-vintage 28nm SoC process node used to fab the chip's anemic, 2012-vintage A53 cores. Tap for a larger version.

Performance 124

Performance Network Cache Metrics 124

SQL Server According to Bob

JUNE 3, 2016

The following chart shows the same 1TB database testing. Use SQL Server Management Studio (SSMS) or your favorite query editor to connect to a SQL Server 2012 or 2014 instance. Note: You may need to execute the dbcc a second time so buffer cache is hot, eliminating I/O sub-system variants. MultiObjectScanner = Older design.

Hardware 40

Hardware Cache Servers Software Engineering 40

SQL Performance

JULY 16, 2019

This made it easier for database professionals to make the case for a hardware upgrade, and made the typical upgrade more worthwhile. You might be asking why you should care about all of this as a SQL Server Database professional? Figure 2: AMD EPYC Rome Processor. How is This Relevant for SQL Server? There are many reasons!

Servers 46

Servers Hardware Architecture Retail 46

SQL Performance

SEPTEMBER 2, 2021

UPDATE: September 2nd, 2021 (Originally published July 26th, 2012.). A lot of things change over the course of a few major versions of our favorite database platform. Here are the contenders I am going to compare (using SQL Server 2012, 11.00.2316, on a Windows 7 VM with 4 CPUs and 8 GB of RAM): CLR. CREATE FUNCTION dbo.

C++ 59

C++ Servers Testing Database 59

Smashing Magazine

APRIL 1, 2020

In the end, youll have built a shopping cart using GraphCMS (a (backend-only content management system). A scalable, cross-platform content management system is crucial to ensuring a product’s growth velocity. It was developed by Facebook in 2012 and released open-sourced in 2015. Gridsome, Gatsby). Mobile Apps (iOS, Android).

Open Source 103

Open Source Website Mobile Code 103

O'Reilly Software

OCTOBER 23, 2018

Technology systems are difficult to wrangle. Our systems grow in accidental complexity and complication over time. By 2012, Harvard Business Review published an article by Thomas Davenport and D.J. It's a given that we must design a system, including a local software architecture, that actually runs, that is "solid."

Strategy 100

Strategy Architecture Technology Technology 100

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The first was c3.

Virtualization 40

Virtualization AWS Hardware Storage 40

Highly Scalable

MARCH 10, 2015

Most of this article represents an overview of the results published by retailers and researchers who built practical decision making and optimization systems combining abstract economic models with data mining methods. The most typical use cases for this problem are recommender systems, personalized search results ranking, and targeted ads.

Retail 152

Retail C++ Analytics Metrics 152

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. You should not use it on anything except a personal test system. Introduction. The associated global aggregate always ran in row mode, after a Repartition Streams exchange.

Servers 67

Servers Testing Metrics Storage 67