Percona

JUNE 6, 2023

This blog was originally published in January 2012 and was updated in June 2023. Increased Storage Requirements : One of the disadvantages of full backups is the increased storage requirements due to the fact that they capture a complete copy of all data and files. What is an incremental backup? What is an incremental backup?

Storage 68

Storage Strategy Network Efficiency 68

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 110

Performance Latency Cache Virtualization 110

All Things Distributed

AUGUST 24, 2012

By Werner Vogels on 24 August 2012 04:00 PM. The AWS team launched this week Amazon Glacier , a cold storage archive service at the very low price point of $0.01 The Five-Minute Rule Ten Years Later, and Other Computer Storage Rules of Thumb , Jim Gray and Goetz Graefe, ACM SIGMOD Record 26 (4): 63â??68, Comments ().

Storage 108

Storage Hardware AWS Data Engineering 108

All Things Distributed

MARCH 5, 2012

By Werner Vogels on 05 March 2012 02:01 PM. AWS today announced a substantial price drop from March 1, 2012 for many of the Amazon EC2, Amazon RDS, and Amazon ElastiCache instances types around the world. We continuously apply all our innovative skills to the design of datacenters, servers, storage, network, etc. Comments ().

AWS 110

AWS Innovation Scalability Cache 110

All Things Distributed

JULY 16, 2012

By Werner Vogels on 16 July 2012 09:00 AM. There are sessions in many different categories: Architecture, Big Data, HPC, Computer & Networking, Storage, Databases, Security, Tools & Languages, Media Sharing & Content Delivery, Managing AWS Resources, Enterprise IT, Mobile, Start-up, and more. All Things Distributed.

AWS 83

AWS Big Data Media Storage 83

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

NOVEMBER 29, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 111

Virtualization AWS Hardware Storage 111

All Things Distributed

MAY 8, 2012

By Werner Vogels on 08 May 2012 02:00 PM. of administrative tasks such as OS and database software patching, storage management, and implementing reliable backup and disaster recovery solutions. Amazon RDS currently supports SQL Server 2008 R2 and plans to add support for SQL Server 2012 later this year. All Things Distributed.

Cloud 115

Cloud Development AWS Servers 115

SQL Performance

MAY 16, 2019

For SQL Server 2012 and earlier, this means 5 extra bytes per row are included in the data size calculation: One byte for an internal bit flag, and four bytes for the uniquifier (used in the calculation even for unique indexes, which do not store a uniquifier ). . [ SQL Server 2012. fn_dblog ( NULL , NULL ) AS FD WHERE.

Cache 67

Cache Servers Testing Storage 67

All Things Distributed

DECEMBER 27, 2012

By Werner Vogels on 27 December 2012 12:00 PM. S3 is not only a highly reliable and available storage service but also one of the most powerful web serving engines that exists today. Root Domain Support for Amazon S3 Website Hosting. Comments ().

Website 126

Website Traffic Storage Scalability 126

All Things Distributed

SEPTEMBER 25, 2012

By Werner Vogels on 25 September 2012 06:00 PM. Following the huge success of being able to provision a consistent, user-requested I/O rate for DynamoDB and Elastic Block Store (EBS), the AWS Database Services team has now released Provisioned IOPS, a new high performance storage option for the Amazon Relational Database Service (Amazon RDS).

Cloud 117

Cloud AWS Storage Database 117

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. GA 11 April 2012 5.5.23 MariaDB Server includes many storage engines beyond the default InnoDB.

Open Source 52

Open Source Servers Storage Scalability 52

All Things Distributed

SEPTEMBER 14, 2012

By Werner Vogels on 14 September 2012 05:00 PM. That goes especially for the interaction between applications and storage engines, and between applications and databases. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Back-to-the-Future Weekend Reading - CryptDB. Comments ().

Operating System 81

Operating System Storage Scalability Database 81

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs).

Availability 40

Availability Servers Hardware Benchmarking 40

All Things Distributed

JULY 19, 2012

By Werner Vogels on 19 July 2012 12:00 AM. Magnetic disks are rapidly starting to exhibit tape-like properties and with modern workloads being increasingly random, they are becoming less and less suitable as a storage system. All Things Distributed. Werner Vogels weblog on building scalable and robust distributed systems. Comments ().

Cloud 129

Cloud Performance AWS Virtualization 129

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Virtualization 52

SQL Performance

MAY 1, 2019

For SQL Server 2012 and earlier , the transition point for this particular table is 898 rows. The way the calculation is performed is slightly different in SQL Server 2012 and earlier compared with SQL Server 2014 and later. In SQL Server 2012 and earlier, the calculation is performed by sqllang!OptimizerUtil::ComputeRowLength.

Servers 47

Servers Database Testing Performance 47

Tim Kadlec

JANUARY 9, 2019

Ballooning bandwidth and storage have fostered complacency that we can do without. In a 2012 paper, The American Council for an Energy-Efficient Economy estimated the internet uses 5 kWh on average to support every GB of data. Performance is conservation. Again, this isn’t hyperbole. Let’s run with that for a second.

Performance 111

Performance Energy Internet Internet 111

All Things Distributed

SEPTEMBER 6, 2013

Due to the exponential growth of the biology and informatics fields, Unilever needs to maintain this new program within a highly-scalable environment that supports parallel computation and heavy data storage demands. Tom Tom – Founded in 1991, TomTom is a leading provider of navigation and location-based products and services.

Cloud 129

Cloud Energy AWS Healthcare 129

Brendan Gregg

NOVEMBER 28, 2017

In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. The AMI and boot are now HVM.

Virtualization 40

Virtualization AWS Hardware Storage 40

All Things Distributed

MARCH 20, 2012

By Werner Vogels on 20 March 2012 09:00 PM. re seeking ultimate flexibility, AWS allows you to interact with services such as Amazon Elastic Compute Cloud ( Amazon EC2 ) and Amazon Simple Storage Service ( Amazon S3 ) directly and to piece these services together in a building block fashion. All Things Distributed. Comments ().

AWS 104

AWS Scalability Java Storage 104

SQL Server According to Bob

JUNE 3, 2016

Use SQL Server Management Studio (SSMS) or your favorite query editor to connect to a SQL Server 2012 or 2014 instance. 32GB RAM, 4 Core Hyper-threaded enabled 2.8Ghz, SSD Storage. The DBCC CheckDB demonstration loads a table and demonstrates the performance improvement. Paste the script below in a new query window. or newer release.

Hardware 40

Hardware Cache Servers Software Engineering 40

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively. low-end Androids have finally caught up to the iPhone 5 from 2012. The Moto G4 , for example.

Performance 124

Performance Network Cache Metrics 124

All Things Distributed

AUGUST 16, 2012

By Werner Vogels on 16 August 2012 10:00 AM. An apples to apples comparison of the costs associated with running various usage patterns on-premises and with AWS requires more than a simple comparison of hardware expense versus always-on utility pricing for compute and storage. All Things Distributed. Comments ().

AWS 118

AWS Hardware Traffic Best Practices 118

All Things Distributed

APRIL 5, 2012

By Werner Vogels on 06 April 2012 06:00 AM. We consulted directly with Amazon and learned that the storage and the DB Server size affected I/O throughput – after altering our size we dropped our load time to 1 hour which was within expectations relative to native database. Comments ().

Innovation 146

Innovation AWS Education Network 146

Smashing Magazine

NOVEMBER 8, 2018

In this article, I will describe this latter solution, based on a WordPress application storing files on Amazon Web Services (AWS) Simple Storage Service (S3) (a cloud object storage solution to store and retrieve data), operating through the AWS SDK. Conclusion.

AWS 44

AWS Servers Storage Cloud 44

SQL Performance

APRIL 23, 2019

In SQL Server 2012, grouped (vector) aggregation was able to use parallel batch-mode execution, but only for the partial (per-thread) aggregate. Columnstore storage. To understand this, it is necessary to first review how columnstore storage works at a high level: A compressed row group contains a column segment for each column.

Servers 67

Servers Testing Metrics Storage 67

SQL Performance

AUGUST 23, 2019

There have been major improvements since the first appearance of the batch mode execution engine in SQL Server 2012. This article is about batch mode bitmaps, which have a very different implementation. The details given here apply to SQL Server 2017 — the most recently released version at the time of writing.

Servers 75

Servers Engineering Efficiency Retail 75

Percona

JANUARY 14, 2019

In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. blockade','arizona'] ? ? protests','occupy','romney','weiner','protesters'] ? ? santorum','returns','martin','obamacare','romney'] ? ?

Database 40

Database Analytics Blockchain Healthcare 40

Alex Russell

JULY 14, 2021

Here, native apps are doing work related to their core function; storage and tracking of user data are squarely within the four corners of the app's natural responsibilities. From at least 2012, Apple has deigned to allow "competing browsers" in its App Store.

Google 121

Google Mobile Engineering Internet 121

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. High availability apparently is not available on Windows Server 2008R2 Standard Edition and requires Enterprise Edition, which can cost about $2,800 more per server, or you must upgrade to Windows Server 2012.)

Cache 40

Cache Servers Network Design 40

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 99

Hardware Storage Big Data Blockchain 99

All Things Distributed

NOVEMBER 28, 2012

By Werner Vogels on 28 November 2012 09:00 AM. They contain large amounts of locally attached storage on multiple spindles and are connected by a minimally oversubscribed 10 Gigabit Ethernet network. s MPP architecture makes it easy to resize your cluster to keep pace with your storage and performance requirements. Comments ().

Cloud 164

Cloud Storage Architecture Scalability 164

All Things Distributed

OCTOBER 2, 2017

With these goals in mind, In January, 2012 we launched Amazon DynamoDB , our cloud-based NoSQL database service designed from the ground up to support extreme scale, with the security, availability, performance and manageability needed to run mission-critical workloads. Manageable – The service would need to be easy to manage and operate.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

FEBRUARY 15, 2013

As you may remember from our announcement at re: Invent in November 2012, Amazon Redshift is a fast and powerful, fully managed, petabyte-scale data warehouse service that delivers fast query performance at less than one tenth the cost of most traditional data warehouse systems. Amazon Redshift and Designing for Resilience. Comments ().

Design 110

Design AWS Storage Systems 110

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 145

Availability Performance Scalability AWS 145

All Things Distributed

JUNE 21, 2017

DynamoDB has come a long way in the 5 years since we announced its availability in January 2012. DynamoDB was the first service at AWS to use SSD storage. You can add DAX to your existing DynamoDB applications with just a few clicks in the AWS Management Console – no application rewrites required.

Speed 121

Speed Cache Latency AWS 121