Reinventing Performance Testing: New Architectures

Alex Podelko

I am looking forward to share my thoughts on ‘Reinventing Performance Testing’ at the imPACt performance and capacity conference by CMG held on November 7-10, 2016 in La Jolla, CA. Due to virtualization system-level monitoring doesn’t help much anymore and may be misleading – so getting information from application and database servers becomes very important.

Why Uber Engineering Switched from Postgres to MySQL

Uber Engineering

Architecture Open Source Data Database Infra MySQL Postgres Uber DataBy Evan Klitzke. Introduction. The early architecture of Uber consisted of a monolithic backend application written in Python that used Postgres for data persistence.

Expanding the AWS Cloud: Introducing the AWS US East (Ohio) Region

All Things Distributed

In the remainder of 2016 and inq 2017, we will launch another four AWS regions in Canada, China, the United Kingdom, and France, adding another nine AZs to our global infrastructure footprint. Today I am very happy to announce the opening of the new US East (Ohio) Region.

AWS 82

Spice up your Analytics: Amazon QuickSight Now Generally Available in N. Virginia, Oregon, and Ireland.

All Things Distributed

In addition to AWS data sources, QuickSight also lets customers connect to third-party databases running on Amazon EC2 or on-premises and popular business applications like Excel and Salesforce.

Accelerating Data: Faster and More Scalable ElastiCache for Redis

All Things Distributed

Fast Data is an emerging industry term for information that is arriving at high volume and incredible rates, faster than traditional databases can manage. While caching continues to be a dominant use of ElastiCache for Redis, we see customers increasingly use it as an in-memory NoSQL database.

Designing Schemaless, Uber Engineering’s Scalable Datastore Using MySQL

Uber Engineering

Architecture Data Database Infra Mezzanine MySQLBy Jakob Holdgaard Thomsen. The making of Schemaless, Uber Engineering’s custom designed datastore using MySQL, which has allowed us to scale from 2014 to beyond. This is part one of a three-part series on Schemaless. In Project Mezzanine we described … The post Designing Schemaless, Uber Engineering’s Scalable Datastore Using MySQL appeared first on Uber Engineering Blog.

Expanding the Cloud: Introducing the AWS Asia Pacific (Seoul) Region

All Things Distributed

Mirae Asset Global Investments improved its web service environment and reduced annual management costs by 50% by consolidating the management of all web services, including servers, network, database, and security.

Games 83

The Architecture of Schemaless, Uber Engineering’s Trip Datastore Using MySQL

Uber Engineering

Architecture Data Database Infra Mezzanine MySQLHow Uber’s infrastructure works with Schemaless, the datastore using MySQL that’s kept Uber Engineering scaling since October 2014. This is part two of a three- part series on Schemaless; part one is on designing Schemaless. In Project Mezzanine: … The post The Architecture of Schemaless, Uber Engineering’s Trip Datastore Using MySQL appeared first on Uber Engineering Blog.

SQL Mysteries: SQL Server Login Timeouts – A Debugging Story

SQL Server According to Bob

This means we are reading database pages from the master, acquiring locks, and making calls to the domain controller (DC/KDC.). This means that we are unlikely encountering issues with database reads, locking or a preemptive, external call.

Upcoming Webinar Tuesday, 7/31: Using MySQL for Distributed Database Architectures


Please join Percona’s CEO, Peter Zaitsev as he presents Using MySQL for Distributed Database Architectures on Tuesday, July 31st, 2018 at 7:00 AM PDT (UTC-7) / 10:00 AM EDT (UTC-4). 5000 named Percona to their list in 2013, 2014, 2015 and 2016.

Weekend Reading: Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases.

All Things Distributed

In many, high-throughput, OLTP style applications the database plays a crucial role to achieve scale, reliability, high-performance and cost efficiency. For a long time, these requirements were almost exclusively served by commercial, proprietary databases.

Should You Use ClickHouse as a Main Operational Database?


What if we use ClickHouse (which is a columnar analytical database) as our main datastore? Well, typically, an analytical database is not a replacement for a transactional or key/value datastore. how many messages was send for some time period and how much it cost) and a typical key/value queries like: “return 1 message by the message id” Using a columnar analytical database can be a big challenge here. 2016 ? 2016 ?

Which is the Best MongoDB GUI? — 2019 Update


In 2014, we discussed 4 of the top MongoDB GUIs: MongoVue, MongoHub, RockMongo, and Robo 3T (formerly Robomongo), and again in 2016: MongoDB Compass, Robo 3T, Studio 3T, and MongoBooster. SQL Import/Export that supports major databases: Oracle, SQL Server, MySQL, and PostgreSQL.

Common SQL Server Mishaps

SQL Performance

This article will expand on my previous article and point out how these apply to SQL Server , Azure SQL Database , and Azure SQL Managed Instance. When looking at backups, I check for recovery model and the current history of backups for each database.

Thoughts on SQL Server 2019 Editions

SQL Performance

As you may recall, back in SQL Server 2016 SP1, they opened up all of the programming surface features to all editions, and many (but certainly not all) of the performance and availability features. I wrote about this in a post entitled, " A Big Deal : SQL Server 2016 Service Pack 1."

T-SQL bugs, pitfalls, and best practices – window functions

SQL Performance

In my examples I'll use a sample database called TSQLV5. You can find the script that creates and populates this database here , and its ER diagram here. This article is the fourth installment in a series about T-SQL bugs, pitfalls and best practices.

Analyzing "death by a thousand cuts" workloads

SQL Performance

In order to use Query Store and Extended Events, you have to configure them in advance – either enabling Query Store for your database(s), or setting up an XE session and starting it. [ dbid ] ) AS [ Database Name ] , REPLACE ( REPLACE ( LEFT ( t. [

C++ 52

Is Intel Doomed in the Server CPU Space?

SQL Performance

From 2007 until 2016, Intel was able to successfully execute their Tick-Tock release strategy, where they would introduce a new processor microarchitecture roughly every two years (a Tock release). Intel has been stuck at 14nm in the server space since the Broadwell release in Q4 of 2016.

Webinar Tuesday, 8/28: Forking or Branching – Lessons from the MySQL Community


5000 named Percona to their list in 2013, 2014, 2015 and 2016. Peter frequently speaks as an expert lecturer at MySQL and related conferences, and regularly posts on the Percona Database Performance Blog.

The ANY Aggregate is Broken

SQL Performance

Nevertheless, if you run this query yourself, you are quite likely to see the same result I do: The execution plan depends on the version of SQL Server used, and does not depend on database compatibility level. The more complex SQL Server 2016+ plan does not use the ANY aggregate at all.

Nested window functions in SQL

SQL Performance

The ISO/IEC 9075:2016 standard (SQL:2016) defines a feature called nested window functions. This feature allows you to nest two kinds of window functions as an argument of a window aggregate function.

Minimal Logging with INSERT…SELECT into Heap Tables

SQL Performance

The summary rows for heap tables without indexes are the same in both documents (no changes for SQL Server 2016): An explicit TABLOCK hint is not the only way to meet the requirement for table-level locking. For example, with row versioning turned off for the database: SELECT.

Row Pattern Recognition in SQL

SQL Performance

The ISO/IEC 9075:2016 standard, or SQL:2016 in short, introduces support for a profound concept called Row Pattern Recognition (RPR) in SQL. The SQL:2016 standard provides two main RPR-related features: Feature R010, “Row pattern recognition: FROM clause”.

C++ 77

SQL Server On Linux: Forced Unit Access (Fua) Internals

SQL Server According to Bob

Durability: “In database systems , durability is the ACID property which guarantees transactions that have committed will survive permanently. Microsoft SQL Server Database Engine Input/Output Requirements. All Data Files For Same Database Flushed. Overview.

AMD EPYC Processors in Azure Virtual Machines

SQL Performance

Both of these Intel processors are special bespoke models that are not in the Intel ARK database. The slightly newer Intel Xeon E5-26xx v4 (Broadwell) series which was introduced in Q1 of 2016, increased that to 2400MHz.

Minimal Logging with INSERT…SELECT and Fast Load Context

SQL Performance

From SQL Server 2016 onward, FastLoadContext is enabled by default ; the trace flag is not required. For more background, see the Data Performance Loading Guide and the Tiger Team notes on the behaviour changes for SQL Server 2016. FastLoadContext can be disabled on SQL Server 2016 using documented trace flag 692. The test table schema is such that 130 rows can fit on a single 8KB page when row versioning is off for the database.

Monitoring: Why focus on the end user experience?


I recently was asked the following question by an online retailer: “Why should I invest in monitoring the user experience when I already have monitoring for our database, infrastructure, app server, and network?”.

Minimal Logging with INSERT…SELECT into Empty Clustered Tables

SQL Performance

The following script should be run on a development SQL Server instance in a new test database set to use the SIMPLE or BULK_LOGGED recovery model. Introduction.

Cache 70

5 tips for architecting fast data applications

O'Reilly Software

Google was among the pioneers that created “web scale” architectures to analyze the massive data sets that resulted from “crawling” the web that gave birth to Apache Hadoop, MapReduce, and NoSQL databases. We usually relate SQL to querying tables in relational databases.

Grouped Aggregate Pushdown

SQL Performance

SQL Server 2016 introduced serial batch mode processing and aggregate pushdown. The scripts that follow assume there is a table called dbo.Numbers in the current database that contains integers from 1 to at least 16,384. Introduction.

Introduction to Wait Statistics

SQL Performance

To help with this, and because Microsoft does not have documentation on how to interpret wait statistics, back in 2016 I released a wait type library, with details of hundreds of common wait types and how to troubleshoot them.

Introducing The Component-Based API

Smashing Magazine

Following, the API will add the database object data. This information is not placed under each module, but under a shared section called databases , to avoid duplicating information when two or more different modules fetch the same objects from the database.

Headless WordPress: The Ups And Downs Of Creating A Decoupled WordPress

Smashing Magazine

It’s an all-in-one system that is equipped with a working admin interface; it manages database connection, and has a bunch of useful APIs exposed that handle user authentication, routing, and more. on December 6th, 2016. Since they can store transients in memory instead of a database.

Cache 82

AWS EC2 Virtualization 2017: Introducing Nitro

Brendan Gregg

But not all workloads: some are network bound (proxies) and storage bound (databases). ## 5. This was extended to instance storage devices for the x1.32xlarge in 2016.

Break that big ball of mud!

Particular Software

This article was originally published on the NDC 2016 Blog. It turned out that an RPC call to a legacy service, whose response value was stored in the 72nd column in the database table, wasn't even necessary. You may not always need a relational database.

Code 56

Expanding the Cloud – An AWS Region is coming to Hong Kong

All Things Distributed

Since then, AWS has added two more PoPs in Hong Kong, the latest in 2016. Beyond running their web properties and applications, Next Digital also uses Amazon RDS (database), Amazon ElastiCache (caching), and Amazon Redshift (data warehousing).

How Improving Website Performance Can Help Save The Planet

Smashing Magazine

The Green Web Foundation maintains an ever-growing database of web hosts who are either wholly powered by renewable energy or are at least committed to being carbon neutral. In 2016, O’Reilly published “ Designing For Sustainability ” by Tim Frick.

Serverless at re:Invent 2017

The Symphonia

Serverless Aurora promises to be the SQL Database to partner with Lambda that we’ve been hoping for. It’s still in early access, so no concrete news to report here, but a lot of people will be happy to be able to use a SQL database that has the operational properties of DynamoDB.