This tutorial will give you a complete in-depth look at the Exploratory Testing Tours specified by James Whittaker which in turn would help to ensure complete and thorough exploratory testing.
Exploratory Testing Tours: How to Ensure a High-Quality Software Product using Exploratory Test Tours
Exploratory testing is not a testing methodology. Rather, it is an approach to quality verification. The procedure of exploratory testing execution resembles the discovery and investigation of any software product.
During exploratory testing, a QA specialist examines a product, designs tests, executes test cases, and analyzes the test results simultaneously.
In comparison to traditional testing, an exploratory checking approach helps to detect more software bugs due to untypical scenarios.
But few people are sure that during exploratory testing, QA specialists can miss the core functionality of the product and leave it without verification.
Table of Contents:
Exploratory Testing Tours
There are several techniques that help to ensure wide test coverage of exploratory testing. One such technique is Exploratory Tasting Tours.
While performing exploratory testing, test engineers resemble tourists who arrive in a place where they have never been before. Tourists would wish to visit and see as many places as possible within a limited timeframe.
Each city or town has several districts, for example, business or historical ones, and the tourists choose one or several districts to visit based on their comfort.
In terms of software testing,
- The city or town where the tourists come is a software product to test.
- Districts have software features and modules.
A tour is a so-called plan of testing activities. This includes the objectives and tasks to focus on during exploratory testing. Usually, the duration of each tour is limited and should not exceed 4 hours.
6 Prime Districts for Exploratory Testing Tours
James Whittaker was not the author of the idea of exploratory tours, he developed his own approach to exploratory testing and specified the tours.
He pointed out 6 main districts with several tours available.
#1) Business District
A business district is a place where people make money. You will be able to find a lot of banks and office buildings. In several cases, tourists do not like to walk in the business district as there is nothing interesting to see.
A software product also has its own “business district” features that are designed to increase sales. Promo material informs about the features that differentiate a software product from similar ones available on the market and attract more users.
For example, a free trial period, every 5th delivery is free, etc.
a) Guidebook Tour
Some tourists travel only according to the guidebook and never visit places that are not included or mentioned in the guide. This situation is relevant to the users who strictly follow each and every step specified in the support information, instructions, and user manuals.
Users may face bugs such as unclear/improper instructions, steps to follow do not correspond to the actual work of the software, inconclusive prompts, etc.
b) Money Tour
Every city has a special place that attracts all the tourists. For example, people visit Paris to see the Eiffel Tower and the Louvre museum. The visiting card of Rome is the Colosseum.
In software testing, the advertising materials should correspond to the actual features of the application. Otherwise, after purchasing the application, the users will be disappointed, might leave negative feedback, and never recommend your app to others.
Also, the Money tour may detect outdated screenshots or lists of features, improper grammar, and logical mistakes.
c) Landmark Tour
A tourist selects the places to visit beforehand but without detailed planning as he/she does with a guidebook. A test engineer defines a list of software features and executes testing based on that list in a step-by-step manner.
Thus, the tester does not miss the critical functionality and may detect bugs that block the system’s operability.
d) Intellectual Tour
Every tourist group will include a person who would have read tons of books about the city, its history, cultural traditions and try to show his/ her brilliance all the time.
A tester can also execute untypical user scenarios to detect bugs. For example, to enter a very long name for a file, add a huge number of products to the shopping cart, enter invalid data into the form fields, etc.
e) FedEx Tour
Before reaching an addressee, an international parcel gets additional marks and ticks.
A software product also utilizes data that can be stored, modified, or even lost. A test engineer should follow the way in which the data is processed and validate it after all the operations. For example, an app does not support the Cyrillic alphabet or right-to-left writing.
f) After-Hours Tour
At the end of the working day, people go home leaving their job for the next day. But when a user closes an application, that does not mean that it stops working totally.
The app can backup or archive data, receive updates, etc. Verifying the application in the background mode, a tester can detect irrational usage of traffic, memory leaks, and so on.
g) Garbage Collector Tour
Even the smallest town has garbage collectors who spend a couple of minutes near every house to collect garbage and go farther.
In software testing, the tour resembles sampling verification without any detailed analysis. For example, checking software UI, content elements, etc.
#2) Historic District
A typical tour includes a tour around old districts which is full of ancient buildings and places of historical value.
In testing, a historic district refers to features that are connected with previous product versions, code, or functionality.
a) Bad-Neighborhood Tour
There are places that all tourists should try to avoid.
A bad-neighborhood tour is code fragments that contain a lot of bugs. Usually, one bug triggers another one, and so on. A tester should check such buggy areas precisely.
b) Museum Tour
Every traditional tour includes visiting museums.
In testing, a museum is a code that developers have not changed for a long time. The code may not work in a new environment. For example, an Android version of the application operates properly. Developers may copy code or files that are improper for an iOS version.
c) Prior Version Tour
The restoration of buildings is similar to software updates. Users should easily adapt to the updated UI and functionality that can change the user experience.
The tester should take all the modifications into account.
#3) Entertainment District
After a long walk, the tourists wish to have some fun. An entertainment district symbolizes the option of software customization.
There are 3 tours in the Entertainment district namely:
- Supporting Actors (focus not on critical functionality),
- Back Alley (testing not frequently used features), and
- All-Nighter or Clubbing tours (testing an application without restarting).
Entertainment districts focus on the functionality related to the core one. Tours can help detect UI bugs, localization errors, usability issues, and uncritical functional bugs.
#4) Tourist District
Every city and town has places where tourists spend a lot of money. Here there are many restaurants and gift shops.
In testing, a Tourist district means to look through the software functionality without focusing on any detail. Testers may follow the Collector tour to verify software artifacts, e.g., anything that a user is able to save.
Also, there are Lonely Businessmen (to get to the feature using the longest way), Supermodel (GUI verification), and Scottish Pub tour that includes the analysis of users’ feedback.
#5) Hotel District
Usually, tourists stay in hotels where they can take some rest and relax after a busy day. During testing, a hotel district is a place to verify non-critical functionality.
a) Rained-Out Tour
Sudden rain can spoil the planned promenade and make tourists stay in the hotel. A tester verifies the system behavior by cancelling the previous operation and checks the after-effects of his actions.
b) Couch Potato Tour
A tourist group may include an apathetic person who is not interested in anything.
In testing, a QA specialist should verify the system functionality by following a default way without making any settings.
#6) Seedy District
A seedy district is too dangerous for tourists. In testing, it is such software areas that attract shifty users who strive to crash the system.
Testers should mind that and try to simulate the actions of such users. They can follow the Saboteur tour and try to crash the system by limiting the resources that are required for proper operation.
An Obsessive-Compulsive tour means repeating the same action several times and monitoring the system behavior.
The idea of the Antisocial tour is to perform actions that contradict the app logic, for example, entering invalid data.
Antisocial tour includes 3 sub tours namely:
- Opposite
- Crime spree
- Wrong turn
During the opposite sub tour, testers perform the actions that the users will conduct unlikely, for example, adding more than 10 000 tracks to a playlist.
The crime spree sub tour means to enter illegal data, E.g., SQL injections.
According to the wrong turn sub tour, a tester performs an ordinary action but in the wrong sequence.
Conclusion
In this article, we took an in-depth look at the tours specified by James Whittaker which helped to ensure complete and thorough exploratory testing.
I hope you enjoyed this informative tutorial on Exploratory Testing Tours.
About the Author: Anastasiia Piatak is a Program Manager at QATestLab and an independent provider of QA and testing services. Anastasiia has more than 2-year experience in management, software testing, project management, and presales. She leads a team of more than 20 members and currently has 10+ active projects.
Do you have anything new to share about Exploratory Testing Tours? Feel free to express your thoughts in the comments section below. We would love to hear from you.
PREV Tutorial | NEXT Tutorial #3: Exploratory Testing vs Scripted Testing
greate job
Nice explanation. Exploratory tours are the perfect ways for best coverage of exploratory testing.
Very interesting comparison and documentation. Thanks!
Exploratory tours really helps a lot to identify and isolate the procedure or way to carry out during the exploratory testing.
On & all well defined and detailed piece of content.