Test Suite is a collection of Scenarios grouped for the purpose of execution, analysis and Release tracking. Since a Scenario comprises of 1 or more Test Cases, a Test Suite ultimately consists of a collection of Test Cases.
Depending on your objective, you can create three different types of Test Suites in accelQ. These three types differ in the way the collection of Scenarios is formulated.
- Static suite: Collection of Scenarios is manually selected from the Universe.
- Filter based suite: You specify which scenarios to be selected based on a set of Scenario custom field filters or tag based filters. It is a dynamic suite and evolves as you keep building more and more scenarios satisfying the filter criterion.
- Requirements based suite: You specify a set of Requirements based on which, the required Scenarios are pooled from traceability information in the Universe. Here again, the suite is dynamic and evolves as you build scenarios catering to given Requirements.
Create Test Suite
- Click on the "+" icon in the top toolbar of accelQ and select "Test Suite".
- Choose the Type of test suite.
- Provide any custom field information that the Suite may be associated with.
Once you create a suite, you are prompted to setup the content (test cases) of the suite in subsequent steps.
Setting up a Test Suite
Setting up the content of a test suite is a 2 step process:
Step 1: Scenario selection
You select scenarios depending on the type of Suite.
- Static: Manually select required scenarios
- Filter based: Setup Scenario tag based and custom field based filters. Scenarios are auto selected based on the filters.
- Requirements based: Setup Requirement ID's based on which traceable scenarios are auto selected.
Step 2: Setup Test Case filters
Once the Scenario list is formed, all the test cases from these scenario are now part of the suite.
If you would like to further fine-tune the definition of a suite, you can apply test case filters.
For example, you may want to create a suite: Sanity test suite for Flights module.
In this case, you could create a Filter based suite where Module = Flight and then apply test case filter to say, Test Type = Sanity
Selecting scenarios for static suite
Click in the search field to get a list of Scenarios in the system.
Select one or more Scenarios from the list. You can Ctrl-Click of Shift-Click to select multiple scenarios from the list in one shot. Click Add button.
Note: You can also type in the search field to filter the dropdown list.
Review and re-order scenarios as required for the flow. Static suite allows you to setup a specific order for Scenarios to execute.
Setting up Scenario Filters for Filter based Test Suite
For a filter based suite, you specify a list of Scenario filters and the system auto selects the matching scenarios from the project.
- In the Scenario filter model, click on Add Filter link.
- Select the field name, operator (contains or not-contains) and the value. You can also select multiple values for the field.
- Click on the tick-mark to confirm the filter.
- You can add multiple filters, which are combined as AND condition between each filter. In other words, selected scenarios will satisfy ALL the filter conditions.
Setting up Requirements for Requirements Based Suite
In the Requirements based suite, you select a set of Requirements from your Requirements tracking system (Jira, TFS etc.). System auto selects Scenarios that are marked for traceability with the selected Requirements.
- Select Jira or TFS project where Requirements should be searched.
- Search for requirements based on the Requirement ID (or Story ID) or based on text content of the story.
- You may have multiple matches from the search.
- Select (one or more) based on the need and add to the list of Requirements.
Setting up Test Case filters
Once you setup criterion for selecting Scenarios, you can optionally setup a Test Case filter to further fine-tune the content of a suite. This operation is common for all three types of suites.
- In the Test Case filter model, click on Add Filter link.
- Select the field name, operator (contains or not-contains) and the value. You can also select multiple values for the field.
- Click on the tick-mark to confirm the filter.
- You can add multiple filters, which are combined as AND condition between each filter. In other words, selected test cases will satisfy ALL the filter conditions.
Editing Test Suite definition
You can edit the Scenario selection and test case filters by navigating to Test Cases tab.
In the top header section in the Test Case listing page, hover and click on the Scenario definition line or test case filter line.
Alternatively, click on the Edit button in the side and choose one of the options to edit.
Comments
0 comments
Please sign in to leave a comment.