Skip to content

Commit 097c048

Browse files
committed
Expand results view tests
1 parent 531f32c commit 097c048

1 file changed

Lines changed: 62 additions & 46 deletions

File tree

extensions/ql-vscode/docs/test-plan.md

Lines changed: 62 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -215,55 +215,71 @@ with this since it has quite a limited number of actions you can do.
215215
2. Cannot cancel analysis
216216

217217
### Results view
218+
219+
This requires running a MRVA query and seeing the results view.
220+
221+
#### Test case 1: When variant analysis state is "pending"
218222
1. Can open a results view
219-
- When variant analysis state is "pending"
220-
- When variant analysis state is "in_progress"
221-
- When variant analysis state is "succeeded"
222-
- When variant analysis state is "failed"
223-
- When variant analysis state is "canceled"
224223
2. Results view opens automatically
225-
- When starting variant analysis run
226-
- When VSCode opens (if view was open when VSCode was closed)
224+
- When starting variant analysis run
225+
- When VSCode opens (if view was open when VSCode was closed)
226+
3. Results view is empty
227+
228+
#### Test case 2: When variant analysis state is not "pending"
229+
1. Can open a results view
230+
2. Results view opens automatically
231+
1. When starting variant analysis run
232+
2. When VSCode opens (if view was open when VSCode was closed)
227233
3. Can copy repository list
228-
See section from query history.
234+
1. Text is copied to clipboard
235+
2. Text is a valid repository list
229236
4. Can export results
230-
- Only includes repos that you have selected (also see section from query history)
231-
5. Can cancel analysis (see section from query history)
232-
6. Can open query file (see section from query history)
233-
7. Can open query text
234-
8. Can view logs when variant analysis in final state (succeeded/failed/cancelled)
235-
9. Can sort repos
236-
- By name
237-
- By results
238-
- By stars
239-
- By last commit
240-
10. Can filter repos
241-
11. Shows correct statistics
242-
- Total number of results
243-
- Total number of repositories
244-
- Duration
245-
13. Can see live results
246-
- Results appear in extension as soon as each query is completed
247-
14. Can view interpreted results (i.e. for a "problem" query)
248-
- Can view non-path results
249-
- Can view code paths for "path-problem" queries
250-
15. Can view raw results (i.e. for a non "problem" query)
251-
- Renders a table
252-
16. Can see skipped repositories
253-
- Can see repos with no db in a tab
254-
- Shown warning that explains the tab
255-
- Can see repos with no access in a tab
256-
- Shown warning that explains the tab
257-
- Only shows tab when there are skipped repos
258-
17. Result downloads
259-
- All results are downloaded automatically
260-
- Download status is indicated by a spinner (Not currently any indication of progress beyond "downloading" and "not downloading")
261-
- Only 3 items are downloaded at a time
262-
- Results for completed queries are still downloaded when
263-
- Some but not all queries failed
264-
- The variant analysis was cancelled after some queries completed
237+
1. Only includes repos that you have selected (also see section from query history)
238+
5. Can cancel analysis
239+
6. Can open query file
240+
1. When the file still exists and has not moved
241+
2. When the file does not exist
242+
7. Can open query text
243+
8. Can sort repos
244+
1. By name
245+
2. By results
246+
3. By stars
247+
4. By last commit
248+
9. Can filter repos
249+
10. Shows correct statistics
250+
1. Total number of results
251+
2. Total number of repositories
252+
3. Duration
253+
11. Can see live results
254+
1. Results appear in extension as soon as each query is completed
255+
12. Can view interpreted results (i.e. for a "problem" query)
256+
1. Can view non-path results
257+
2. Can view code paths for "path-problem" queries
258+
13. Can view raw results (i.e. for a non "problem" query)
259+
1. Renders a table
260+
14. Can see skipped repositories
261+
1. Can see repos with no db in a tab
262+
1. Shown warning that explains the tab
263+
2. Can see repos with no access in a tab
264+
1. Shown warning that explains the tab
265+
3. Only shows tab when there are skipped repos
266+
15. Result downloads
267+
1. All results are downloaded automatically
268+
2. Download status is indicated by a spinner (Not currently any indication of progress beyond "downloading" and "not downloading")
269+
3. Only 3 items are downloaded at a time
270+
4. Results for completed queries are still downloaded when
271+
1. Some but not all queries failed
272+
2. The variant analysis was cancelled after some queries completed
273+
274+
#### Test case 3: When variant analysis state is in "succeeded" state
275+
1. Can view logs
276+
2. All results are downloaded
277+
278+
#### Test case 4: When variant analysis is in "failed" or "cancelled" state
279+
1. Can view logs
280+
1. Results for finished queries are still downloaded.
265281

266282
### Is all copy / text correct?
267-
- In prompts when running a query
268-
- In query history
269-
- In results view
283+
1. In prompts when running a query
284+
2. In query history
285+
3. In results view

0 commit comments

Comments
 (0)