debian-mirror-gitlab/.gitlab/issue_templates/QA Failure.md

83 lines
2.9 KiB
Markdown
Raw Normal View History

2020-03-13 15:44:24 +05:30
<!---
Before opening a new QA failure issue, make sure to first search for it in the
QA failures board: https://gitlab.com/groups/gitlab-org/-/boards/1385578
The issue should have the following:
- The relative path of the failing spec file in the title, e.g. if the login
test fails, include `qa/specs/features/browser_ui/1_manage/login/log_in_spec.rb` in the title.
This is required so that existing issues can easily be found by searching for the spec file.
- If the issue is about multiple test failures, include the path for each failing spec file in the description.
- A link to the failing job.
- The stack trace from the job's logs in the "Stack trace" section below.
- A screenshot (if available), and HTML capture (if available), in the "Screenshot / HTML page" section below.
2022-05-07 20:08:51 +05:30
- A link to the corresponding test case(s) in the summary.
2020-03-13 15:44:24 +05:30
--->
### Summary
2022-05-07 20:08:51 +05:30
Failing job(s):
2020-03-13 15:44:24 +05:30
2022-05-07 20:08:51 +05:30
Failing spec(s):
Corresponding test case(s):
2020-03-13 15:44:24 +05:30
### Stack trace
```
PUT STACK TRACE HERE
```
### Screenshot / HTML page
<!--
Attach the screenshot and HTML snapshot of the page from the job's artifacts:
1. Download the job's artifacts and unarchive them.
1. Open the `gitlab-qa-run-2020-*/gitlab-{ce,ee}-qa-*/{,ee}/{api,browser_ui}/<path to failed test>` folder.
1. Select the `.png` and `.html` files that appears in the job logs (look for `HTML screenshot: /path/to/html/page.html` / `Image screenshot: `/path/to/html/page.png`).
1. Drag and drop them here.
2020-04-22 19:07:51 +05:30
Note: You don't need to include a screenshot if the information it contains can be included as text. Include the text instead.
E.g., error 500/404, "Retry later" errors, etc.
If you include multiple screenshots it can be helpful to hide all but the first in a details/summary element, to avoid excessive scrolling:
<details><summary>Expand for screenshot</summary>
drag and drop the screenshot here
</details>
2020-03-13 15:44:24 +05:30
-->
### Possible fixes
<!-- Default due date. -->
/due in 2 weeks
<!-- Base labels. -->
2020-04-08 14:13:33 +05:30
/label ~Quality ~QA ~test
<!-- Test failure type label, please use just one.-->
2022-05-07 20:08:51 +05:30
/label ~"failure::broken-test" ~"failure::flaky-test" ~"failure::stale-test" ~"failure::test-environment" ~"failure::investigating" ~"failure::new"
2020-03-13 15:44:24 +05:30
<!--
Choose the stage that appears in the test path, e.g. ~"devops::create" for
`qa/specs/features/browser_ui/3_create/web_ide/add_file_template_spec.rb`.
-->
/label ~devops::
<!--
Select a label for where the failure was found, e.g. if the failure occurred in
a nightly pipeline, select ~"found:nightly".
-->
/label ~found:
<!--
https://about.gitlab.com/handbook/engineering/quality/guidelines/#priorities:
2020-11-24 15:15:51 +05:30
- ~"priority::1": Tests that are needed to verify fundamental GitLab functionality.
- ~"priority::2": Tests that deal with external integrations which may take a longer time to debug and fix.
2020-03-13 15:44:24 +05:30
-->
2020-11-24 15:15:51 +05:30
/label ~priority::
2020-03-13 15:44:24 +05:30
2020-11-24 15:15:51 +05:30
<!-- Select the current milestone if ~"priority::1" or the next milestone if ~"priority::2". -->
2020-03-13 15:44:24 +05:30
/milestone %