realaravinth/debian-mirror-gitlab
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
debian-mirror-gitlab/.gitlab/issue_templates/Acceptance_Testing.md
Pirate Praveen b5b5f601e2 New upstream version 11.3.10+dfsg
2018-11-20 20:47:30 +05:30

3.5 KiB
Raw Blame History

Details

  • Feature Toggle Name: FEATURE_NAME
  • Required GitLab Version: vX.X

1. Preparation

  • Controllers and workers:
    1. Please link to dashboards of the workers, and the controllers and actions that can be impacted
    2. ...
    3. ...

2. Development Trial

Check Dev Server Versions

Enable on dev.gitlab.org:

  • /chatops feature set FEATURE_NAME true --dev in #dev-gitlab

Then leave running while monitoring and performing some testing through web, api or SSH.

Monitor

2. Staging Trial

Check Staging Server Versions

Enable on staging.gitlab.com

  • /chatops run feature set FEATURE_NAME true --staging in #development

Then leave running while monitoring for at least 15 minutes while performing some testing through web, api or SSH.

Monitor

4. Production Server Version Check

5. Initial Impact Check

  • Enable for a subset of users, when using percentage gates: 1%.

Then leave running while monitoring for at least 15 minutes while performing some testing through web, api or SSH.

Monitor

6. Low Impact Check

  • Enable for a bigger subset of users, when using percentage gates: 10%.

Then leave running while monitoring for at least 30 minutes while performing some testing through web, api or SSH.

Monitor

7. Mid Impact Trial

  • Enable for a big subset of users, when using percentage gates: 50%.

Then leave running while monitoring for at least 12 hours while performing some testing through web, api or SSH.

Monitor

8. Full Impact Trial

  • Enable for all users: `/chatops run feature set FEATURE_NAME true

Then leave running while monitoring for at least 1 week.

Monitor

Success?

  • Remove the feature gate from the code, and close this issue with that MR.