debian-mirror-gitlab/doc/development/feature_categorization/index.md

234 lines
8 KiB
Markdown
Raw Normal View History

2021-01-29 00:20:46 +05:30
---
stage: Enablement
group: Infrastructure
2022-11-25 23:54:43 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments
2021-01-29 00:20:46 +05:30
---
2020-07-28 23:09:34 +05:30
# Feature Categorization
> [Introduced](https://gitlab.com/groups/gitlab-com/gl-infra/-/epics/269) in GitLab 13.2.
2023-03-17 16:20:25 +05:30
Each Sidekiq worker, Batched Background migrations, controller action, [test example](../testing_guide/best_practices.md#feature-category-metadata) or API endpoint
2020-07-28 23:09:34 +05:30
must declare a `feature_category` attribute. This attribute maps each
2022-08-27 11:52:29 +05:30
of these to a [feature category](https://about.gitlab.com/handbook/product/categories/). This
2020-07-28 23:09:34 +05:30
is done for error budgeting, alert routing, and team attribution.
The list of feature categories can be found in the file `config/feature_categories.yml`.
This file is generated from the
[`stages.yml`](https://gitlab.com/gitlab-com/www-gitlab-com/blob/master/data/stages.yml)
data file used in the GitLab Handbook and other GitLab resources.
## Updating `config/feature_categories.yml`
Occasionally new features will be added to GitLab stages, groups, and
product categories. When this occurs, you can automatically update
`config/feature_categories.yml` by running
`scripts/update-feature-categories`. This script will fetch and parse
[`stages.yml`](https://gitlab.com/gitlab-com/www-gitlab-com/blob/master/data/stages.yml)
and generate a new version of the file, which needs to be committed to
the repository.
2022-08-27 11:52:29 +05:30
The [Scalability team](https://about.gitlab.com/handbook/engineering/infrastructure/team/scalability/)
2021-01-03 14:25:43 +05:30
currently maintains the `feature_categories.yml` file. They will automatically be
2020-07-28 23:09:34 +05:30
notified on Slack when the file becomes outdated.
## Sidekiq workers
The declaration uses the `feature_category` class method, as shown below.
```ruby
class SomeScheduledTaskWorker
include ApplicationWorker
# Declares that this worker is part of the
# `continuous_integration` feature category
feature_category :continuous_integration
# ...
end
```
The feature categories specified using `feature_category` should be
defined in
[`config/feature_categories.yml`](https://gitlab.com/gitlab-org/gitlab/-/blob/master/config/feature_categories.yml). If
not, the specs will fail.
### Excluding Sidekiq workers from feature categorization
A few Sidekiq workers, that are used across all features, cannot be mapped to a
2022-06-21 17:19:12 +05:30
single category. These should be declared as such using the
`feature_category :not_owned`
2020-07-28 23:09:34 +05:30
declaration, as shown below:
```ruby
class SomeCrossCuttingConcernWorker
include ApplicationWorker
# Declares that this worker does not map to a feature category
2022-06-21 17:19:12 +05:30
feature_category :not_owned # rubocop:disable Gitlab/AvoidFeatureCategoryNotOwned
2020-07-28 23:09:34 +05:30
# ...
end
```
2021-11-18 22:05:49 +05:30
When possible, workers marked as "not owned" use their caller's
category (worker or HTTP endpoint) in metrics and logs.
For instance, `ReactiveCachingWorker` can have multiple feature
categories in metrics and logs.
2023-03-17 16:20:25 +05:30
## Batched background migrations
Long-running migrations (as per the [time limits guidelines](../migration_style_guide.md#how-long-a-migration-should-take))
are pulled out as [batched background migrations](../database/batched_background_migrations.md).
They should define a `feature_category`, like this:
```ruby
# File name: lib/gitlab/background_migration/my_background_migration_job.rb
class MyBackgroundMigrationJob < BatchedMigrationJob
feature_category :gitaly
#...
end
```
NOTE:
[`RuboCop::Cop::BackgroundMigration::FeatureCategory`](https://gitlab.com/gitlab-org/gitlab/-/blob/master/rubocop/cop/background_migration/feature_category.rb) cop ensures a valid `feature_category` is defined.
2020-07-28 23:09:34 +05:30
## Rails controllers
Specifying feature categories on controller actions can be done using
the `feature_category` class method.
A feature category can be specified on an entire controller
using:
```ruby
2021-01-03 14:25:43 +05:30
class Boards::ListsController < ApplicationController
feature_category :kanban_boards
2020-07-28 23:09:34 +05:30
end
```
The feature category can be limited to a list of actions using the
2021-01-03 14:25:43 +05:30
second argument:
2020-07-28 23:09:34 +05:30
```ruby
2021-01-03 14:25:43 +05:30
class DashboardController < ApplicationController
2021-12-11 22:18:48 +05:30
feature_category :team_planning, [:issues, :issues_calendar]
2023-03-17 16:20:25 +05:30
feature_category :code_review_workflow, [:merge_requests]
2020-07-28 23:09:34 +05:30
end
```
2021-01-03 14:25:43 +05:30
These forms cannot be mixed: if a controller has more than one category,
every single action must be listed.
2020-07-28 23:09:34 +05:30
### Excluding controller actions from feature categorization
In the rare case an action cannot be tied to a feature category this
can be done using the `not_owned` feature category.
```ruby
class Admin::LogsController < ApplicationController
feature_category :not_owned
end
```
### Ensuring feature categories are valid
The `spec/controllers/every_controller_spec.rb` will iterate over all
defined routes, and check the controller to see if a category is
assigned to all actions.
2021-01-03 14:25:43 +05:30
The spec also validates if the used feature categories are known. And if
the actions used in configuration still exist as routes.
2021-01-29 00:20:46 +05:30
## API endpoints
2021-02-22 17:27:13 +05:30
The [GraphQL API](../../api/graphql/index.md) is currently categorized
2021-03-08 18:12:59 +05:30
as `not_owned`. For now, no extra specification is needed. For more
2021-02-22 17:27:13 +05:30
information, see
[`gitlab-com/gl-infra/scalability#583`](https://gitlab.com/gitlab-com/gl-infra/scalability/-/issues/583/).
2021-01-29 00:20:46 +05:30
Grape API endpoints can use the `feature_category` class method, like
[Rails controllers](#rails-controllers) do:
```ruby
module API
class Issues < ::API::Base
2021-12-11 22:18:48 +05:30
feature_category :team_planning
2021-01-29 00:20:46 +05:30
end
end
```
The second argument can be used to specify feature categories for
specific routes:
```ruby
module API
class Users < ::API::Base
2023-04-23 21:23:45 +05:30
feature_category :user_profile, ['/users/:id/custom_attributes', '/users/:id/custom_attributes/:key']
2021-01-29 00:20:46 +05:30
end
end
```
Or the feature category can be specified in the action itself:
```ruby
module API
class Users < ::API::Base
2023-04-23 21:23:45 +05:30
get ':id', feature_category: :user_profile do
2021-01-29 00:20:46 +05:30
end
end
end
```
As with Rails controllers, an API class must specify the category for
every single action unless the same category is used for every action
within that class.
2023-03-04 22:38:38 +05:30
## RSpec Examples
You must set feature category metadata for each RSpec example. This information is used for flaky test
issues to identify the group that owns the feature.
2023-04-23 21:23:45 +05:30
The `feature_category` should be a value from [`config/feature_categories.yml`](https://gitlab.com/gitlab-org/gitlab/-/blob/master/config/feature_categories.yml).
2023-03-04 22:38:38 +05:30
The `feature_category` metadata can be set:
- [In the top-level `RSpec.describe` blocks](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/104274/diffs#6bd01173381e873f3e1b6c55d33cdaa3d897156b_5_5).
- [In `describe` blocks](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/104274/diffs#a520db2677a30e7f1f5593584f69c49031b894b9_12_12).
Consider splitting the file in the case there are multiple feature categories identified in the same file.
Example:
```ruby
RSpec.describe Admin::Geo::SettingsController, :geo, feature_category: :geo_replication do
```
For examples that don't have a `feature_category` set we add a warning when running them in local environment.
2023-04-23 21:23:45 +05:30
To disable the warning use `RSPEC_WARN_MISSING_FEATURE_CATEGORY=false` when running RSpec tests:
2023-03-04 22:38:38 +05:30
```shell
RSPEC_WARN_MISSING_FEATURE_CATEGORY=false bin/rspec spec/<test_file>
```
2023-04-23 21:23:45 +05:30
Additionally, we flag the offenses via `RSpec/MissingFeatureCategory` RuboCop rule.
2023-03-17 16:20:25 +05:30
### Tooling feature category
For Engineering Productivity internal tooling we use `feature_category: :tooling`.
For example in [`spec/tooling/danger/specs_spec.rb`](https://gitlab.com/gitlab-org/gitlab/-/blob/master/spec/tooling/danger/specs_spec.rb#L12).
2023-04-23 21:23:45 +05:30
### Shared feature category
For features that support developers and they are not specific to a product group we use `feature_category: :shared`
For example [`spec/lib/gitlab/job_waiter_spec.rb`](https://gitlab.com/gitlab-org/gitlab/-/blob/master/spec/lib/gitlab/job_waiter_spec.rb)
2023-07-09 08:55:56 +05:30
### Admin section
Adding feature categories is equally important when adding new parts to the Admin section. Historically, Admin sections were often marked as `not_owned` in the code. Now
you must ensure each new addition to the Admin section is properly annotated using `feature_category` notation.