debian-mirror-gitlab/doc/user/application_security/policies/scan-execution-policies.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

252 lines
14 KiB
Markdown
Raw Normal View History

2022-04-04 11:22:00 +05:30
---
2022-10-11 01:57:18 +05:30
stage: Govern
group: Security Policies
2022-11-25 23:54:43 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments
2022-04-04 11:22:00 +05:30
---
# Scan execution policies **(ULTIMATE)**
2022-10-11 01:57:18 +05:30
> - Group-level security policies were [introduced](https://gitlab.com/groups/gitlab-org/-/epics/4425) in GitLab 15.2.
> - Group-level security policies were [enabled on GitLab.com](https://gitlab.com/gitlab-org/gitlab/-/issues/356258) in GitLab 15.4.
2023-03-04 22:38:38 +05:30
> - Operational container scanning [introduced](https://gitlab.com/groups/gitlab-org/-/epics/3410) in GitLab 15.5
2022-08-13 15:12:31 +05:30
2022-11-25 23:54:43 +05:30
Group, subgroup, or project owners can use scan execution policies to require that security scans run on a specified
2023-04-23 21:23:45 +05:30
schedule or with the project pipeline. The security scan runs with multiple project pipelines if you define the policy
at a group or subgroup level. GitLab injects the required scans into the CI pipeline as new jobs. In the event
of a job name collision, GitLab adds a dash and a number to the job name. GitLab increments the number until the name
no longer conflicts with existing job names. If you create a policy at the group level, it applies to every child project
or subgroup. You cannot edit a group-level policy from a child project or subgroup.
2022-04-04 11:22:00 +05:30
2023-04-23 21:23:45 +05:30
This feature has some overlap with [compliance framework pipelines](../../group/compliance_frameworks.md#compliance-pipelines),
2022-04-04 11:22:00 +05:30
as we have not [unified the user experience for these two features](https://gitlab.com/groups/gitlab-org/-/epics/7312).
For details on the similarities and differences between these features, see
2022-10-11 01:57:18 +05:30
[Enforce scan execution](../index.md#enforce-scan-execution).
2022-04-04 11:22:00 +05:30
2022-05-07 20:08:51 +05:30
NOTE:
2023-04-23 21:23:45 +05:30
Policy jobs for scans other than DAST scans are created in the `test` stage of the pipeline. If you modify the default pipeline
2022-05-07 20:08:51 +05:30
[`stages`](../../../ci/yaml/index.md#stages),
2023-04-23 21:23:45 +05:30
to remove the `test` stage, jobs will run in the `scan-policies` stage instead. This stage is injected into the CI pipeline at evaluation time if it doesn't exist. If the `build` stage exists, it is injected just after the `build` stage. If the `build` stage does not exist, it is injected at the beginning of the pipeline. DAST scans always run in the `dast` stage. If this stage does not exist, then a `dast` stage is injected at the end of the pipeline.
2022-05-07 20:08:51 +05:30
2022-04-04 11:22:00 +05:30
## Scan execution policy editor
NOTE:
2022-11-25 23:54:43 +05:30
Only group, subgroup, or project Owners have the [permissions](../../permissions.md#project-members-permissions)
2022-04-04 11:22:00 +05:30
to select Security Policy Project.
Once your policy is complete, save it by selecting **Create via merge request**
at the bottom of the editor. You are redirected to the merge request on the project's
configured security policy project. If one does not link to your project, a security
policy project is automatically created. Existing policies can also be
removed from the editor interface by selecting **Delete policy**
at the bottom of the editor.
2022-07-16 23:28:13 +05:30
Most policy changes take effect as soon as the merge request is merged. Any changes that
do not go through a merge request and are committed directly to the default branch may require up to 10 minutes
before the policy changes take effect.
2022-04-04 11:22:00 +05:30
2022-11-25 23:54:43 +05:30
![Scan Execution Policy Editor Rule Mode](img/scan_execution_policy_rule_mode_v15_5.png)
2022-04-04 11:22:00 +05:30
## Scan execution policies schema
The YAML file with scan execution policies consists of an array of objects matching scan execution
policy schema nested under the `scan_execution_policy` key. You can configure a maximum of 5
2022-07-23 23:45:48 +05:30
policies under the `scan_execution_policy` key. Any other policies configured after
the first 5 are not applied.
2022-04-04 11:22:00 +05:30
When you save a new policy, GitLab validates its contents against [this JSON schema](https://gitlab.com/gitlab-org/gitlab/-/blob/master/ee/app/validators/json_schemas/security_orchestration_policy.json).
If you're not familiar with how to read [JSON schemas](https://json-schema.org/),
the following sections and tables provide an alternative.
| Field | Type | Possible values | Description |
|-------|------|-----------------|-------------|
| `scan_execution_policy` | `array` of scan execution policy | | List of scan execution policies (maximum 5) |
## Scan execution policy schema
| Field | Type | Possible values | Description |
|-------|------|-----------------|-------------|
2022-08-13 15:12:31 +05:30
| `name` | `string` | | Name of the policy. Maximum of 255 characters.|
2022-04-04 11:22:00 +05:30
| `description` (optional) | `string` | | Description of the policy. |
| `enabled` | `boolean` | `true`, `false` | Flag to enable (`true`) or disable (`false`) the policy. |
| `rules` | `array` of rules | | List of rules that the policy applies. |
| `actions` | `array` of actions | | List of actions that the policy enforces. |
## `pipeline` rule type
This rule enforces the defined actions whenever the pipeline runs for a selected branch.
| Field | Type | Possible values | Description |
|-------|------|-----------------|-------------|
| `type` | `string` | `pipeline` | The rule's type. |
| `branches` | `array` of `string` | `*` or the branch's name | The branch the given policy applies to (supports wildcard). |
## `schedule` rule type
This rule enforces the defined actions and schedules a scan on the provided date/time.
| Field | Type | Possible values | Description |
|------------|------|-----------------|-------------|
| `type` | `string` | `schedule` | The rule's type. |
2023-03-04 22:38:38 +05:30
| `branches` | `array` of `string` | `*` or the branch's name | The branch the given policy applies to (supports wildcard). This field is required if the `agents` field is not set. |
2022-10-11 01:57:18 +05:30
| `cadence` | `string` | CRON expression (for example, `0 0 * * *`) | A whitespace-separated string containing five fields that represents the scheduled time. |
2023-04-23 21:23:45 +05:30
| `agents` | `object` | | The name of the [GitLab agents](../../clusters/agent/index.md) where [Operational Container Scanning](../../clusters/agent/vulnerabilities.md) runs. The object key is the name of the Kubernetes agent configured for your project in GitLab. This field is required if the `branches` field is not set. |
2022-04-04 11:22:00 +05:30
2022-07-16 23:28:13 +05:30
GitLab supports the following types of CRON syntax for the `cadence` field:
- A daily cadence of once per hour at a specified hour, for example: `0 18 * * *`
- A weekly cadence of once per week on a specified day and at a specified hour, for example: `0 13 * * 0`
2023-03-04 22:38:38 +05:30
NOTE:
2023-04-23 21:23:45 +05:30
Other elements of the [CRON syntax](https://docs.oracle.com/cd/E12058_01/doc/doc.1014/e12030/cron_expressions.htm) may work in the cadence field if supported by the [cron](https://github.com/robfig/cron) we are using in our implementation, however, GitLab does not officially test or support them.
2023-03-04 22:38:38 +05:30
NOTE:
2023-04-23 21:23:45 +05:30
If using the `agents` field, required for `Operational Container Scanning`, the CRON expression is evaluated in [UTC](https://www.timeanddate.com/worldclock/timezone/utc) using the system-time of the Kubernetes-agent pod. If not using the `agents` field, the CRON expression is evaluated in standard [UTC](https://www.timeanddate.com/worldclock/timezone/utc) time from GitLab.com. If you have a self-managed GitLab instance and have [changed the server time zone](../../../administration/timezone.md), the CRON expression is evaluated with the new time zone.
2022-11-25 23:54:43 +05:30
### `agent` schema
Use this schema to define `agents` objects in the [`schedule` rule type](#schedule-rule-type).
| Field | Type | Possible values | Description |
|--------------|---------------------|--------------------------|-------------|
2023-04-23 21:23:45 +05:30
| `namespaces` | `array` of `string` | | The namespace that is scanned. If empty, all namespaces are scanned. |
2022-11-25 23:54:43 +05:30
#### Policy example
```yaml
2023-03-04 22:38:38 +05:30
- name: Enforce Container Scanning in cluster connected through my-gitlab-agent for default and kube-system namespaces
2022-11-25 23:54:43 +05:30
enabled: true
rules:
- type: schedule
cadence: '0 10 * * *'
agents:
2023-03-04 22:38:38 +05:30
<agent-name>:
2022-11-25 23:54:43 +05:30
namespaces:
2023-03-04 22:38:38 +05:30
- 'default'
- 'kube-system'
2022-11-25 23:54:43 +05:30
actions:
- scan: container_scanning
```
2022-07-16 23:28:13 +05:30
2023-03-04 22:38:38 +05:30
The keys for a schedule rule are:
2023-04-23 21:23:45 +05:30
- `cadence` (required): a [CRON expression](https://docs.oracle.com/cd/E12058_01/doc/doc.1014/e12030/cron_expressions.htm) for when the scans are run
2023-03-04 22:38:38 +05:30
- `agents:<agent-name>` (required): The name of the agent to use for scanning
2023-04-23 21:23:45 +05:30
- `agents:<agent-name>:namespaces` (optional): The Kubernetes namespaces to scan. If omitted, all namespaces are scanned.
2023-03-04 22:38:38 +05:30
2022-04-04 11:22:00 +05:30
## `scan` action type
This action executes the selected `scan` with additional parameters when conditions for at least one
rule in the defined policy are met.
| Field | Type | Possible values | Description |
|-------|------|-----------------|-------------|
2023-01-13 00:05:48 +05:30
| `scan` | `string` | `dast`, `secret_detection`, `sast`, `container_scanning`, `dependency_scanning` | The action's type. |
| `site_profile` | `string` | Name of the selected [DAST site profile](../dast/proxy-based.md#site-profile). | The DAST site profile to execute the DAST scan. This field should only be set if `scan` type is `dast`. |
| `scanner_profile` | `string` or `null` | Name of the selected [DAST scanner profile](../dast/proxy-based.md#scanner-profile). | The DAST scanner profile to execute the DAST scan. This field should only be set if `scan` type is `dast`.|
2022-04-04 11:22:00 +05:30
| `variables` | `object` | | A set of CI variables, supplied as an array of `key: value` pairs, to apply and enforce for the selected scan. The `key` is the variable name, with its `value` provided as a string. This parameter supports any variable that the GitLab CI job supports for the specified scan. |
2023-04-23 21:23:45 +05:30
| `tags` | `array` of `string` | | A list of runner tags for the policy. The policy jobs are run by runner with the specified tags. |
2022-04-04 11:22:00 +05:30
Note the following:
2023-01-13 00:05:48 +05:30
- You must create the [site profile](../dast/proxy-based.md#site-profile) and [scanner profile](../dast/proxy-based.md#scanner-profile)
2022-04-04 11:22:00 +05:30
with selected names for each project that is assigned to the selected Security Policy Project.
Otherwise, the policy is not applied and a job with an error message is created instead.
- Once you associate the site profile and scanner profile by name in the policy, it is not possible
to modify or delete them. If you want to modify them, you must first disable the policy by setting
the `active` flag to `false`.
- When configuring policies with a scheduled DAST scan, the author of the commit in the security
policy project's repository must have access to the scanner and site profiles. Otherwise, the scan
is not scheduled successfully.
- For a secret detection scan, only rules with the default ruleset are supported. [Custom rulesets](../secret_detection/index.md#custom-rulesets)
are not supported.
- A secret detection scan runs in `normal` mode when executed as part of a pipeline, and in
[`historic`](../secret_detection/index.md#full-history-secret-detection)
mode when executed as part of a scheduled scan.
2022-11-25 23:54:43 +05:30
- A container scanning scan that is configured for the `pipeline` rule type ignores the agent defined in the `agents` object. The `agents` object is only considered for `schedule` rule types.
An agent with a name provided in the `agents` object must be created and configured for the project.
2022-04-04 11:22:00 +05:30
## Example security policies project
2022-06-21 17:19:12 +05:30
You can use this example in a `.gitlab/security-policies/policy.yml` file stored in a
[security policy project](index.md#security-policy-project):
2022-04-04 11:22:00 +05:30
```yaml
---
scan_execution_policy:
- name: Enforce DAST in every release pipeline
description: This policy enforces pipeline configuration to have a job with DAST scan for release branches
enabled: true
rules:
- type: pipeline
branches:
- release/*
actions:
- scan: dast
scanner_profile: Scanner Profile A
site_profile: Site Profile B
- name: Enforce DAST and secret detection scans every 10 minutes
description: This policy enforces DAST and secret detection scans to run every 10 minutes
enabled: true
rules:
- type: schedule
branches:
- main
cadence: "*/10 * * * *"
actions:
- scan: dast
scanner_profile: Scanner Profile C
site_profile: Site Profile D
- scan: secret_detection
- name: Enforce Secret Detection and Container Scanning in every default branch pipeline
description: This policy enforces pipeline configuration to have a job with Secret Detection and Container Scanning scans for the default branch
enabled: true
rules:
- type: pipeline
branches:
- main
actions:
- scan: secret_detection
- scan: sast
variables:
SAST_EXCLUDED_ANALYZERS: brakeman
- scan: container_scanning
```
In this example:
- For every pipeline executed on branches that match the `release/*` wildcard (for example, branch
`release/v1.2.1`), DAST scans run with `Scanner Profile A` and `Site Profile B`.
- DAST and secret detection scans run every 10 minutes. The DAST scan runs with `Scanner Profile C`
and `Site Profile D`.
- Secret detection, container scanning, and SAST scans run for every pipeline executed on the `main`
branch. The SAST scan runs with the `SAST_EXCLUDED_ANALYZER` variable set to `"brakeman"`.
## Example for scan execution policy editor
You can use this example in the YAML mode of the [scan execution policy editor](#scan-execution-policy-editor).
It corresponds to a single object from the previous example.
```yaml
name: Enforce Secret Detection and Container Scanning in every default branch pipeline
description: This policy enforces pipeline configuration to have a job with Secret Detection and Container Scanning scans for the default branch
enabled: true
rules:
- type: pipeline
branches:
- main
actions:
- scan: secret_detection
- scan: container_scanning
```
2023-04-23 21:23:45 +05:30
## Avoiding duplicate scans
Scan execution policies can cause the same type of scanner to run more than once if developers include scan jobs in the project's
`.gitlab-ci.yml` file. This behavior is intentional as scanners can run more than once with different variables and settings. For example, a
developer may want to try running a SAST scan with different variables than the one enforced by the security and compliance team. In
this case, two SAST jobs run in the pipeline, one with the developer's variables and one with the security and compliance team's variables.
If you want to avoid running duplicate scans, you can either remove the scans from the project's `.gitlab-ci.yml` file or disable your
local jobs by setting `SAST_DISABLED: true`. Disabling jobs this way does not prevent the security jobs defined by scan execution
policies from running.