debian-mirror-gitlab/doc/ci/yaml/includes.md

408 lines
12 KiB
Markdown
Raw Normal View History

2020-06-23 00:09:42 +05:30
---
stage: Verify
2021-11-11 11:23:49 +05:30
group: Pipeline Authoring
2022-11-25 23:54:43 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments
2020-06-23 00:09:42 +05:30
type: reference
---
2021-09-30 23:02:18 +05:30
# GitLab CI/CD include examples **(FREE)**
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
You can use [`include`](index.md#include) to include external YAML files in your CI/CD jobs.
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
## Include a single configuration file
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
To include a single configuration file, use either of these syntax options:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
- `include` by itself with a single file, which is the same as
[`include:local`](index.md#includelocal):
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
```yaml
include: '/templates/.after-script-template.yml'
```
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
- `include` with a single file, and you specify the `include` type:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
```yaml
include:
remote: 'https://gitlab.com/awesome-project/raw/main/.before-script-template.yml'
```
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
## Include an array of configuration files
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
You can include an array of configuration files:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
- If you do not specify an `include` type, the type defaults to [`include:local`](index.md#includelocal):
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
```yaml
include:
- 'https://gitlab.com/awesome-project/raw/main/.before-script-template.yml'
- '/templates/.after-script-template.yml'
```
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
- You can define a single item array:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
```yaml
include:
- remote: 'https://gitlab.com/awesome-project/raw/main/.before-script-template.yml'
```
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
- You can define an array and explicitly specify multiple `include` types:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
```yaml
include:
- remote: 'https://gitlab.com/awesome-project/raw/main/.before-script-template.yml'
- local: '/templates/.after-script-template.yml'
- template: Auto-DevOps.gitlab-ci.yml
```
- You can define an array that combines both default and specific `include` type:
```yaml
include:
- 'https://gitlab.com/awesome-project/raw/main/.before-script-template.yml'
- '/templates/.after-script-template.yml'
- template: Auto-DevOps.gitlab-ci.yml
- project: 'my-group/my-project'
ref: main
file: '/templates/.gitlab-ci-template.yml'
```
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
## Use `default` configuration from an included configuration file
2020-05-24 23:13:21 +05:30
2021-12-11 22:18:48 +05:30
You can define a [`default`](index.md#default) section in a
2021-11-11 11:23:49 +05:30
configuration file. When you use a `default` section with the `include` keyword, the defaults apply to
all jobs in the pipeline.
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
For example, you can use a `default` section with [`before_script`](index.md#before_script).
Content of a custom configuration file named `/templates/.before-script-template.yml`:
2020-05-24 23:13:21 +05:30
```yaml
2021-01-03 14:25:43 +05:30
default:
before_script:
- apt-get update -qq && apt-get install -y -qq sqlite3 libsqlite3-dev nodejs
- gem install bundler --no-document
- bundle install --jobs $(nproc) "${FLAGS[@]}"
2020-05-24 23:13:21 +05:30
```
Content of `.gitlab-ci.yml`:
```yaml
2021-11-11 11:23:49 +05:30
include: '/templates/.before-script-template.yml'
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
rspec1:
script:
- bundle exec rspec
rspec2:
2020-05-24 23:13:21 +05:30
script:
- bundle exec rspec
```
2021-11-11 11:23:49 +05:30
The default `before_script` commands execute in both `rspec` jobs, before the `script` commands.
## Override included configuration values
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
When you use the `include` keyword, you can override the included configuration values to adapt them
to your pipeline requirements.
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
The following example shows an `include` file that is customized in the
`.gitlab-ci.yml` file. Specific YAML-defined variables and details of the
`production` job are overridden.
Content of a custom configuration file named `autodevops-template.yml`:
2020-05-24 23:13:21 +05:30
```yaml
variables:
POSTGRES_USER: user
POSTGRES_PASSWORD: testing_password
POSTGRES_DB: $CI_ENVIRONMENT_SLUG
production:
stage: production
script:
- install_dependencies
- deploy
environment:
name: production
url: https://$CI_PROJECT_PATH_SLUG.$KUBE_INGRESS_BASE_DOMAIN
2021-09-04 01:27:46 +05:30
rules:
- if: $CI_COMMIT_BRANCH == $CI_DEFAULT_BRANCH
2020-05-24 23:13:21 +05:30
```
Content of `.gitlab-ci.yml`:
```yaml
include: 'https://company.com/autodevops-template.yml'
image: alpine:latest
variables:
POSTGRES_USER: root
POSTGRES_PASSWORD: secure_password
stages:
- build
- test
- production
production:
environment:
url: https://domain.com
```
2021-11-11 11:23:49 +05:30
The `POSTGRES_USER` and `POSTGRES_PASSWORD` variables
and the `environment:url` of the `production` job defined in the `.gitlab-ci.yml` file
override the values defined in the `autodevops-template.yml` file. The other keywords
do not change. This method is called *merging*.
## Override included configuration arrays
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
You can use merging to extend and override configuration in an included template, but
you cannot add or modify individual items in an array. For example, to add
an additional `notify_owner` command to the extended `production` job's `script` array:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
Content of `autodevops-template.yml`:
2020-05-24 23:13:21 +05:30
```yaml
production:
stage: production
script:
- install_dependencies
- deploy
```
Content of `.gitlab-ci.yml`:
```yaml
2021-11-11 11:23:49 +05:30
include: 'autodevops-template.yml'
2020-05-24 23:13:21 +05:30
stages:
- production
production:
script:
- install_dependencies
- deploy
- notify_owner
```
2021-11-11 11:23:49 +05:30
If `install_dependencies` and `deploy` are not repeated in
the `.gitlab-ci.yml` file, the `production` job would have only `notify_owner` in the script.
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
## Use nested includes
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
You can nest `include` sections in configuration files that are then included
in another configuration. For example, for `include` keywords nested three deep:
2020-05-24 23:13:21 +05:30
2021-11-11 11:23:49 +05:30
Content of `.gitlab-ci.yml`:
2020-05-24 23:13:21 +05:30
```yaml
include:
- local: /.gitlab-ci/another-config.yml
```
2021-11-11 11:23:49 +05:30
Content of `/.gitlab-ci/another-config.yml`:
2020-05-24 23:13:21 +05:30
```yaml
include:
2021-11-11 11:23:49 +05:30
- local: /.gitlab-ci/config-defaults.yml
2020-05-24 23:13:21 +05:30
```
2021-11-11 11:23:49 +05:30
Content of `/.gitlab-ci/config-defaults.yml`:
2020-05-24 23:13:21 +05:30
```yaml
2021-11-11 11:23:49 +05:30
default:
after_script:
- echo "Job complete."
2020-05-24 23:13:21 +05:30
```
2021-12-11 22:18:48 +05:30
2022-04-04 11:22:00 +05:30
### Use nested includes with duplicate `includes` entries
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/28987) in GitLab 14.8
Nested includes can include the same configuration file. The duplicate configuration
file is included multiple times, but the effect is the same as if it was only
included once.
For example, with the following nested includes, where `defaults.gitlab-ci.yml`
is included multiple times:
- Contents of the `.gitlab-ci.yml` file:
```yaml
include:
- template: defaults.gitlab-ci.yml
- local: unit-tests.gitlab-ci.yml
- local: smoke-tests.gitlab-ci.yml
```
- Contents of the `defaults.gitlab-ci.yml` file:
```yaml
default:
before_script: default-before-script.sh
retry: 2
```
- Contents of the `unit-tests.gitlab-ci.yml` file:
```yaml
include:
- template: defaults.gitlab-ci.yml
unit-test-job:
script: unit-test.sh
retry: 0
```
- Contents of the `smoke-tests.gitlab-ci.yml` file:
```yaml
include:
- template: defaults.gitlab-ci.yml
smoke-test-job:
script: smoke-test.sh
```
The final configuration would be:
```yaml
unit-test-job:
before_script: default-before-script.sh
script: unit-test.sh
retry: 0
smoke-test-job:
before_script: default-before-script.sh
script: smoke-test.sh
retry: 2
```
2021-12-11 22:18:48 +05:30
## Use variables with `include`
> - [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/284883) in GitLab 13.8.
> - [Feature flag removed](https://gitlab.com/gitlab-org/gitlab/-/issues/294294) in GitLab 13.9.
> - [Support for project, group, and instance variables added](https://gitlab.com/gitlab-org/gitlab/-/issues/219065) in GitLab 14.2.
> - [Support for pipeline variables added](https://gitlab.com/gitlab-org/gitlab/-/issues/337633) in GitLab 14.5.
In `include` sections in your `.gitlab-ci.yml` file, you can use:
2022-08-27 11:52:29 +05:30
- [Project variables](../variables/index.md#add-a-cicd-variable-to-a-project).
- [Group variables](../variables/index.md#add-a-cicd-variable-to-a-group).
- [Instance variables](../variables/index.md#add-a-cicd-variable-to-an-instance).
- Project [predefined variables](../variables/predefined_variables.md).
2021-12-11 22:18:48 +05:30
- In GitLab 14.2 and later, the `$CI_COMMIT_REF_NAME` [predefined variable](../variables/predefined_variables.md).
When used in `include`, the `CI_COMMIT_REF_NAME` variable returns the full
ref path, like `refs/heads/branch-name`. In `include:rules`, you might need to use
`if: $CI_COMMIT_REF_NAME =~ /main/` (not `== main`). This behavior is resolved in GitLab 14.5.
In GitLab 14.5 and later, you can also use:
2022-01-26 12:08:38 +05:30
- [Trigger variables](../triggers/index.md#pass-cicd-variables-in-the-api-call).
2022-05-07 20:08:51 +05:30
- [Scheduled pipeline variables](../pipelines/schedules.md#add-a-pipeline-schedule).
2021-12-11 22:18:48 +05:30
- [Manual pipeline run variables](../variables/index.md#override-a-variable-when-running-a-pipeline-manually).
- Pipeline [predefined variables](../variables/predefined_variables.md).
YAML files are parsed before the pipeline is created, so the following pipeline predefined variables
are **not** available:
- `CI_PIPELINE_ID`
- `CI_PIPELINE_URL`
- `CI_PIPELINE_IID`
- `CI_PIPELINE_CREATED_AT`
For example:
```yaml
include:
project: '$CI_PROJECT_PATH'
file: '.compliance-gitlab-ci.yml'
```
2022-08-27 11:52:29 +05:30
You cannot use variables defined in jobs, or in a global [`variables`](../yaml/index.md#variables)
section which defines the default variables for all jobs. Includes are evaluated before jobs,
so these variables cannot be used with `include`.
For an example of how you can include predefined variables, and the variables' impact on CI/CD jobs,
2021-12-11 22:18:48 +05:30
see this [CI/CD variable demo](https://youtu.be/4XR8gw3Pkos).
## Use `rules` with `include`
> - Introduced in GitLab 14.2 [with a flag](../../administration/feature_flags.md) named `ci_include_rules`. Disabled by default.
> - [Enabled on GitLab.com](https://gitlab.com/gitlab-org/gitlab/-/issues/337507) in GitLab 14.3.
> - [Enabled on self-managed](https://gitlab.com/gitlab-org/gitlab/-/issues/337507) GitLab 14.3.
> - [Feature flag `ci_include_rules` removed](https://gitlab.com/gitlab-org/gitlab/-/issues/337507) in GitLab 14.4.
> - [Generally available](https://gitlab.com/gitlab-org/gitlab/-/issues/337507) in GitLab 14.4.
> - [Support for `exists` keyword added](https://gitlab.com/gitlab-org/gitlab/-/issues/341511) in GitLab 14.5.
You can use [`rules`](index.md#rules) with `include` to conditionally include other configuration files.
You can only use the following rules with `include` (and only with [certain variables](#use-variables-with-include)):
- [`if` rules](index.md#rulesif). For example:
```yaml
include:
- local: builds.yml
rules:
2022-07-16 23:28:13 +05:30
- if: $INCLUDE_BUILDS == "true"
2021-12-11 22:18:48 +05:30
- local: deploys.yml
rules:
- if: $CI_COMMIT_BRANCH == "main"
test:
stage: test
script: exit 0
```
- [`exists` rules](index.md#rulesexists). For example:
```yaml
include:
- local: builds.yml
rules:
- exists:
- file.md
test:
stage: test
script: exit 0
```
`rules` keyword `changes` is not supported.
2022-05-07 20:08:51 +05:30
You cannot use [`needs:`](index.md#needs) to create a job dependency that points to
a job added with `include:local:rules`. When the configuration is checked for validity,
GitLab returns `undefined need: <job-name>`. An [issue exists](https://gitlab.com/gitlab-org/gitlab/-/issues/345377)
to improve this behavior.
2021-12-11 22:18:48 +05:30
## Use `include:local` with wildcard file paths
> - [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/25921) in GitLab 13.11.
> - [Feature flag removed](https://gitlab.com/gitlab-org/gitlab/-/issues/327315) in GitLab 14.2.
You can use wildcard paths (`*` and `**`) with `include:local`.
Example:
```yaml
include: 'configs/*.yml'
```
When the pipeline runs, GitLab:
- Adds all `.yml` files in the `configs` directory into the pipeline configuration.
- Does not add `.yml` files in subfolders of the `configs` directory. To allow this,
add the following configuration:
```yaml
# This matches all `.yml` files in `configs` and any subfolder in it.
include: 'configs/**.yml'
# This matches all `.yml` files only in subfolders of `configs`.
include: 'configs/**/*.yml'
```