2017-08-17 22:00:37 +05:30
|
|
|
# New CI job permissions model
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
> Introduced in GitLab 8.12.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
GitLab 8.12 has a completely redesigned [job permissions] system. You can find
|
2016-09-29 09:46:39 +05:30
|
|
|
all discussion and all our concerns when choosing the current approach in issue
|
|
|
|
[#18994](https://gitlab.com/gitlab-org/gitlab-ce/issues/18994).
|
|
|
|
|
|
|
|
---
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
Jobs permissions should be tightly integrated with the permissions of a user
|
|
|
|
who is triggering a job.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
The reasons to do it like that are:
|
|
|
|
|
|
|
|
- We already have a permissions system in place: group and project membership
|
|
|
|
of users.
|
2017-08-17 22:00:37 +05:30
|
|
|
- We already fully know who is triggering a job (using `git push`, using the
|
2016-09-29 09:46:39 +05:30
|
|
|
web UI, executing triggers).
|
|
|
|
- We already know what user is allowed to do.
|
2017-08-17 22:00:37 +05:30
|
|
|
- We use the user permissions for jobs that are triggered by the user.
|
2016-09-29 09:46:39 +05:30
|
|
|
- It opens a lot of possibilities to further enforce user permissions, like
|
|
|
|
allowing only specific users to access runners or use secure variables and
|
|
|
|
environments.
|
2017-08-17 22:00:37 +05:30
|
|
|
- It is simple and convenient that your job can access everything that you
|
2016-09-29 09:46:39 +05:30
|
|
|
as a user have access to.
|
2017-08-17 22:00:37 +05:30
|
|
|
- Short living unique tokens are now used, granting access for time of the job
|
2016-09-29 09:46:39 +05:30
|
|
|
and maximizing security.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
With the new behavior, any job that is triggered by the user, is also marked
|
2016-09-29 09:46:39 +05:30
|
|
|
with their permissions. When a user does a `git push` or changes files through
|
|
|
|
the web UI, a new pipeline will be usually created. This pipeline will be marked
|
2017-08-17 22:00:37 +05:30
|
|
|
as created be the pusher (local push or via the UI) and any job created in this
|
2016-09-29 09:46:39 +05:30
|
|
|
pipeline will have the permissions of the pusher.
|
|
|
|
|
|
|
|
This allows us to make it really easy to evaluate the access for all projects
|
2017-08-17 22:00:37 +05:30
|
|
|
that have [Git submodules][gitsub] or are using container images that the pusher
|
|
|
|
would have access too. **The permission is granted only for time that job is
|
|
|
|
running. The access is revoked after the job is finished.**
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
## Types of users
|
|
|
|
|
|
|
|
It is important to note that we have a few types of users:
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
- **Administrators**: CI jobs created by Administrators will not have access
|
2016-09-29 09:46:39 +05:30
|
|
|
to all GitLab projects, but only to projects and container images of projects
|
|
|
|
that the administrator is a member of.That means that if a project is either
|
|
|
|
public or internal users have access anyway, but if a project is private, the
|
|
|
|
Administrator will have to be a member of it in order to have access to it
|
2017-08-17 22:00:37 +05:30
|
|
|
via another project's job.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
- **External users**: CI jobs created by [external users][ext] will have
|
2016-09-29 09:46:39 +05:30
|
|
|
access only to projects to which user has at least reporter access. This
|
|
|
|
rules out accessing all internal projects by default,
|
|
|
|
|
|
|
|
This allows us to make the CI and permission system more trustworthy.
|
|
|
|
Let's consider the following scenario:
|
|
|
|
|
|
|
|
1. You are an employee of a company. Your company has a number of internal tools
|
2017-08-17 22:00:37 +05:30
|
|
|
hosted in private repositories and you have multiple CI jobs that make use
|
2016-09-29 09:46:39 +05:30
|
|
|
of these repositories.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
2. You invite a new [external user][ext]. CI jobs created by that user do not
|
2016-09-29 09:46:39 +05:30
|
|
|
have access to internal repositories, because the user also doesn't have the
|
|
|
|
access from within GitLab. You as an employee have to grant explicit access
|
|
|
|
for this user. This allows us to prevent from accidental data leakage.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
## Job token
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
A unique job token is generated for each job and it allows the user to
|
2016-09-29 09:46:39 +05:30
|
|
|
access all projects that would be normally accessible to the user creating that
|
2017-08-17 22:00:37 +05:30
|
|
|
job.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
We try to make sure that this token doesn't leak by:
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
1. Securing all API endpoints to not expose the job token.
|
|
|
|
1. Masking the job token from job logs.
|
|
|
|
1. Allowing to use the job token **only** when job is running.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
However, this brings a question about the Runners security. To make sure that
|
|
|
|
this token doesn't leak, you should also make sure that you configure
|
|
|
|
your Runners in the most possible secure way, by avoiding the following:
|
|
|
|
|
|
|
|
1. Any usage of Docker's `privileged` mode is risky if the machines are re-used.
|
2017-08-17 22:00:37 +05:30
|
|
|
1. Using the `shell` executor since jobs run on the same machine.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
By using an insecure GitLab Runner configuration, you allow the rogue developers
|
2017-08-17 22:00:37 +05:30
|
|
|
to steal the tokens of other jobs.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
## Pipeline triggers
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
Since 9.0 [pipelnie triggers][triggers] do support the new permission model.
|
|
|
|
The new triggers do impersonate their associated user including their access
|
|
|
|
to projects and their project permissions. To migrate trigger to use new permisison
|
|
|
|
model use **Take ownership**.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
## Before GitLab 8.12
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
In versions before GitLab 8.12, all CI jobs would use the CI Runner's token
|
2016-09-29 09:46:39 +05:30
|
|
|
to checkout project sources.
|
|
|
|
|
|
|
|
The project's Runner's token was a token that you could find under the
|
|
|
|
project's **Settings > CI/CD Pipelines** and was limited to access only that
|
|
|
|
project.
|
|
|
|
It could be used for registering new specific Runners assigned to the project
|
|
|
|
and to checkout project sources.
|
|
|
|
It could also be used with the GitLab Container Registry for that project,
|
2017-08-17 22:00:37 +05:30
|
|
|
allowing pulling and pushing Docker images from within the CI job.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
---
|
|
|
|
|
|
|
|
GitLab would create a special checkout URL like:
|
|
|
|
|
|
|
|
```
|
|
|
|
https://gitlab-ci-token:<project-runners-token>/gitlab.com/gitlab-org/gitlab-ce.git
|
|
|
|
```
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
And then the users could also use it in their CI jobs all Docker related
|
2016-09-29 09:46:39 +05:30
|
|
|
commands to interact with GitLab Container Registry. For example:
|
|
|
|
|
|
|
|
```
|
2017-08-17 22:00:37 +05:30
|
|
|
docker login -u gitlab-ci-token -p $CI_JOB_TOKEN registry.gitlab.com
|
2016-09-29 09:46:39 +05:30
|
|
|
```
|
|
|
|
|
|
|
|
Using single token had multiple security implications:
|
|
|
|
|
|
|
|
- The token would be readable to anyone who had developer access to a project
|
2017-08-17 22:00:37 +05:30
|
|
|
that could run CI jobs, allowing the developer to register any specific
|
2016-09-29 09:46:39 +05:30
|
|
|
Runner for that project.
|
|
|
|
- The token would allow to access only the project's sources, forbidding from
|
|
|
|
accessing any other projects.
|
|
|
|
- The token was not expiring and was multi-purpose: used for checking out sources,
|
|
|
|
for registering specific runners and for accessing a project's container
|
|
|
|
registry with read-write permissions.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
All the above led to a new permission model for jobs that was introduced
|
2016-09-29 09:46:39 +05:30
|
|
|
with GitLab 8.12.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
## Making use of the new CI job permissions model
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
With the new job permissions model, there is now an easy way to access all
|
2016-09-29 09:46:39 +05:30
|
|
|
dependent source code in a project. That way, we can:
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
1. Access a project's dependent repositories
|
|
|
|
1. Access a project's [Git submodules][gitsub]
|
2016-09-29 09:46:39 +05:30
|
|
|
1. Access private container images
|
|
|
|
1. Access project's and submodule LFS objects
|
|
|
|
|
2016-11-03 12:29:30 +05:30
|
|
|
Below you can see the prerequisites needed to make use of the new permissions
|
|
|
|
model and how that works with Git submodules and private Docker images hosted on
|
2016-09-29 09:46:39 +05:30
|
|
|
the container registry.
|
|
|
|
|
2016-11-03 12:29:30 +05:30
|
|
|
### Prerequisites to use the new permissions model
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
With the new permissions model in place, there may be times that your job will
|
2016-11-03 12:29:30 +05:30
|
|
|
fail. This is most likely because your project tries to access other project's
|
2017-08-17 22:00:37 +05:30
|
|
|
sources, and you don't have the appropriate permissions. In the job log look
|
2016-11-03 12:29:30 +05:30
|
|
|
for information about 403 or forbidden access messages.
|
|
|
|
|
|
|
|
In short here's what you need to do should you encounter any issues.
|
|
|
|
|
|
|
|
As an administrator:
|
|
|
|
|
|
|
|
- **500 errors**: You will need to update [GitLab Workhorse][workhorse] to at
|
|
|
|
least 0.8.2. This is done automatically for Omnibus installations, you need to
|
|
|
|
[check manually][update-docs] for installations from source.
|
|
|
|
- **500 errors**: Check if you have another web proxy sitting in front of NGINX (HAProxy,
|
|
|
|
Apache, etc.). It might be a good idea to let GitLab use the internal NGINX
|
|
|
|
web server and not disable it completely. See [this comment][comment] for an
|
|
|
|
example.
|
|
|
|
- **403 errors**: You need to make sure that your installation has [HTTP(S)
|
|
|
|
cloning enabled][https]. HTTP(S) support is now a **requirement** by GitLab CI
|
|
|
|
to clone all sources.
|
|
|
|
|
|
|
|
As a user:
|
|
|
|
|
|
|
|
- Make sure you are a member of the group or project you're trying to have
|
|
|
|
access to. As an Administrator, you can verify that by impersonating the user
|
2017-08-17 22:00:37 +05:30
|
|
|
and retry the failing job in order to verify that everything is correct.
|
2016-11-03 12:29:30 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
### Dependent repositories
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
The [Job environment variable][jobenv] `CI_JOB_TOKEN` can be used to
|
|
|
|
authenticate any clones of dependent repositories. For example:
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
```
|
2017-08-17 22:00:37 +05:30
|
|
|
git clone https://gitlab-ci-token:${CI_JOB_TOKEN}@gitlab.com/myuser/mydependentrepo
|
2016-09-29 09:46:39 +05:30
|
|
|
```
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
It can also be used for system-wide authentication
|
|
|
|
(only do this in a docker container, it will overwrite ~/.netrc):
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
```
|
2017-08-17 22:00:37 +05:30
|
|
|
echo -e "machine gitlab.com\nlogin gitlab-ci-token\npassword ${CI_JOB_TOKEN}" > ~/.netrc
|
2016-09-29 09:46:39 +05:30
|
|
|
```
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
### Git submodules
|
2016-09-29 09:46:39 +05:30
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
To properly configure submodules with GitLab CI, read the
|
|
|
|
[Git submodules documentation][gitsub].
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
### Container Registry
|
|
|
|
|
|
|
|
With the update permission model we also extended the support for accessing
|
|
|
|
Container Registries for private projects.
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
> **Notes:**
|
|
|
|
- GitLab Runner versions prior to 1.8 don't incorporate the introduced changes
|
|
|
|
for permissions. This makes the `image:` directive to not work with private
|
|
|
|
projects automatically and it needs to be configured manually on Runner's host
|
|
|
|
with a predefined account (for example administrator's personal account with
|
|
|
|
access token created explicitly for this purpose). This issue is resolved with
|
|
|
|
latest changes in GitLab Runner 1.8 which receives GitLab credentials with
|
|
|
|
build data.
|
|
|
|
- Starting with GitLab 8.12, if you have 2FA enabled in your account, you need
|
|
|
|
to pass a personal access token instead of your password in order to login to
|
|
|
|
GitLab's Container Registry.
|
|
|
|
|
|
|
|
Your jobs can access all container images that you would normally have access
|
2016-09-29 09:46:39 +05:30
|
|
|
to. The only implication is that you can push to the Container Registry of the
|
2017-08-17 22:00:37 +05:30
|
|
|
project for which the job is triggered.
|
2016-09-29 09:46:39 +05:30
|
|
|
|
|
|
|
This is how an example usage can look like:
|
|
|
|
|
|
|
|
```
|
|
|
|
test:
|
|
|
|
script:
|
2017-08-17 22:00:37 +05:30
|
|
|
- docker login -u gitlab-ci-token -p $CI_JOB_TOKEN $CI_REGISTRY
|
2016-09-29 09:46:39 +05:30
|
|
|
- docker pull $CI_REGISTRY/group/other-project:latest
|
|
|
|
- docker run $CI_REGISTRY/group/other-project:latest
|
|
|
|
```
|
|
|
|
|
2017-08-17 22:00:37 +05:30
|
|
|
[job permissions]: ../permissions.md#jobs-permissions
|
2016-11-03 12:29:30 +05:30
|
|
|
[comment]: https://gitlab.com/gitlab-org/gitlab-ce/issues/22484#note_16648302
|
2016-09-29 09:46:39 +05:30
|
|
|
[ext]: ../permissions.md#external-users
|
2017-08-17 22:00:37 +05:30
|
|
|
[gitsub]: ../../ci/git_submodules.md
|
2016-11-03 12:29:30 +05:30
|
|
|
[https]: ../admin_area/settings/visibility_and_access_controls.md#enabled-git-access-protocols
|
2016-09-29 09:46:39 +05:30
|
|
|
[triggers]: ../../ci/triggers/README.md
|
2016-11-03 12:29:30 +05:30
|
|
|
[update-docs]: https://gitlab.com/gitlab-org/gitlab-ce/tree/master/doc/update
|
|
|
|
[workhorse]: https://gitlab.com/gitlab-org/gitlab-workhorse
|
2017-08-17 22:00:37 +05:30
|
|
|
[jobenv]: ../../ci/variables/README.md#predefined-variables-environment-variables
|