debian-mirror-gitlab/doc/integration/jenkins.md

247 lines
11 KiB
Markdown
Raw Normal View History

2021-01-29 00:20:46 +05:30
---
2021-10-27 15:23:28 +05:30
stage: Ecosystem
group: Integrations
2021-02-22 17:27:13 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#assignments
2021-01-29 00:20:46 +05:30
---
2021-03-11 19:13:27 +05:30
# Jenkins CI service **(FREE)**
2019-07-31 22:56:46 +05:30
2021-03-11 19:13:27 +05:30
> [Moved](https://gitlab.com/gitlab-org/gitlab/-/issues/246756) to GitLab Free in 13.7.
2020-05-24 23:13:21 +05:30
From GitLab, you can trigger a Jenkins build when you push code to a repository, or when a merge
2020-10-24 23:57:45 +05:30
request is created. In return, the Jenkins pipeline status is shown on merge requests widgets and
2020-05-24 23:13:21 +05:30
on the GitLab project's home page.
2021-02-22 17:27:13 +05:30
To better understand the GitLab Jenkins integration, watch the following video:
2020-05-24 23:13:21 +05:30
- [GitLab workflow with Jira issues and Jenkins pipelines](https://youtu.be/Jn-_fyra7xQ)
2021-02-22 17:27:13 +05:30
2020-05-24 23:13:21 +05:30
Use the Jenkins integration with GitLab when:
2021-09-30 23:02:18 +05:30
- You plan to migrate your CI from Jenkins to [GitLab CI/CD](../ci/index.md) in the future, but
2020-05-24 23:13:21 +05:30
need an interim solution.
- You're invested in [Jenkins Plugins](https://plugins.jenkins.io/) and choose to keep using Jenkins
to build your apps.
2019-07-31 22:56:46 +05:30
2019-12-21 20:55:43 +05:30
For a real use case, read the blog post [Continuous integration: From Jenkins to GitLab using Docker](https://about.gitlab.com/blog/2017/07/27/docker-my-precious/).
2019-09-04 21:01:54 +05:30
2020-05-24 23:13:21 +05:30
Moving from a traditional CI plug-in to a single application for the entire software development
life cycle can decrease hours spent on maintaining toolchains by 10% or more. For more details, see
2021-02-22 17:27:13 +05:30
the ['GitLab vs. Jenkins' comparison page](https://about.gitlab.com/devops-tools/jenkins-vs-gitlab/).
NOTE:
This documentation focuses only on how to **configure** a Jenkins *integration* with
2021-04-17 20:07:23 +05:30
GitLab. Learn how to set up Jenkins [on your local machine](../development/integrations/jenkins.md)
in our developer documentation, and how to **migrate** from Jenkins to GitLab CI/CD in our
2021-02-22 17:27:13 +05:30
[Migrating from Jenkins](../ci/migration/jenkins.md) documentation.
2019-10-12 21:52:04 +05:30
2020-05-24 23:13:21 +05:30
## Configure GitLab integration with Jenkins
2019-07-31 22:56:46 +05:30
2021-02-22 17:27:13 +05:30
The GitLab Jenkins integration requires installation and configuration in both GitLab and Jenkins.
2020-05-24 23:13:21 +05:30
In GitLab, you need to grant Jenkins access to the relevant projects. In Jenkins, you need to
install and configure several plugins.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
### GitLab requirements
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
- [Grant Jenkins permission to GitLab project](#grant-jenkins-access-to-gitlab-project)
- [Configure GitLab API access](#configure-gitlab-api-access)
- [Configure the GitLab project](#configure-the-gitlab-project)
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
### Jenkins requirements
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
- [Configure the Jenkins server](#configure-the-jenkins-server)
- [Configure the Jenkins project](#configure-the-jenkins-project)
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
## Grant Jenkins access to GitLab project
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
Grant a GitLab user access to the select GitLab projects.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
1. Create a new GitLab user, or choose an existing GitLab user.
2019-07-31 22:56:46 +05:30
2021-02-22 17:27:13 +05:30
This account is used by Jenkins to access the GitLab projects. We recommend creating a GitLab
2020-05-24 23:13:21 +05:30
user for only this purpose. If you use a person's account, and their account is deactivated or
2021-02-22 17:27:13 +05:30
deleted, the GitLab-Jenkins integration stops working.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
1. Grant the user permission to the GitLab projects.
2019-07-31 22:56:46 +05:30
2021-11-18 22:05:49 +05:30
If you're integrating Jenkins with many GitLab projects, consider granting the user the global
Administrator role. Otherwise, add the user to each project, and grant the Developer role.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
## Configure GitLab API access
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
Create a personal access token to authorize Jenkins' access to GitLab.
2019-07-31 22:56:46 +05:30
2021-03-11 19:13:27 +05:30
1. Sign in to GitLab as the user to be used with Jenkins.
1. In the top-right corner, select your avatar.
1. Select **Edit profile**.
2021-11-11 11:23:49 +05:30
1. On the left sidebar, select **Access Tokens**.
2020-05-24 23:13:21 +05:30
1. Create a personal access token with the **API** scope checkbox checked. For more details, see
[Personal access tokens](../user/profile/personal_access_tokens.md).
2021-02-22 17:27:13 +05:30
1. Record the personal access token's value, because it's required in [Configure the Jenkins server](#configure-the-jenkins-server) section.
2020-05-24 23:13:21 +05:30
## Configure the Jenkins server
2019-07-31 22:56:46 +05:30
2021-02-22 17:27:13 +05:30
Install and configure the Jenkins plugin. The plugin must be installed and configured to
2020-05-24 23:13:21 +05:30
authorize the connection to GitLab.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
1. On the Jenkins server, go to **Manage Jenkins > Manage Plugins**.
1. Install the [Jenkins GitLab Plugin](https://wiki.jenkins.io/display/JENKINS/GitLab+Plugin).
1. Go to **Manage Jenkins > Configure System**.
2021-04-29 21:17:54 +05:30
1. In the **GitLab** section, check the **Enable authentication for '/project' end-point** checkbox.
2020-05-24 23:13:21 +05:30
1. Click **Add**, then choose **Jenkins Credential Provider**.
1. Choose **GitLab API token** as the token type.
1. Enter the GitLab personal access token's value in the **API Token** field and click **Add**.
1. Enter the GitLab server's URL in the **GitLab host URL** field.
1. Click **Test Connection**, ensuring the connection is successful before proceeding.
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
For more information, see GitLab Plugin documentation about
[Jenkins-to-GitLab authentication](https://github.com/jenkinsci/gitlab-plugin#jenkins-to-gitlab-authentication).
![Jenkins GitLab plugin configuration](img/jenkins_gitlab_plugin_config.png)
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
## Configure the Jenkins project
2021-02-22 17:27:13 +05:30
Set up the Jenkins project you intend to run your build on.
2020-05-24 23:13:21 +05:30
1. On your Jenkins instance, go to **New Item**.
1. Enter the project's name.
1. Choose between **Freestyle** or **Pipeline** and click **OK**.
2021-02-22 17:27:13 +05:30
We recommend a Freestyle project, because the Jenkins plugin updates the build status on
2020-05-24 23:13:21 +05:30
GitLab. In a Pipeline project, you must configure a script to update the status on GitLab.
1. Choose your GitLab connection from the dropdown.
1. Check the **Build when a change is pushed to GitLab** checkbox.
1. Check the following checkboxes:
- **Accepted Merge Request Events**
- **Closed Merge Request Events**
1. Specify how build status is reported to GitLab:
- If you created a **Freestyle** project, in the **Post-build Actions** section, choose
**Publish build status to GitLab**.
- If you created a **Pipeline** project, you must use a Jenkins Pipeline script to update the status on
GitLab.
Example Jenkins Pipeline script:
```groovy
pipeline {
agent any
stages {
stage('gitlab') {
steps {
echo 'Notify GitLab'
updateGitlabCommitStatus name: 'build', state: 'pending'
updateGitlabCommitStatus name: 'build', state: 'success'
}
}
}
}
```
2021-09-30 23:02:18 +05:30
For more Jenkins Pipeline script examples, go to the [Jenkins GitLab plugin repository on GitHub](https://github.com/jenkinsci/gitlab-plugin#scripted-pipeline-jobs).
2020-05-24 23:13:21 +05:30
## Configure the GitLab project
2021-04-17 20:07:23 +05:30
Configure the GitLab integration with Jenkins in one of the following ways.
2020-05-24 23:13:21 +05:30
2021-04-17 20:07:23 +05:30
### Recommended Jenkins integration
2021-09-30 23:02:18 +05:30
GitLab recommends this approach for Jenkins integrations because it is easier to configure
than the [webhook integration](#webhook-integration).
2021-02-22 17:27:13 +05:30
2020-05-24 23:13:21 +05:30
1. Create a new GitLab project or choose an existing one.
1. Go to **Settings > Integrations**, then select **Jenkins CI**.
1. Turn on the **Active** toggle.
1. Select the events you want GitLab to trigger a Jenkins build for:
- Push
- Merge request
- Tag push
1. Enter the **Jenkins URL**.
1. Enter the **Project name**.
The project name should be URL-friendly, where spaces are replaced with underscores. To ensure
the project name is valid, copy it from your browser's address bar while viewing the Jenkins
project.
1. Enter the **Username** and **Password** if your Jenkins server requires
authentication.
1. Click **Test settings and save changes**. GitLab tests the connection to Jenkins.
2019-07-31 22:56:46 +05:30
2021-04-17 20:07:23 +05:30
### Webhook integration
2021-02-22 17:27:13 +05:30
If you are unable to provide GitLab with your Jenkins server login, you can use this option
to integrate GitLab and Jenkins.
1. In the configuration of your Jenkins job, in the GitLab configuration section, click **Advanced**.
1. Click the **Generate** button under the **Secret Token** field.
1. Copy the resulting token, and save the job configuration.
2021-04-17 20:07:23 +05:30
1. In GitLab, create a webhook for your project, enter the trigger URL
(such as `https://JENKINS_URL/project/YOUR_JOB`) and paste the token in the **Secret Token** field.
2021-02-22 17:27:13 +05:30
1. After you add the webhook, click the **Test** button, and it should succeed.
2019-07-31 22:56:46 +05:30
## Troubleshooting
2022-01-26 12:08:38 +05:30
### Error during GitLab configuration - "Connection failed. Please check your settings"
If you get this error message while configuring GitLab, the following are possible causes:
- GitLab is unable to reach your Jenkins instance at the address. If your GitLab instance is self-managed, try pinging the
Jenkins instance at the domain provided on the GitLab instance.
- The Jenkins instance is at a local address and is not included in the
[GitLab installation's allowlist](../security/webhooks.md#allowlist-for-local-requests).
- The credentials for the Jenkins instance do not have sufficient access or are invalid.
- The **Enable authentication for /project end-point checkbox** is not selected in your [Jenkin's plugin configuration](#configure-the-jenkins-server).
2019-07-31 22:56:46 +05:30
### Error in merge requests - "Could not connect to the CI server"
This integration relies on Jenkins reporting the build status back to GitLab via
2019-09-30 21:07:59 +05:30
the [Commit Status API](../api/commits.md#commit-status).
2019-07-31 22:56:46 +05:30
The error 'Could not connect to the CI server' usually means that GitLab did not
receive a build status update via the API. Either Jenkins was not properly
2019-09-30 21:07:59 +05:30
configured or there was an error reporting the status via the API.
2019-07-31 22:56:46 +05:30
1. [Configure the Jenkins server](#configure-the-jenkins-server) for GitLab API access
2020-05-24 23:13:21 +05:30
1. [Configure the Jenkins project](#configure-the-jenkins-project), including the
2019-09-30 21:07:59 +05:30
'Publish build status to GitLab' post-build action.
2020-01-01 13:55:28 +05:30
### Merge Request event does not trigger a Jenkins Pipeline
2020-04-22 19:07:51 +05:30
Check [service hook logs](../user/project/integrations/overview.md#troubleshooting-integrations) for request failures or check the `/var/log/gitlab/gitlab-rails/production.log` file for messages like:
2020-01-01 13:55:28 +05:30
```plaintext
WebHook Error => Net::ReadTimeout
```
or
```plaintext
WebHook Error => execution expired
```
If those are present, the request is exceeding the
2021-02-22 17:27:13 +05:30
[webhook timeout](../user/project/integrations/webhooks.md#webhook-fails-or-multiple-webhook-requests-are-triggered),
2020-01-01 13:55:28 +05:30
which is set to 10 seconds by default.
2021-02-22 17:27:13 +05:30
To fix this the `gitlab_rails['webhook_timeout']` value must be increased
in the `gitlab.rb` configuration file, followed by the [`gitlab-ctl reconfigure` command](../administration/restart_gitlab.md).
2020-01-01 13:55:28 +05:30
2021-03-11 19:13:27 +05:30
If you don't find the errors above, but do find *duplicate* entries like below (in `/var/log/gitlab/gitlab-rail`),
[webhook requests may be timing out](../user/project/integrations/webhooks.md#webhook-fails-or-multiple-webhook-requests-are-triggered):
2020-01-01 13:55:28 +05:30
2020-04-22 19:07:51 +05:30
```plaintext
2020-01-01 13:55:28 +05:30
2019-10-25_04:22:41.25630 2019-10-25T04:22:41.256Z 1584 TID-ovowh4tek WebHookWorker JID-941fb7f40b69dff3d833c99b INFO: start
2019-10-25_04:22:41.25630 2019-10-25T04:22:41.256Z 1584 TID-ovowh4tek WebHookWorker JID-941fb7f40b69dff3d833c99b INFO: start
```
2021-09-30 23:02:18 +05:30
### Enable job logs in Jenkins
When troubleshooting an integration issue, it is useful to enable job logs in Jenkins to see more details about what is happening under the hood.
To enable job logs in Jenkins:
1. Go to **Dashboard > Manage Jenkins > System Log**.
1. Select **Add new log recorder**.
1. Enter a name for the log recorder.
1. On the next screen, select **Add** and enter `org.jenkinsci.plugins.workflow.job` in the text field.
1. Make sure that the Log Level is **All** and select **Save**.
Now, after you run a build, you can go to the loggers page (**Dashboard > Manage Jenkins > System Log**), select your logger, and check the logs.