debian-mirror-gitlab/doc/user/project/merge_requests/code_quality.md

358 lines
15 KiB
Markdown
Raw Normal View History

2019-09-04 21:01:54 +05:30
---
2020-07-28 23:09:34 +05:30
stage: Verify
group: Testing
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#designated-technical-writers
2019-09-04 21:01:54 +05:30
type: reference, howto
---
2020-07-28 23:09:34 +05:30
# Code Quality
2019-07-31 22:56:46 +05:30
2020-03-13 15:44:24 +05:30
> [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/1984) in [GitLab Starter](https://about.gitlab.com/pricing/) 9.3.
2019-07-31 22:56:46 +05:30
2020-04-08 14:13:33 +05:30
Ensuring your project's code stays simple, readable and easy to contribute to can be problematic. With the help of [GitLab CI/CD](../../../ci/README.md), you can analyze your
2019-07-31 22:56:46 +05:30
source code quality using GitLab Code Quality.
2019-10-12 21:52:04 +05:30
Code Quality:
- Uses [Code Climate Engines](https://codeclimate.com), which are
2020-06-23 00:09:42 +05:30
free and open source. Code Quality does not require a Code Climate
2019-10-12 21:52:04 +05:30
subscription.
2020-04-08 14:13:33 +05:30
- Runs in [pipelines](../../../ci/pipelines/index.md) using a Docker image built in the
2019-10-12 21:52:04 +05:30
[GitLab Code
2020-04-08 14:13:33 +05:30
Quality](https://gitlab.com/gitlab-org/ci-cd/codequality) project using [default Code Climate configurations](https://gitlab.com/gitlab-org/ci-cd/codequality/-/tree/master/codeclimate_defaults).
2019-12-04 20:38:33 +05:30
- Can make use of a [template](#example-configuration).
2019-10-12 21:52:04 +05:30
- Is available with [Auto
2020-04-22 19:07:51 +05:30
DevOps](../../../topics/autodevops/stages.md#auto-code-quality-starter).
2020-04-08 14:13:33 +05:30
- Can be extended through [Analysis Plugins](https://docs.codeclimate.com/docs/list-of-engines) or a [custom tool](#implementing-a-custom-tool).
2019-07-31 22:56:46 +05:30
2020-07-28 23:09:34 +05:30
## Code Quality Widget
> - [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/1984) in [GitLab Starter](https://about.gitlab.com/pricing/) 9.3.
> - Made [available in all tiers](https://gitlab.com/gitlab-org/gitlab/-/issues/212499) in 13.2.
2019-07-31 22:56:46 +05:30
Going a step further, GitLab can show the Code Quality report right
2020-07-28 23:09:34 +05:30
in the merge request widget area if a report from the target branch is available to compare to:
2019-07-31 22:56:46 +05:30
2019-12-04 20:38:33 +05:30
![Code Quality Widget](img/code_quality.png)
2019-07-31 22:56:46 +05:30
2020-05-24 23:13:21 +05:30
Watch a quick walkthrough of Code Quality in action:
<div class="video-fallback">
See the video: <a href="https://www.youtube.com/watch?v=B32LxtJKo9M">Code Quality: Speed Run</a>.
</div>
<figure class="video-container">
<iframe src="https://www.youtube.com/embed/B32LxtJKo9M" frameborder="0" allowfullscreen="true"> </iframe>
</figure>
NOTE: **Note:**
For one customer, the auditor found that having Code Quality, SAST, and Container Scanning all automated in GitLab CI/CD was almost better than a manual review! [Read more](https://about.gitlab.com/customers/bi_worldwide/).
See also the Code Climate list of [Supported Languages for Maintainability](https://docs.codeclimate.com/docs/supported-languages-for-maintainability).
2020-04-08 14:13:33 +05:30
2019-07-31 22:56:46 +05:30
## Use cases
For instance, consider the following workflow:
2019-10-12 21:52:04 +05:30
1. Your backend team member starts a new implementation for making a certain
feature in your app faster.
1. With Code Quality reports, they analyze how their implementation is impacting
the code quality.
2020-05-24 23:13:21 +05:30
1. The metrics show that their code degrades the quality by 10 points.
2019-10-12 21:52:04 +05:30
1. You ask a co-worker to help them with this modification.
1. They both work on the changes until Code Quality report displays no
degradations, only improvements.
1. You approve the merge request and authorize its deployment to staging.
1. Once verified, their changes are deployed to production.
2019-12-04 20:38:33 +05:30
## Example configuration
CAUTION: **Caution:**
The job definition shown below is supported on GitLab 11.11 and later versions. It
also requires the GitLab Runner 11.5 or later. For earlier versions, use the
[previous job definitions](#previous-job-definitions).
This example shows how to run Code Quality on your code by using GitLab CI/CD and Docker.
2020-05-24 23:13:21 +05:30
First, you need GitLab Runner configured:
2020-04-22 19:07:51 +05:30
2020-06-23 00:09:42 +05:30
- For the [Docker-in-Docker workflow](../../../ci/docker/using_docker_build.md#use-docker-in-docker-workflow-with-docker-executor).
2020-05-24 23:13:21 +05:30
- With enough disk space to handle generated Code Quality files. For example on the [GitLab project](https://gitlab.com/gitlab-org/gitlab) the files are approximately 7 GB.
2019-12-04 20:38:33 +05:30
2020-06-23 00:09:42 +05:30
Once you set up the Runner, include the Code Quality template in your CI configuration:
2019-12-04 20:38:33 +05:30
```yaml
include:
- template: Code-Quality.gitlab-ci.yml
```
The above example will create a `code_quality` job in your CI/CD pipeline which
will scan your source code for code quality issues. The report will be saved as a
2020-07-28 23:09:34 +05:30
[Code Quality report artifact](../../../ci/pipelines/job_artifacts.md#artifactsreportscodequality)
2020-06-23 00:09:42 +05:30
that you can later download and analyze.
2019-12-04 20:38:33 +05:30
2020-06-23 00:09:42 +05:30
It's also possible to override the URL to the Code Quality image by
2020-03-13 15:44:24 +05:30
setting the `CODE_QUALITY_IMAGE` variable. This is particularly useful if you want
to lock in a specific version of Code Quality, or use a fork of it:
```yaml
include:
- template: Code-Quality.gitlab-ci.yml
code_quality:
variables:
CODE_QUALITY_IMAGE: "registry.example.com/codequality-fork:latest"
```
2019-12-26 22:10:19 +05:30
By default, report artifacts are not downloadable. If you need them downloadable on the
job details page, you can add `gl-code-quality-report.json` to the artifact paths like so:
```yaml
include:
- template: Code-Quality.gitlab-ci.yml
code_quality:
artifacts:
paths: [gl-code-quality-report.json]
```
2020-06-23 00:09:42 +05:30
The included `code_quality` job is running in the `test` stage, so it needs to be included in your CI configuration, like so:
2019-12-21 20:55:43 +05:30
```yaml
stages:
- test
```
2019-12-04 20:38:33 +05:30
TIP: **Tip:**
This information will be automatically extracted and shown right in the merge request widget.
CAUTION: **Caution:**
On self-managed instances, if a malicious actor compromises the Code Quality job
2020-06-23 00:09:42 +05:30
definition they will be able to execute privileged Docker commands on the Runner
2019-12-04 20:38:33 +05:30
host. Having proper access control policies mitigates this attack vector by
allowing access only to trusted actors.
### Previous job definitions
CAUTION: **Caution:**
Before GitLab 11.5, Code Quality job and artifact had to be named specifically to
automatically extract report data and show it in the merge request widget. While these
2020-06-23 00:09:42 +05:30
old job definitions are still maintained they have been deprecated and are no longer supported on GitLab 12.0 or higher.
You're advised to update your `.gitlab-ci.yml` configuration to reflect that change.
2019-12-04 20:38:33 +05:30
2019-12-26 22:10:19 +05:30
For GitLab 11.5 and later, the job should look like:
2019-12-04 20:38:33 +05:30
```yaml
code_quality:
image: docker:stable
variables:
DOCKER_DRIVER: overlay2
allow_failure: true
services:
- docker:stable-dind
script:
- export SP_VERSION=$(echo "$CI_SERVER_VERSION" | sed 's/^\([0-9]*\)\.\([0-9]*\).*/\1-\2-stable/')
- docker run
--env SOURCE_CODE="$PWD"
--volume "$PWD":/code
--volume /var/run/docker.sock:/var/run/docker.sock
2020-04-08 14:13:33 +05:30
"registry.gitlab.com/gitlab-org/ci-cd/codequality:$SP_VERSION" /code
2020-03-13 15:44:24 +05:30
artifacts:
reports:
codequality: gl-code-quality-report.json
```
In GitLab 12.6, Code Quality switched to the
2020-04-08 14:13:33 +05:30
[new versioning scheme](https://gitlab.com/gitlab-org/ci-cd/codequality#versioning-and-release-cycle).
2020-06-23 00:09:42 +05:30
It's highly recommended to include the Code Quality template as shown in the
2020-03-13 15:44:24 +05:30
[example configuration](#example-configuration), which uses the new versioning scheme.
If not using the template, the `SP_VERSION` variable can be hardcoded to use the
new image versions:
```yaml
code_quality:
image: docker:stable
variables:
DOCKER_DRIVER: overlay2
SP_VERSION: 0.85.6
allow_failure: true
services:
- docker:stable-dind
script:
- docker run
--env SOURCE_CODE="$PWD"
--volume "$PWD":/code
--volume /var/run/docker.sock:/var/run/docker.sock
2020-04-08 14:13:33 +05:30
"registry.gitlab.com/gitlab-org/ci-cd/codequality:$SP_VERSION" /code
2019-12-04 20:38:33 +05:30
artifacts:
reports:
codequality: gl-code-quality-report.json
```
For GitLab 11.4 and earlier, the job should look like:
```yaml
code_quality:
image: docker:stable
variables:
DOCKER_DRIVER: overlay2
allow_failure: true
services:
- docker:stable-dind
script:
- export SP_VERSION=$(echo "$CI_SERVER_VERSION" | sed 's/^\([0-9]*\)\.\([0-9]*\).*/\1-\2-stable/')
- docker run
--env SOURCE_CODE="$PWD"
--volume "$PWD":/code
--volume /var/run/docker.sock:/var/run/docker.sock
2020-04-08 14:13:33 +05:30
"registry.gitlab.com/gitlab-org/ci-cd/codequality:$SP_VERSION" /code
2019-12-04 20:38:33 +05:30
artifacts:
paths: [gl-code-quality-report.json]
```
Alternatively the job name could be `codeclimate` or `codequality` and the artifact
name could be `codeclimate.json`. These names have been deprecated with GitLab 11.0
and may be removed in the next major release, GitLab 12.0.
For GitLab 10.3 and earlier, the job should look like:
```yaml
codequality:
image: docker:latest
variables:
DOCKER_DRIVER: overlay
services:
- docker:dind
script:
- docker pull codeclimate/codeclimate:0.69.0
- docker run --env CODECLIMATE_CODE="$PWD" --volume "$PWD":/code --volume /var/run/docker.sock:/var/run/docker.sock --volume /tmp/cc:/tmp/cc codeclimate/codeclimate:0.69.0 init
- docker run --env CODECLIMATE_CODE="$PWD" --volume "$PWD":/code --volume /var/run/docker.sock:/var/run/docker.sock --volume /tmp/cc:/tmp/cc codeclimate/codeclimate:0.69.0 analyze -f json > codeclimate.json || true
artifacts:
paths: [codeclimate.json]
```
2019-07-31 22:56:46 +05:30
2019-10-12 21:52:04 +05:30
## Configuring jobs using variables
2019-07-31 22:56:46 +05:30
2019-10-12 21:52:04 +05:30
The Code Quality job supports environment variables that users can set to
configure job execution at runtime.
2019-07-31 22:56:46 +05:30
2019-10-12 21:52:04 +05:30
For a list of available environment variables, see
2020-04-08 14:13:33 +05:30
[Environment variables](https://gitlab.com/gitlab-org/ci-cd/codequality#environment-variables).
2019-10-12 21:52:04 +05:30
## Implementing a custom tool
It's possible to have a custom tool provide Code Quality reports in GitLab. To
do this:
1. Define a job in your `.gitlab-ci.yml` file that generates the
[Code Quality report
2020-07-28 23:09:34 +05:30
artifact](../../../ci/pipelines/job_artifacts.md#artifactsreportscodequality).
2019-10-12 21:52:04 +05:30
1. Configure your tool to generate the Code Quality report artifact as a JSON
2020-06-23 00:09:42 +05:30
file that implements a subset of the [Code Climate
2020-04-22 19:07:51 +05:30
spec](https://github.com/codeclimate/platform/blob/master/spec/analyzers/SPEC.md#data-types).
2019-10-12 21:52:04 +05:30
The Code Quality report artifact JSON file must contain an array of objects
with the following properties:
2019-07-31 22:56:46 +05:30
| Name | Description |
| ---------------------- | -------------------------------------------------------------------------------------- |
| `description` | A description of the code quality violation. |
| `fingerprint` | A unique fingerprint to identify the code quality violation. For example, an MD5 hash. |
| `location.path` | The relative path to the file containing the code quality violation. |
| `location.lines.begin` | The line on which the code quality violation occurred. |
Example:
```json
[
{
"description": "'unused' is assigned a value but never used.",
"fingerprint": "7815696ecbf1c96e6894b779456d330e",
"location": {
"path": "lib/index.js",
"lines": {
"begin": 42
}
}
}
]
```
NOTE: **Note:**
2019-10-12 21:52:04 +05:30
Although the Code Climate spec supports more properties, those are ignored by
GitLab.
2020-07-28 23:09:34 +05:30
## Code Quality reports **(STARTER)**
2019-07-31 22:56:46 +05:30
2020-04-08 14:13:33 +05:30
Once the Code Quality job has completed:
2019-07-31 22:56:46 +05:30
2020-07-28 23:09:34 +05:30
- The full list of code quality violations generated by a pipeline is shown in the
2020-04-08 14:13:33 +05:30
Code Quality tab of the Pipeline Details page.
- Potential changes to code quality are shown directly in the merge request.
The Code Quality widget in the merge request compares the reports from the base and head of the branch,
then lists any violations that will be resolved or created when the branch is merged.
- The full JSON report is available as a
[downloadable artifact](../../../ci/pipelines/job_artifacts.md#downloading-artifacts)
for the `code_quality` job.
2019-07-31 22:56:46 +05:30
2020-07-28 23:09:34 +05:30
## Extending functionality
### Using Analysis Plugins
Should there be a need to extend the default functionality provided by Code Quality, as stated in [Code Quality](#code-quality), [Analysis Plugins](https://docs.codeclimate.com/docs/list-of-engines) are available.
For example, to use the [SonarJava analyzer](https://docs.codeclimate.com/docs/sonar-java),
add a file named `.codeclimate.yml` containing the [enablement code](https://docs.codeclimate.com/docs/sonar-java#enable-the-plugin)
for the plugin to the root of your repository:
```yaml
version: "2"
plugins:
sonar-java:
enabled: true
```
This adds SonarJava to the `plugins:` section of the [default `.codeclimate.yml`](https://gitlab.com/gitlab-org/ci-cd/codequality/-/blob/master/codeclimate_defaults/.codeclimate.yml)
included in your project.
Changes to the `plugins:` section do not affect the `exclude_patterns` section of the
defeault `.codeclimate.yml`. See the Code Climate documentation for
[excluding files and folders](https://docs.codeclimate.com/docs/excluding-files-and-folders)
for more details.
Here's [an example project](https://gitlab.com/jheimbuck_gl/jh_java_example_project) that uses Code Quality with a `.codeclimate.yml` file.
2020-06-23 00:09:42 +05:30
## Troubleshooting
2019-07-31 22:56:46 +05:30
2020-07-28 23:09:34 +05:30
### Changing the default configuration has no effect
A common issue is that the terms `Code Quality` (GitLab specific) and `Code Climate`
(Engine used by GitLab) are very similar. You must add a **`.codeclimate.yml`** file
to change the default configuration, **not** a `.codequality.yml` file. If you use
the wrong filename, the [default `.codeclimate.yml`](https://gitlab.com/gitlab-org/ci-cd/codequality/-/blob/master/codeclimate_defaults/.codeclimate.yml)
is still used.
2020-06-23 00:09:42 +05:30
### No Code Quality report is displayed in a Merge Request
2019-09-04 21:01:54 +05:30
2020-06-23 00:09:42 +05:30
This can be due to multiple reasons:
2020-04-08 14:13:33 +05:30
2020-06-23 00:09:42 +05:30
- You just added the Code Quality job in your `.gitlab-ci.yml`. The report does not
have anything to compare to yet, so no information can be displayed. Future merge
requests will have something to compare to.
2020-07-28 23:09:34 +05:30
- Your pipeline is not set to run the code quality job on your default branch. If there is no report generated from the default branch, your MR branch reports will not have anything to compare to.
2020-06-23 00:09:42 +05:30
- If no [degradation or error is detected](https://docs.codeclimate.com/docs/maintainability#section-checks),
nothing will be displayed.
- The [`artifacts:expire_in`](../../../ci/yaml/README.md#artifactsexpire_in) CI/CD
setting can cause the Code Quality artifact(s) to expire faster than desired.
- Large `codeclimate.json` files (esp. >10 MB) are [known to prevent the report from being displayed](https://gitlab.com/gitlab-org/gitlab/-/issues/2737).
As a work-around, try removing [properties](https://github.com/codeclimate/platform/blob/master/spec/analyzers/SPEC.md#data-types)
that are [ignored by GitLab](#implementing-a-custom-tool). You can:
- Configure the Code Quality tool to not output those types.
- Use `sed`, `awk` or similar commands in the `.gitlab-ci.yml` script to
edit the `codeclimate.json` before the job completes.
2019-09-04 21:01:54 +05:30
2020-06-23 00:09:42 +05:30
### Only a single Code Quality report is displayed, but more are defined
2019-09-04 21:01:54 +05:30
2020-06-23 00:09:42 +05:30
GitLab only uses the Code Quality artifact from the latest created job (with the largest job ID).
If multiple jobs in a pipeline generate a code quality artifact, those of earlier jobs are ignored.
To avoid confusion, configure only one job to generate a `codeclimate.json`.