--- stage: Create group: Source Code info: "To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments" type: reference, api --- # Internal API The internal API is used by different GitLab components, it cannot be used by other consumers. This documentation is intended for people working on the GitLab codebase. This documentation does not yet include the internal API used by GitLab Pages. ## Adding new endpoints API endpoints should be externally accessible by default, with proper authentication and authorization. Before adding a new internal endpoint, consider if the API would potentially be useful to the wider GitLab community and can be made externally accessible. One reason we might favor internal API endpoints sometimes is when using such an endpoint requires internal data that external actors cannot have. For example, in the internal Pages API we might use a secret token that identifies a request as internal or sign a request with a public key that is not available to a wider community. Another reason to separate something into an internal API is when request to such API endpoint should never go through an edge (public) load balancer. This way we can configure different rate limiting rules and policies around how the endpoint is being accessed, because we know that only internal requests can be made to that endpoint going through an internal load balancer. ## Authentication These methods are all authenticated using a shared secret. This secret is stored in a file at the path configured in `config/gitlab.yml` by default this is in the root of the rails app named `.gitlab_shell_secret` To authenticate using that token, clients: 1. Read the contents of that file. 1. Use the file contents to generate a JSON Web Token (`JWT`). 1. Pass the JWT in the `Gitlab-Shell-Api-Request` header. ## Git Authentication This is called by [Gitaly](https://gitlab.com/gitlab-org/gitaly) and [GitLab Shell](https://gitlab.com/gitlab-org/gitlab-shell) to check access to a repository. - **When called from GitLab Shell**: No changes are passed, and the internal API replies with the information needed to pass the request on to Gitaly. - **When called from Gitaly in a `pre-receive` hook**: The changes are passed and validated to determine if the push is allowed. Calls are limited to 50 seconds each. This endpoint is covered in more detail on [its own page](internal_api_allowed.md), due to the scope of what it covers. ```plaintext POST /internal/allowed ``` | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `key_id` | string | no | ID of the SSH-key used to connect to GitLab Shell | | `username` | string | no | Username from the certificate used to connect to GitLab Shell | | `project` | string | no (if `gl_repository` is passed) | Path to the project | | `gl_repository` | string | no (if `project` is passed) | Repository identifier, such as `project-7` | | `protocol` | string | yes | SSH when called from GitLab Shell, HTTP or SSH when called from Gitaly | | `action` | string | yes | Git command being run (`git-upload-pack`, `git-receive-pack`, `git-upload-archive`) | | `changes` | string | yes | ` ` when called from Gitaly, the magic string `_any` when called from GitLab Shell | | `check_ip` | string | no | IP address from which call to GitLab Shell was made | Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "key_id=11&project=gnuwget/wget2&action=git-upload-pack&protocol=ssh" \ "http://localhost:3001/api/v4/internal/allowed" ``` Example response: ```json { "status": true, "gl_repository": "project-3", "gl_project_path": "gnuwget/wget2", "gl_id": "user-1", "gl_username": "root", "git_config_options": [], "gitaly": { "repository": { "storage_name": "default", "relative_path": "@hashed/4e/07/4e07408562bedb8b60ce05c1decfe3ad16b72230967de01f640b7e4729b49fce.git", "git_object_directory": "", "git_alternate_object_directories": [], "gl_repository": "project-3", "gl_project_path": "gnuwget/wget2" }, "address": "unix:/Users/bvl/repos/gitlab/gitaly.socket", "token": null }, "gl_console_messages": [] } ``` ### Known consumers - Gitaly - GitLab Shell ## LFS Authentication This is the endpoint that gets called from GitLab Shell to provide information for LFS clients when the repository is accessed over SSH. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `key_id` | string | no | ID of the SSH-key used to connect to GitLab Shell | | `username`| string | no | Username from the certificate used to connect to GitLab Shell | | `project` | string | no | Path to the project | Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "key_id=11&project=gnuwget/wget2" "http://localhost:3001/api/v4/internal/lfs_authenticate" ``` ```json { "username": "root", "lfs_token": "eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJkYXRhIjp7ImFjdG9yIjoicm9vdCJ9LCJqdGkiOiIyYWJhZDcxZC0xNDFlLTQ2NGUtOTZlMi1mODllYWRiMGVmZTYiLCJpYXQiOjE1NzAxMTc2NzYsIm5iZiI6MTU3MDExNzY3MSwiZXhwIjoxNTcwMTE5NDc2fQ.g7atlBw1QMY7QEBVPE0LZ8ZlKtaRzaMRmNn41r2YITM", "repository_http_path": "http://localhost:3001/gnuwget/wget2.git", "expires_in": 1800 } ``` ### Known consumers - GitLab Shell ## Authorized Keys Check This endpoint is called by the GitLab Shell authorized keys check. Which is called by OpenSSH or GitLab SSHD for [fast SSH key lookup](../../administration/operations/fast_ssh_key_lookup.md). | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `key` | string | yes | An authorized key used for public key authentication. | ```plaintext GET /internal/authorized_keys ``` Example request: ```shell curl --request GET --header "Gitlab-Shell-Api-Request: " "http://localhost:3001/api/v4/internal/authorized_keys?key=" ``` Example response: ```json { "id": 11, "title": "admin@example.com", "key": "ssh-rsa ...", "created_at": "2019-06-27T15:29:02.219Z" } ``` ### Known consumers - GitLab Shell ## Get user for user ID or key This endpoint is used when a user performs `ssh git@gitlab.com`. It discovers the user associated with an SSH key. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `key_id` | integer | no | The ID of the SSH key used as found in the authorized-keys file or through the `/authorized_keys` check | | `username` | string | no | Username of the user being looked up, used by GitLab Shell when authenticating using a certificate | ```plaintext GET /internal/discover ``` Example request: ```shell curl --request GET --header "Gitlab-Shell-Api-Request: " "http://localhost:3001/api/v4/internal/discover?key_id=7" ``` Example response: ```json { "id": 7, "name": "Dede Eichmann", "username": "rubi" } ``` ### Known consumers - GitLab Shell ## Instance information This gets some generic information about the instance. This is used by Geo nodes to get information about each other. ```plaintext GET /internal/check ``` Example request: ```shell curl --request GET --header "Gitlab-Shell-Api-Request: " "http://localhost:3001/api/v4/internal/check" ``` Example response: ```json { "api_version": "v4", "gitlab_version": "12.3.0-pre", "gitlab_rev": "d69c988e6a6", "redis": true } ``` ### Known consumers - GitLab Geo - GitLab Shell's `bin/check` - Gitaly ## Get new 2FA recovery codes using an SSH key This is called from GitLab Shell and allows users to get new 2FA recovery codes based on their SSH key. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `key_id` | integer | no | The ID of the SSH key used as found in the authorized-keys file or through the `/authorized_keys` check | | `user_id` | integer | no | **Deprecated** User ID for which to generate new recovery codes | ```plaintext GET /internal/two_factor_recovery_codes ``` Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "key_id=7" "http://localhost:3001/api/v4/internal/two_factor_recovery_codes" ``` Example response: ```json { "success": true, "recovery_codes": [ "d93ee7037944afd5", "19d7b84862de93dd", "1e8c52169195bf71", "be50444dddb7ca84", "26048c77d161d5b7", "482d5c03d1628c47", "d2c695e309ce7679", "dfb4748afc4f12a7", "0e5f53d1399d7979", "af04d5622153b020" ] } ``` ### Known consumers - GitLab Shell ## Get new personal access-token This is called from GitLab Shell and allows users to generate a new personal access token. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `name` | string | yes | The name of the new token | | `scopes` | string array | yes | The authorization scopes for the new token, these must be valid token scopes | | `expires_at` | string | no | The expiry date for the new token | | `key_id` | integer | no | The ID of the SSH key used as found in the authorized-keys file or through the `/authorized_keys` check | | `user_id` | integer | no | User ID for which to generate the new token | ```plaintext POST /internal/personal_access_token ``` Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "user_id=29&name=mytokenname&scopes[]=read_user&scopes[]=read_repository&expires_at=2020-07-24" \ "http://localhost:3001/api/v4/internal/personal_access_token" ``` Example response: ```json { "success": true, "token": "Hf_79B288hRv_3-TSD1R", "scopes": ["read_user","read_repository"], "expires_at": "2020-07-24" } ``` ### Known consumers - GitLab Shell ## Authenticate Error Tracking requests This endpoint is called by the error tracking Go REST API application to authenticate a project. > [Introduced](https://gitlab.com/gitlab-org/opstrace/opstrace/-/issues/1693) in GitLab 15.1. | Attribute | Type | Required | Description | |:-------------|:--------|:---------|:-------------------------------------------------------------------| | `project_id` | integer | yes | The ID of the project which has the associated key. | | `public_key` | string | yes | The [public key](../../api/error_tracking.md#error-tracking-client-keys) generated by the integrated Error Tracking feature. | ```plaintext POST /internal/error_tracking/allowed ``` Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "project_id=111&public_key=generated-error-tracking-key" \ "http://localhost:3001/api/v4/internal/error_tracking/allowed" ``` Example response: ```json { "enabled": true } ``` ### Known consumers - OpsTrace ## Incrementing counter on pre-receive This is called from the Gitaly hooks increasing the reference counter for a push that might be accepted. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `gl_repository` | string | yes | repository identifier for the repository receiving the push | ```plaintext POST /internal/pre_receive ``` Example request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "gl_repository=project-7" "http://localhost:3001/api/v4/internal/pre_receive" ``` Example response: ```json { "reference_counter_increased": true } ``` ## PostReceive Called from Gitaly after a receiving a push. This triggers the `PostReceive`-worker in Sidekiq, processes the passed push options and builds the response including messages that need to be displayed to the user. | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `identifier` | string | yes | `user-[id]` or `key-[id]` Identifying the user performing the push | | `gl_repository` | string | yes | identifier of the repository being pushed to | | `push_options` | string array | no | array of push options | | `changes` | string | no | refs to be updated in the push in the format `oldrev newrev refname\n`. | ```plaintext POST /internal/post_receive ``` Example Request: ```shell curl --request POST --header "Gitlab-Shell-Api-Request: " \ --data "gl_repository=project-7" --data "identifier=user-1" \ --data "changes=0000000000000000000000000000000000000000 fd9e76b9136bdd9fe217061b497745792fe5a5ee gh-pages\n" \ "http://localhost:3001/api/v4/internal/post_receive" ``` Example response: ```json { "messages": [ { "message": "Hello from post-receive", "type": "alert" } ], "reference_counter_decreased": true } ``` ## GitLab agent endpoints > - [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/41045) in GitLab 13.4. > - This feature is not deployed on GitLab.com > - It's not recommended for production use. The following endpoints are used by the GitLab agent server (`kas`) for various purposes. These endpoints are all authenticated using JWT. The JWT secret is stored in a file specified in `config/gitlab.yml`. By default, the location is in the root of the GitLab Rails app in a file called `.gitlab_kas_secret`. ### GitLab agent information Called from GitLab agent server (`kas`) to retrieve agent information for the given agent token. This returns the Gitaly connection information for the agent's project in order for `kas` to fetch and update the agent's configuration. ```plaintext GET /internal/kubernetes/agent_info ``` Example Request: ```shell curl --request GET --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " "http://localhost:3000/api/v4/internal/kubernetes/agent_info" ``` ### GitLab agent project information Called from GitLab agent server (`kas`) to retrieve project information for the given agent token. This returns the Gitaly connection for the requested project. GitLab `kas` uses this to configure the agent to fetch Kubernetes resources from the project repository to sync. Only public projects are supported. For private projects, the ability for the agent to be authorized is [not yet implemented](https://gitlab.com/gitlab-org/gitlab/-/issues/220912). | Attribute | Type | Required | Description | |:----------|:-------|:---------|:------------| | `id` | integer/string | yes | The ID or [URL-encoded path of the project](../../api/rest/index.md#namespaced-path-encoding) | ```plaintext GET /internal/kubernetes/project_info ``` Example Request: ```shell curl --request GET --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " "http://localhost:3000/api/v4/internal/kubernetes/project_info?id=7" ``` ### GitLab agent usage metrics Called from GitLab agent server (`kas`) to increase the usage metric counters. | Attribute | Type | Required | Description | |:---------------------------------------------------------------------------|:--------------|:---------|:-----------------------------------------------------------------------------------------------------------------| | `counters` | hash | no | The number to increase the `k8s_api_proxy_request` counter by | | `counters["k8s_api_proxy_request"]` | integer | no | The number to increase the `k8s_api_proxy_request` counter by | | `counters["gitops_sync"]` | integer | no | The number to increase the `gitops_sync` counter by | | `unique_counters` | hash | no | The number to increase the `k8s_api_proxy_request` counter by | | `unique_counters["agent_users_using_ci_tunnel"]` | integer array | no | The set of unique user ids that have interacted a CI Tunnel to track the `agent_users_using_ci_tunnel` metric event | ```plaintext POST /internal/kubernetes/usage_metrics ``` Example Request: ```shell curl --request POST --header "Gitlab-Kas-Api-Request: " --header "Content-Type: application/json" \ --data '{"counters": {"gitops_sync":1}}' "http://localhost:3000/api/v4/internal/kubernetes/usage_metrics" ``` ### Create Starboard vulnerability Called from the GitLab agent server (`kas`) to create a security vulnerability from a Starboard vulnerability report. This request is idempotent. Multiple requests with the same data create a single vulnerability. The response contains the UUID of the created vulnerability finding. | Attribute | Type | Required | Description | |:----------------|:-------|:---------|:------------| | `vulnerability` | Hash | yes | Vulnerability data matching the security report schema [`vulnerability` field](https://gitlab.com/gitlab-org/security-products/security-report-schemas/-/blob/master/src/security-report-format.json). | | `scanner` | Hash | yes | Scanner data matching the security report schema [`scanner` field](https://gitlab.com/gitlab-org/security-products/security-report-schemas/-/blob/master/src/security-report-format.json). | ```plaintext PUT internal/kubernetes/modules/starboard_vulnerability ``` Example Request: ```shell curl --request PUT --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " --header "Content-Type: application/json" \ --url "http://localhost:3000/api/v4/internal/kubernetes/modules/starboard_vulnerability" \ --data '{ "vulnerability": { "name": "CVE-123-4567 in libc", "severity": "high", "confidence": "unknown", "location": { "kubernetes_resource": { "namespace": "production", "kind": "deployment", "name": "nginx", "container": "nginx" } }, "identifiers": [ { "type": "cve", "name": "CVE-123-4567", "value": "CVE-123-4567" } ] }, "scanner": { "id": "starboard_trivy", "name": "Trivy (via Starboard Operator)", "vendor": "GitLab" } }' ``` Example response: ```json { "uuid": "4773b2ee-5ba5-5e9f-b48c-5f7a17f0faac" } ``` ### Resolve Starboard vulnerabilities Called from the GitLab agent server (`kas`) to resolve Starboard security vulnerabilities. Accepts a list of finding UUIDs and marks all Starboard vulnerabilities not identified by the list as resolved. | Attribute | Type | Required | Description | |:----------|:-------------|:---------|:----------------------------------------------------------------------------------------------------------------------------------| | `uuids` | string array | yes | UUIDs of detected vulnerabilities, as collected from [Create Starboard vulnerability](#create-starboard-vulnerability) responses. | ```plaintext POST internal/kubernetes/modules/starboard_vulnerability/scan_result ``` Example Request: ```shell curl --request POST --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " --header "Content-Type: application/json" \ --url "http://localhost:3000/api/v4/internal/kubernetes/modules/starboard_vulnerability/scan_result" \ --data '{ "uuids": ["102e8a0a-fe29-59bd-b46c-57c3e9bc6411", "5eb12985-0ed5-51f4-b545-fd8871dc2870"] }' ``` ### Scan Execution Policies Called from GitLab agent server (`kas`) to retrieve `scan_execution_policies` configured for the project belonging to the agent token. GitLab `kas` uses this to configure the agent to scan images in the Kubernetes cluster based on the policy. ```plaintext GET /internal/kubernetes/modules/starboard_vulnerability/scan_execution_policies ``` Example Request: ```shell curl --request GET --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " "http://localhost:3000/api/v4/internal/kubernetes/modules/starboard_vulnerability/scan_execution_policies" ``` Example response: ```json { "policies": [ { "name": "Policy", "description": "Policy description", "enabled": true, "yaml": "---\nname: Policy\ndescription: 'Policy description'\nenabled: true\nactions:\n- scan: container_scanning\nrules:\n- type: pipeline\n branches:\n - main\n", "updated_at": "2022-06-02T05:36:26+00:00" } ] } ``` ### Policy Configuration Called from GitLab agent server (`kas`) to retrieve `policies_configuration` configured for the project belonging to the agent token. GitLab `kas` uses this to configure the agent to scan images in the Kubernetes cluster based on the configuration. ```plaintext GET /internal/kubernetes/modules/starboard_vulnerability/policies_configuration ``` Example Request: ```shell curl --request GET --header "Gitlab-Kas-Api-Request: " \ --header "Authorization: Bearer " "http://localhost:3000/api/v4/internal/kubernetes/modules/starboard_vulnerability/policies_configuration" ``` Example response: ```json { "configurations": [ { "cadence": "30 2 * * *", "namespaces": [ "namespace-a", "namespace-b" ], "updated_at": "2022-06-02T05:36:26+00:00" } ] } ``` ## Subscriptions The subscriptions endpoint is used by [CustomersDot](https://gitlab.com/gitlab-org/customers-gitlab-com) (`customers.gitlab.com`) to apply subscriptions including trials, and add-on purchases, for personal namespaces or top-level groups within GitLab.com. ### Creating a subscription Use a POST to create a subscription. ```plaintext POST /namespaces/:id/gitlab_subscription ``` | Attribute | Type | Required | Description | |:------------|:--------|:---------|:------------| | `start_date` | date | yes | Start date of subscription | | `end_date` | date | no | End date of subscription | | `plan_code` | string | no | Subscription tier code | | `seats` | integer | no | Number of seats in subscription | | `max_seats_used` | integer | no | Highest number of active users in the last month | | `auto_renew` | boolean | no | Whether subscription auto-renews on end date | | `trial` | boolean | no | Whether subscription is a trial | | `trial_starts_on` | date | no | Start date of trial | | `trial_ends_on` | date | no | End date of trial | Example request: ```shell curl --request POST --header "TOKEN: " "https://gitlab.com/api/v4/namespaces/1234/gitlab_subscription?start_date="2020-07-15"&plan="premium"&seats=10" ``` Example response: ```json { "plan": { "code":"premium", "name":"premium", "trial":false, "auto_renew":null, "upgradable":false, }, "usage": { "seats_in_subscription":10, "seats_in_use":1, "max_seats_used":0, "seats_owed":0 }, "billing": { "subscription_start_date":"2020-07-15", "subscription_end_date":null, "trial_ends_on":null } } ``` ### Updating a subscription Use a PUT command to update an existing subscription. ```plaintext PUT /namespaces/:id/gitlab_subscription ``` | Attribute | Type | Required | Description | |:------------|:--------|:---------|:------------| | `start_date` | date | no | Start date of subscription | | `end_date` | date | no | End date of subscription | | `plan_code` | string | no | Subscription tier code | | `seats` | integer | no | Number of seats in subscription | | `max_seats_used` | integer | no | Highest number of active users in the last month | | `auto_renew` | boolean | no | Whether subscription auto-renews on end date | | `trial` | boolean | no | Whether subscription is a trial | | `trial_starts_on` | date | no | Start date of trial. Required if trial is true. | | `trial_ends_on` | date | no | End date of trial | Example request: ```shell curl --request PUT --header "TOKEN: " "https://gitlab.com/api/v4/namespaces/1234/gitlab_subscription?max_seats_used=0" ``` Example response: ```json { "plan": { "code":"premium", "name":"premium", "trial":false, "auto_renew":null, "upgradable":false, }, "usage": { "seats_in_subscription":80, "seats_in_use":82, "max_seats_used":0, "seats_owed":2 }, "billing": { "subscription_start_date":"2020-07-15", "subscription_end_date":"2021-07-15", "trial_ends_on":null } } ``` ### Retrieving a subscription Use a GET command to view an existing subscription. ```plaintext GET /namespaces/:id/gitlab_subscription ``` Example request: ```shell curl --header "TOKEN: " "https://gitlab.com/api/v4/namespaces/1234/gitlab_subscription" ``` Example response: ```json { "plan": { "code":"premium", "name":"premium", "trial":false, "auto_renew":null, "upgradable":false, "exclude_guests":false, }, "usage": { "seats_in_subscription":80, "seats_in_use":82, "max_seats_used":82, "seats_owed":2 }, "billing": { "subscription_start_date":"2020-07-15", "subscription_end_date":"2021-07-15", "trial_ends_on":null } } ``` ### Known consumers - CustomersDot ## CI/CD minutes provisioning The CI/CD Minutes endpoints are used by [CustomersDot](https://gitlab.com/gitlab-org/customers-gitlab-com) (`customers.gitlab.com`) to apply additional packs of CI/CD minutes, for personal namespaces or top-level groups within GitLab.com. ### Creating an additional pack Use a POST to create additional packs. ```plaintext POST /namespaces/:id/minutes ``` | Attribute | Type | Required | Description | |:------------|:--------|:---------|:------------| | `packs` | array | yes | An array of purchased minutes packs | | `packs[expires_at]` | date | yes | Expiry date of the purchased pack| | `packs[number_of_minutes]` | integer | yes | Number of additional minutes | | `packs[purchase_xid]` | string | yes | The unique ID of the purchase | Example request: ```shell curl --request POST \ --url "http://localhost:3000/api/v4/namespaces/123/minutes" \ --header 'Content-Type: application/json' \ --header 'PRIVATE-TOKEN: ' \ --data '{ "packs": [ { "number_of_minutes": 10000, "expires_at": "2022-01-01", "purchase_xid": "46952fe69bebc1a4de10b2b4ff439d0c" } ] }' ``` Example response: ```json [ { "namespace_id": 123, "expires_at": "2022-01-01", "number_of_minutes": 10000, "purchase_xid": "46952fe69bebc1a4de10b2b4ff439d0c" } ] ``` ### Moving additional packs Use a `PATCH` to move additional packs from one namespace to another. ```plaintext PATCH /namespaces/:id/minutes/move/:target_id ``` | Attribute | Type | Required | Description | |:------------|:--------|:---------|:------------| | `id` | string | yes | The ID of the namespace to transfer packs from | | `target_id` | string | yes | The ID of the target namespace to transfer the packs to | Example request: ```shell curl --request PATCH \ --url "http://localhost:3000/api/v4/namespaces/123/minutes/move/321" \ --header 'PRIVATE-TOKEN: ' ``` Example response: ```json { "message": "202 Accepted" } ``` ### Known consumers - CustomersDot ## Upcoming reconciliations The `upcoming_reconciliations` endpoint is used by [CustomersDot](https://gitlab.com/gitlab-org/customers-gitlab-com) (`customers.gitlab.com`) to update upcoming reconciliations for namespaces. ### Updating `upcoming_reconciliations` Use a PUT command to update `upcoming_reconciliations`. ```plaintext PUT /internal/upcoming_reconciliations ``` | Attribute | Type | Required | Description | |:-------------------|:-----------|:---------|:------------| | `upcoming_reconciliations` | array | yes | Array of upcoming reconciliations | Each array element contains: | Attribute | Type | Required | Description | |:-------------------|:-----------|:---------|:------------| | `namespace_id` | integer | yes | ID of the namespace to be reconciled | | `next_reconciliation_date` | date | yes | Date of the next reconciliation | | `display_alert_from` | date | yes | Start date to display alert of upcoming reconciliation | Example request: ```shell curl --request PUT --header "PRIVATE-TOKEN: " --header "Content-Type: application/json" \ --data '{"upcoming_reconciliations": [{"namespace_id": 127, "next_reconciliation_date": "13 Jun 2021", "display_alert_from": "06 Jun 2021"}, {"namespace_id": 129, "next_reconciliation_date": "12 Jun 2021", "display_alert_from": "05 Jun 2021"}]}' \ "https://gitlab.com/api/v4/internal/upcoming_reconciliations" ``` Example response: ```plaintext 200 ``` ### Deleting an `upcoming_reconciliation` Use a DELETE command to delete an `upcoming_reconciliation`. ```plaintext DELETE /internal/upcoming_reconciliations ``` | Attribute | Type | Required | Description | |:---------------|:--------|:---------|:----------------------------------------------------------------------------------| | `namespace_id` | integer | yes | The ID of the GitLab.com namespace that no longer has an upcoming reconciliation. | Example request: ```shell curl --request DELETE \ --url "http://localhost:3000/api/v4/internal/upcoming_reconciliations?namespace_id=22" \ --header 'PRIVATE-TOKEN: ' ``` Example response: ```plaintext 204 ``` ### Known consumers - CustomersDot ## Group SCIM API **(PREMIUM SAAS)** > [Introduced](https://gitlab.com/gitlab-org/gitlab/-/merge_requests/9388) in GitLab 11.10. The group SCIM API implements the [RFC7644 protocol](https://www.rfc-editor.org/rfc/rfc7644). As this API is for **system** use for SCIM provider integration, it is subject to change without notice. To use this API, enable [Group SSO](../../user/group/saml_sso/index.md) for the group. This API is only in use where [SCIM for Group SSO](../../user/group/saml_sso/scim_setup.md) is enabled. It's a prerequisite to the creation of SCIM identities. This API is different to the [main SCIM API](../../api/scim.md) and the [instance SCIM API](#instance-scim-api). ### Get a list of SCIM provisioned users This endpoint is used as part of the SCIM syncing mechanism. It only returns a single user based on a unique ID which should match the `extern_uid` of the user. ```plaintext GET /api/scim/v2/groups/:group_path/Users ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `filter` | string | no | A [filter](#available-filters) expression. | | `group_path` | string | yes | Full path to the group. | | `startIndex` | integer | no | The 1-based index indicating where to start returning results from. A value of less than one is interpreted as 1. | | `count` | integer | no | Desired maximum number of query results. | NOTE: Pagination follows the [SCIM spec](https://www.rfc-editor.org/rfc/rfc7644#section-3.4.2.4) rather than GitLab pagination as used elsewhere. If records change between requests it is possible for a page to either be missing records that have moved to a different page or repeat records from a previous request. Example request: ```shell curl "https://gitlab.example.com/api/scim/v2/groups/test_group/Users?filter=id%20eq%20%220b1d561c-21ff-4092-beab-8154b17f82f2%22" \ --header "Authorization: Bearer " \ --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:api:messages:2.0:ListResponse" ], "totalResults": 1, "itemsPerPage": 20, "startIndex": 1, "Resources": [ { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ] } ``` ### Get a single SCIM provisioned user ```plaintext GET /api/scim/v2/groups/:group_path/Users/:id ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `id` | string | yes | External UID of the user. | | `group_path` | string | yes | Full path to the group. | Example request: ```shell curl "https://gitlab.example.com/api/scim/v2/groups/test_group/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ``` ### Create a SCIM provisioned user ```plaintext POST /api/scim/v2/groups/:group_path/Users/ ``` Parameters: | Attribute | Type | Required | Description | |:---------------|:----------|:----|:--------------------------| | `externalId` | string | yes | External UID of the user. | | `userName` | string | yes | Username of the user. | | `emails` | JSON string | yes | Work email. | | `name` | JSON string | yes | Name of the user. | | `meta` | string | no | Resource type (`User`). | Example request: ```shell curl --verbose --request POST "https://gitlab.example.com/api/scim/v2/groups/test_group/Users" \ --data '{"externalId":"test_uid","active":null,"userName":"username","emails":[{"primary":true,"type":"work","value":"name@example.com"}],"name":{"formatted":"Test User","familyName":"User","givenName":"Test"},"schemas":["urn:ietf:params:scim:schemas:core:2.0:User"],"meta":{"resourceType":"User"}}' \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ``` Returns a `201` status code if successful. ### Update a single SCIM provisioned user Fields that can be updated are: | SCIM/IdP field | GitLab field | |:---------------------------------|:-----------------------------------------------------------------------------| | `id/externalId` | `extern_uid` | | `name.formatted` | `name` ([Removed](https://gitlab.com/gitlab-org/gitlab/-/issues/363058)) | | `emails\[type eq "work"\].value` | `email` ([Removed](https://gitlab.com/gitlab-org/gitlab/-/issues/363058)) | | `active` | Identity removal if `active` = `false` | | `userName` | `username` ([Removed](https://gitlab.com/gitlab-org/gitlab/-/issues/363058)) | ```plaintext PATCH /api/scim/v2/groups/:group_path/Users/:id ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `id` | string | yes | External UID of the user. | | `group_path` | string | yes | Full path to the group. | | `Operations` | JSON string | yes | An [operations](#available-operations) expression. | Example request: ```shell curl --verbose --request PATCH "https://gitlab.example.com/api/scim/v2/groups/test_group/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --data '{ "Operations": [{"op":"Add","path":"name.formatted","value":"New Name"}] }' \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Returns an empty response with a `204` status code if successful. ### Remove a single SCIM provisioned user Removes the user's SSO identity and group membership. ```plaintext DELETE /api/scim/v2/groups/:group_path/Users/:id ``` Parameters: | Attribute | Type | Required | Description | | ------------ | ------ | -------- | ------------------------- | | `id` | string | yes | External UID of the user. | | `group_path` | string | yes | Full path to the group. | Example request: ```shell curl --verbose --request DELETE "https://gitlab.example.com/api/scim/v2/groups/test_group/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Returns an empty response with a `204` status code if successful. ## Instance SCIM API **(PREMIUM SELF)** > [Introduced](https://gitlab.com/gitlab-org/gitlab/-/issues/378599) in GitLab 15.8. The Instance SCIM API implements the [RFC7644 protocol](https://www.rfc-editor.org/rfc/rfc7644). As this API is for **system** use for SCIM provider integration, it is subject to change without notice. To use this API, enable [SAML SSO](../../integration/saml.md) for the instance. This API is different to the [main SCIM API](../../api/scim.md) and the [group SCIM API](#group-scim-api). ### Get a list of SCIM provisioned users This endpoint is used as part of the SCIM syncing mechanism. It only returns a single user based on a unique ID which should match the `extern_uid` of the user. ```plaintext GET /api/scim/v2/application/Users ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `filter` | string | no | A [filter](#available-filters) expression. | | `startIndex` | integer | no | The 1-based index indicating where to start returning results from. A value of less than one is interpreted as 1. | | `count` | integer | no | Desired maximum number of query results. | NOTE: Pagination follows the [SCIM spec](https://www.rfc-editor.org/rfc/rfc7644#section-3.4.2.4) rather than GitLab pagination as used elsewhere. If records change between requests it is possible for a page to either be missing records that have moved to a different page or repeat records from a previous request. Example request: ```shell curl "https://gitlab.example.com/api/scim/v2/application/Users?filter=id%20eq%20%220b1d561c-21ff-4092-beab-8154b17f82f2%22" \ --header "Authorization: Bearer " \ --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:api:messages:2.0:ListResponse" ], "totalResults": 1, "itemsPerPage": 20, "startIndex": 1, "Resources": [ { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ] } ``` ### Get a single SCIM provisioned user ```plaintext GET /api/scim/v2/application/Users/:id ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `id` | string | yes | External UID of the user. | Example request: ```shell curl "https://gitlab.example.com/api/scim/v2/application/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ``` ### Create a SCIM provisioned user ```plaintext POST /api/scim/v2/application/Users ``` Parameters: | Attribute | Type | Required | Description | |:---------------|:----------|:----|:--------------------------| | `externalId` | string | yes | External UID of the user. | | `userName` | string | yes | Username of the user. | | `emails` | JSON string | yes | Work email. | | `name` | JSON string | yes | Name of the user. | | `meta` | string | no | Resource type (`User`). | Example request: ```shell curl --verbose --request POST "https://gitlab.example.com/api/scim/v2/application/Users" \ --data '{"externalId":"test_uid","active":null,"userName":"username","emails":[{"primary":true,"type":"work","value":"name@example.com"}],"name":{"formatted":"Test User","familyName":"User","givenName":"Test"},"schemas":["urn:ietf:params:scim:schemas:core:2.0:User"],"meta":{"resourceType":"User"}}' \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Example response: ```json { "schemas": [ "urn:ietf:params:scim:schemas:core:2.0:User" ], "id": "0b1d561c-21ff-4092-beab-8154b17f82f2", "active": true, "name.formatted": "Test User", "userName": "username", "meta": { "resourceType":"User" }, "emails": [ { "type": "work", "value": "name@example.com", "primary": true } ] } ``` Returns a `201` status code if successful. ### Update a single SCIM provisioned user Fields that can be updated are: | SCIM/IdP field | GitLab field | |:---------------------------------|:-----------------------------------------------------------------------------| | `id/externalId` | `extern_uid` | | `active` | Identity removal if `active` = `false` | ```plaintext PATCH /api/scim/v2/application/Users/:id ``` Parameters: | Attribute | Type | Required | Description | |:----------|:--------|:---------|:----------------------------------------------------------------------------------------------------------------------------------------| | `id` | string | yes | External UID of the user. | | `Operations` | JSON string | yes | An [operations](#available-operations) expression. | Example request: ```shell curl --verbose --request PATCH "https://gitlab.example.com/api/scim/v2/application/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --data '{ "Operations": [{"op":"Add","path":"name.formatted","value":"New Name"}] }' \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Returns an empty response with a `204` status code if successful. ### Remove a single SCIM provisioned user The user is placed in an `ldap_blocked` status and signed out. This means the user cannot sign in or push or pull code. ```plaintext DELETE /api/scim/v2/application/Users/:id ``` Parameters: | Attribute | Type | Required | Description | | ------------ | ------ | -------- | ------------------------- | | `id` | string | yes | External UID of the user. | Example request: ```shell curl --verbose --request DELETE "https://gitlab.example.com/api/scim/v2/application/Users/f0b1d561c-21ff-4092-beab-8154b17f82f2" \ --header "Authorization: Bearer " --header "Content-Type: application/scim+json" ``` Returns an empty response with a `204` status code if successful. ### Available filters They match an expression as specified in [the RFC7644 filtering section](https://www.rfc-editor.org/rfc/rfc7644#section-3.4.2.2). | Filter | Description | | ----- | ----------- | | `eq` | The attribute matches exactly the specified value. | Example: ```plaintext id eq a-b-c-d ``` ### Available operations They perform an operation as specified in [the RFC7644 update section](https://www.rfc-editor.org/rfc/rfc7644#section-3.5.2). | Operator | Description | | ----- | ----------- | | `Replace` | The attribute's value is updated. | | `Add` | The attribute has a new value. | Example: ```json { "op": "Add", "path": "name.formatted", "value": "New Name" } ```