2021-11-18 22:05:49 +05:30
---
stage: Create
group: Source Code
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#assignments
disqus_identifier: 'https://docs.gitlab.com/ee/workflow/repository_mirroring.html'
---
# Repository mirroring **(FREE)**
2021-12-11 22:18:48 +05:30
You can _mirror_ a repository to and from external sources. You can select which
repository serves as the source, and modify which parts of the repository are copied.
Branches, tags, and commits can be mirrored.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
Several mirroring methods exist:
2021-11-18 22:05:49 +05:30
- [Push ](push.md ): for mirroring a GitLab repository to another location.
- [Pull ](pull.md ): for mirroring a repository from another location to GitLab.
2021-12-11 22:18:48 +05:30
- [Bidirectional ](bidirectional.md ) mirroring is also available, but can cause conflicts.
Mirror a repository when:
- The canonical version of your project has migrated to GitLab. To keep providing a
copy of your project at its previous home, configure your GitLab repository as a
[push mirror ](push.md ). Changes you make to your GitLab repository are copied to
the old location.
- Your GitLab project is private, but some components can be shared publicly.
Configure your primary repository as a [push mirror ](push.md ) and push the portions
you want to make public. With this configuration, you can open-source specific
projects, contribute back to the open-source community, and protect the sensitive
parts of your project.
- You migrated to GitLab, but the canonical version of your project is somewhere else.
Configure your GitLab repository as a [pull mirror ](pull.md ) of the other project.
Your GitLab repository pulls copies of the commits, tags, and branches of project.
They become available to use on GitLab.
## Create a repository mirror
Prerequisite:
2022-04-04 11:22:00 +05:30
- You must have at least the Maintainer role for the project.
2021-12-11 22:18:48 +05:30
- If your mirror connects with `ssh://` , the host key must be detectable on the server,
or you must have a local copy of the key.
1. On the top bar, select **Menu > Projects** and find your project.
1. On the left sidebar, select **Settings > Repository** .
1. Expand **Mirroring repositories** .
1. Enter a **Git repository URL** . For security reasons, the URL to the original
2022-04-04 11:22:00 +05:30
repository is only displayed to users with the Maintainer role
or the Owner role for the mirrored project.
2021-12-11 22:18:48 +05:30
1. Select a **Mirror direction** .
1. If you entered a `ssh://` URL, select either:
- **Detect host keys**: GitLab fetches the host keys from the server and displays the fingerprints.
- **Input host keys manually**, and enter the host key into **SSH host key** .
When mirroring the repository, GitLab confirms at least one of the stored host keys
matches before connecting. This check can protect your mirror from malicious code injections,
or your password from being stolen.
1. Select an **Authentication method** . To learn more, read
[Authentication methods for mirrors ](#authentication-methods-for-mirrors ).
1. If you authenticate with SSH host keys, [verify the host key ](#verify-a-host-key )
to ensure it is correct.
1. To prevent force-pushing over diverged refs, select [**Keep divergent refs** ](push.md#keep-divergent-refs ).
1. Optional. Select [**Mirror only protected branches** ](#mirror-only-protected-branches ).
1. Select **Mirror repository** .
If you select `SSH public key` as your authentication method, GitLab generates a
public key for your GitLab repository. You must provide this key to the non-GitLab server.
To learn more, read [Get your SSH public key ](#get-your-ssh-public-key ).
## Update a mirror
2021-11-18 22:05:49 +05:30
When the mirror repository is updated, all new branches, tags, and commits are visible in the
2021-12-11 22:18:48 +05:30
project's activity feed. A repository mirror at GitLab updates automatically.
You can also manually trigger an update:
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
- At most once every five minutes on GitLab.com.
- According to [the pull mirroring interval limit ](../../../../administration/instance_limits.md#pull-mirroring-interval )
set by the administrator on self-managed instances.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
### Force an update
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
While mirrors are scheduled to update automatically, you can force an immediate update unless:
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
- The mirror is already being updated.
- The [interval, in seconds ](../../../../administration/instance_limits.md#pull-mirroring-interval )
for pull mirroring limits has not elapsed after its last update.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
Prerequisite:
2021-11-18 22:05:49 +05:30
2022-04-04 11:22:00 +05:30
- You must have at least the Maintainer role for the project.
2021-12-11 22:18:48 +05:30
1. On the top bar, select **Menu > Projects** and find your project.
1. On the left sidebar, select **Settings > Repository** .
1. Expand **Mirroring repositories** .
1. Scroll to **Mirrored repositories** and identify the mirror to update.
1. Select **Update now** (**{retry}**):
![Repository mirroring force update user interface ](img/repository_mirroring_force_update.png )
2021-11-18 22:05:49 +05:30
## Mirror only protected branches **(PREMIUM)**
> Moved to GitLab Premium in 13.9.
2021-12-11 22:18:48 +05:30
You can choose to mirror only the
2021-11-18 22:05:49 +05:30
[protected branches ](../../protected_branches.md ) in the mirroring project,
2021-12-11 22:18:48 +05:30
either from or to your remote repository. For [pull mirroring ](pull.md ),
non-protected branches in the mirroring project are not mirrored and can diverge.
To use this option, select **Only mirror protected branches** when you create a repository mirror.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
## Authentication methods for mirrors
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
When you create a mirror, you must configure the authentication method for it.
GitLab supports these authentication methods:
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
- [SSH authentication ](#ssh-authentication ).
- Password.
### SSH authentication
2021-11-18 22:05:49 +05:30
SSH authentication is mutual:
2021-12-11 22:18:48 +05:30
- You must prove to the server that you're allowed to access the repository.
- The server must also *prove to you* that it's who it claims to be.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
For SSH authentication, you provide your credentials as a password or _public key_ .
The server that the other repository resides on provides its credentials as a _host key_ .
You must [verify the fingerprint ](#verify-a-host-key ) of this host key manually.
2021-11-18 22:05:49 +05:30
If you're mirroring over SSH (using an `ssh://` URL), you can authenticate using:
- Password-based authentication, just as over HTTPS.
2021-12-11 22:18:48 +05:30
- Public key authentication. This method is often more secure than password authentication,
2021-11-18 22:05:49 +05:30
especially when the other repository supports [deploy keys ](../../deploy_keys/index.md ).
2021-12-11 22:18:48 +05:30
### Get your SSH public key
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
When you mirror a repository and select the **SSH public key** as your
authentication method, GitLab generates a public key for you. The non-GitLab server
needs this key to establish trust with your GitLab repository. To copy your SSH public key:
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
1. On the top bar, select **Menu > Projects** and find your project.
1. On the left sidebar, select **Settings > Repository** .
1. Expand **Mirroring repositories** .
1. Scroll to **Mirrored repositories** .
1. Identify the correct repository, and select **Copy SSH public key** (**{copy-to-clipboard}**).
1. Add the public SSH key to the other repository's configuration:
- If the other repository is hosted on GitLab, add the public SSH key
as a [deploy key ](../../../project/deploy_keys/index.md ).
- If the other repository is hosted elsewhere, add the key to
your user's `authorized_keys` file. Paste the entire public SSH key into the
file on its own line and save it.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
If you must change the key at any time, you can remove and re-add the mirror
to generate a new key. Update the other repository with the new
key to keep the mirror running.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
NOTE:
The generated keys are stored in the GitLab database, not in the file system. Therefore,
SSH public key authentication for mirrors cannot be used in a pre-receive hook.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
### Verify a host key
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
When using a host key, always verify the fingerprints match what you expect.
GitLab.com and other code hosting sites publish their fingerprints
for you to check:
2021-11-18 22:05:49 +05:30
- [AWS CodeCommit ](https://docs.aws.amazon.com/codecommit/latest/userguide/regions.html#regions-fingerprints )
- [Bitbucket ](https://support.atlassian.com/bitbucket-cloud/docs/configure-ssh-and-two-step-verification/ )
- [GitHub ](https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/githubs-ssh-key-fingerprints )
- [GitLab.com ](../../../gitlab_com/index.md#ssh-host-keys-fingerprints )
- [Launchpad ](https://help.launchpad.net/SSHFingerprints )
- [Savannah ](http://savannah.gnu.org/maintenance/SshAccess/ )
- [SourceForge ](https://sourceforge.net/p/forge/documentation/SSH%20Key%20Fingerprints/ )
2021-12-11 22:18:48 +05:30
Other providers vary. You can securely gather key fingerprints with the following
command if you:
- Run self-managed GitLab.
- Have access to the server for the other repository.
2021-11-18 22:05:49 +05:30
```shell
$ cat /etc/ssh/ssh_host*pub | ssh-keygen -E md5 -l -f -
256 MD5:f4:28:9f:23:99:15:21:1b:bf:ed:1f:8e:a0:76:b2:9d root@example.com (ECDSA)
256 MD5:e6:eb:45:8a:3c:59:35:5f:e9:5b:80:12:be:7e:22:73 root@example.com (ED25519)
2048 MD5:3f:72:be:3d:62:03:5c:62:83:e8:6e:14:34:3a:85:1d root@example.com (RSA)
```
2021-12-11 22:18:48 +05:30
Older versions of SSH may require you to remove `-E md5` from the command.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
## Related topics
2021-11-18 22:05:49 +05:30
- Configure a [Pull Mirroring Interval ](../../../../administration/instance_limits.md#pull-mirroring-interval )
- [Disable mirrors for a project ](../../../admin_area/settings/visibility_and_access_controls.md#enable-project-mirroring )
- [Secrets file and mirroring ](../../../../raketasks/backup_restore.md#when-the-secrets-file-is-lost )
## Troubleshooting
Should an error occur during a push, GitLab displays an **Error** highlight for that repository. Details on the error can then be seen by hovering over the highlight text.
2021-12-11 22:18:48 +05:30
### Received RST_STREAM with error code 2 with GitHub
If you receive this message while mirroring to a GitHub repository:
```plaintext
13:Received RST_STREAM with error code 2
```
Your GitHub settings might be set to block pushes that expose your email address
used in commits. To fix this problem, either:
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
- Set your GitHub email address to public.
- Disable the [Block command line pushes that expose my email ](https://github.com/settings/emails ) setting.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
### Deadline Exceeded
2021-11-18 22:05:49 +05:30
2022-03-02 08:16:31 +05:30
When upgrading GitLab, a change in how usernames are represented means that you
2021-11-18 22:05:49 +05:30
must update your mirroring username and password to ensure that `%40` characters are replaced with `@` .
### Connection blocked because server only allows public key authentication
2021-12-11 22:18:48 +05:30
The connection between GitLab and the remote repository is blocked. Even if a
[TCP Check ](../../../../administration/raketasks/maintenance.md#check-tcp-connectivity-to-a-remote-site )
is successful, you must check any networking components in the route from GitLab
to the remote server for blockage.
2021-11-18 22:05:49 +05:30
2021-12-11 22:18:48 +05:30
This error can occur when a firewall performs a `Deep SSH Inspection` on outgoing packets.
2021-11-18 22:05:49 +05:30
### Could not read username: terminal prompts disabled
If you receive this error after creating a new project using
[GitLab CI/CD for external repositories ](../../../../ci/ci_cd_for_external_repos/ ):
```plaintext
2021-12-11 22:18:48 +05:30
"2:fetch remote: "fatal: could not read Username for 'https://bitbucket.org':
terminal prompts disabled\n": exit status 128."
2021-11-18 22:05:49 +05:30
```
Check if the repository owner is specified in the URL of your mirrored repository:
2021-12-11 22:18:48 +05:30
1. On the top bar, select **Menu > Projects** and find your project.
2021-11-18 22:05:49 +05:30
1. On the left sidebar, select **Settings > Repository** .
2021-12-11 22:18:48 +05:30
1. Expand **Mirroring repositories** .
1. If no repository owner is specified, delete and add the URL again in this format,
replacing `OWNER` , `ACCOUNTNAME` , and `REPONAME` with your values:
2021-11-18 22:05:49 +05:30
```plaintext
2021-12-11 22:18:48 +05:30
https://OWNER@bitbucket.org/ACCOUNTNAME/REPONAME.git
2021-11-18 22:05:49 +05:30
```
2021-12-11 22:18:48 +05:30
When connecting to the repository for mirroring, Bitbucket requires the repository owner in the string.
2021-11-18 22:05:49 +05:30
### Pull mirror is missing LFS files
In some cases, pull mirroring does not transfer LFS files. This issue occurs when:
- You use an SSH repository URL. The workaround is to use an HTTPS repository URL instead.
2021-12-11 22:18:48 +05:30
An issue exists [to fix this problem for SSH URLs ](https://gitlab.com/gitlab-org/gitlab/-/issues/11997 ).
2021-11-18 22:05:49 +05:30
- You're using GitLab 14.0 or older, and the source repository is a public Bitbucket URL.
2021-12-11 22:18:48 +05:30
[Fixed ](https://gitlab.com/gitlab-org/gitlab/-/issues/335123 ) in GitLab 14.0.6.
2021-11-18 22:05:49 +05:30
- You mirror an external repository using object storage.
2021-12-11 22:18:48 +05:30
An issue exists [to fix this problem ](https://gitlab.com/gitlab-org/gitlab/-/issues/335495 ).