debian-mirror-gitlab/doc/administration/repository_storage_paths.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

176 lines
6.7 KiB
Markdown
Raw Normal View History

2020-07-28 23:09:34 +05:30
---
2022-08-13 15:12:31 +05:30
stage: Systems
2020-07-28 23:09:34 +05:30
group: Gitaly
2022-11-25 23:54:43 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/product/ux/technical-writing/#assignments
2020-07-28 23:09:34 +05:30
---
2021-03-11 19:13:27 +05:30
# Repository storage **(FREE SELF)**
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
GitLab stores [repositories](../user/project/repository/index.md) on repository storage. Repository
storage is either:
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
- A `gitaly_address`, which points to a [Gitaly node](gitaly/index.md).
2021-11-18 22:05:49 +05:30
- A `path`, which points directly to the directory where the repositories are stored. GitLab
directly accessing a directory containing repositories
[is deprecated](https://gitlab.com/gitlab-org/gitaly/-/issues/1690).
2021-12-11 22:18:48 +05:30
GitLab should be configured to access GitLab repositories through a `gitaly_address`.
2019-02-15 15:39:39 +05:30
2021-03-11 19:13:27 +05:30
GitLab allows you to define multiple repository storages to distribute the storage load between
several mount points. For example:
2019-02-15 15:39:39 +05:30
2021-03-11 19:13:27 +05:30
- When using Gitaly (Omnibus GitLab-style configuration):
```ruby
git_data_dirs({
'default' => { 'gitaly_address' => 'tcp://gitaly1.internal:8075' },
2021-04-17 20:07:23 +05:30
'storage2' => { 'gitaly_address' => 'tcp://gitaly2.internal:8075' },
2021-03-11 19:13:27 +05:30
})
```
2019-02-15 15:39:39 +05:30
2021-03-11 19:13:27 +05:30
- When using direct repository storage (source install-style configuration):
2019-02-15 15:39:39 +05:30
2021-03-11 19:13:27 +05:30
```plaintext
default:
2021-04-17 20:07:23 +05:30
gitaly_address: tcp://gitaly1.example:8075
2021-03-11 19:13:27 +05:30
storage2:
2021-04-17 20:07:23 +05:30
gitaly_address: tcp://gitaly2.example:8075
2021-03-11 19:13:27 +05:30
```
2021-04-17 20:07:23 +05:30
For more information on:
2021-03-11 19:13:27 +05:30
- Configuring Gitaly, see [Configure Gitaly](gitaly/index.md#configure-gitaly).
- Configuring direct repository access, see the following section below.
## Configure repository storage paths
2021-04-17 20:07:23 +05:30
WARNING:
The following information is for configuring GitLab to directly access repositories. This
configuration option is deprecated in favor of using [Gitaly](gitaly/index.md) and is scheduled to
[be removed in GitLab 14.0](https://gitlab.com/gitlab-org/gitaly/-/issues/1690).
2021-03-11 19:13:27 +05:30
To configure repository storage paths:
1. Edit the necessary configuration files:
- `/etc/gitlab/gitlab.rb`, for Omnibus GitLab installations.
- `gitlab.yml`, for installations from source.
1. Add the required repository storage paths.
For repository storage paths:
- You must have at least one storage path called `default`.
- The paths are defined in key-value pairs. Apart from `default`, the key can be any name you choose
to name the file path.
- The target directories and any of its sub paths must not be a symlink.
- No target directory may be a sub-directory of another. That is, no nesting. For example, the
following configuration is invalid:
```plaintext
default:
path: /mnt/git-storage-1
storage2:
path: /mnt/git-storage-1/git-storage-2 # <- NOT OK because of nesting
```
### Configure for backups
For [backups](../raketasks/backup_restore.md) to work correctly:
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
- The repository storage path cannot be a mount point.
- The GitLab user must have correct permissions for the parent directory of the path.
Omnibus GitLab takes care of these issues for you, but for source installations you should be extra
careful.
2021-04-17 20:07:23 +05:30
While restoring a backup, the current contents of `/home/git/repositories` are moved to
2021-03-11 19:13:27 +05:30
`/home/git/repositories.old`. If `/home/git/repositories` is a mount point, then `mv` would be
moving things between mount points, and problems can occur.
Ideally, `/home/git` is the mount point, so things remain inside the same mount point. Omnibus
GitLab installations guarantee this because they don't specify the full repository path but instead
the parent path, but source installations do not.
### Example configuration
In the examples below, we add two additional repository storage paths configured to two additional
mount points.
For compatibility reasons `gitlab.yml` has a different structure than Omnibus GitLab configuration:
- In `gitlab.yml`, you indicate the path for the repositories, for example `/home/git/repositories`
- In Omnibus GitLab configuration you indicate `git_data_dirs`, which could be `/home/git` for
example. Then Omnibus GitLab creates a `repositories` directory under that path to use with
`gitlab.yml`.
2017-08-17 22:00:37 +05:30
**For installations from source**
1. Edit `gitlab.yml` and add the storage paths:
2019-09-30 21:07:59 +05:30
```yaml
repositories:
# Paths where repositories can be stored. Give the canonicalized absolute pathname.
# NOTE: REPOS PATHS MUST NOT CONTAIN ANY SYMLINK!!!
2021-03-11 19:13:27 +05:30
storages: # You must have at least a 'default' repository storage path.
2019-09-30 21:07:59 +05:30
default:
path: /home/git/repositories
2021-04-17 20:07:23 +05:30
storage1:
path: /mnt/storage1/repositories
storage2:
path: /mnt/storage2/repositories
2019-09-30 21:07:59 +05:30
```
2017-08-17 22:00:37 +05:30
2020-05-24 23:13:21 +05:30
1. [Restart GitLab](restart_gitlab.md#installations-from-source) for the changes to take effect.
2017-08-17 22:00:37 +05:30
2021-10-27 15:23:28 +05:30
1. [Configure where new repositories are stored](#configure-where-new-repositories-are-stored).
2017-08-17 22:00:37 +05:30
**For Omnibus installations**
2021-10-27 15:23:28 +05:30
1. Edit `/etc/gitlab/gitlab.rb` by appending the rest of the paths to the default one:
```ruby
git_data_dirs({
"default" => { "path" => "/var/opt/gitlab/git-data" },
"storage1" => { "path" => "/mnt/storage1/git-data" },
"storage2" => { "path" => "/mnt/storage2/git-data" }
})
```
1. [Restart GitLab](restart_gitlab.md#omnibus-gitlab-reconfigure) for the changes to take effect.
2017-08-17 22:00:37 +05:30
2021-10-27 15:23:28 +05:30
1. [Configure where new repositories are stored](#configure-where-new-repositories-are-stored).
2021-03-11 19:13:27 +05:30
NOTE:
Omnibus stores the repositories in a `repositories` subdirectory of the `git-data` directory.
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
## Configure where new repositories are stored
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
After you [configure](#configure-repository-storage-paths) multiple repository storage paths, you
can choose where new repositories are stored:
2017-08-17 22:00:37 +05:30
2022-10-11 01:57:18 +05:30
1. On the top bar, select **Main menu > Admin**.
2021-09-04 01:27:46 +05:30
1. On the left sidebar, select **Settings > Repository** and expand the **Repository storage**
section.
2021-03-11 19:13:27 +05:30
1. Enter values in the **Storage nodes for new repositories** fields.
1. Select **Save changes**.
2017-08-17 22:00:37 +05:30
2021-03-11 19:13:27 +05:30
Each repository storage path can be assigned a weight from 0-100. When a new project is created,
2021-09-30 23:02:18 +05:30
these weights are used to determine the storage location the repository is created on.
2020-07-28 23:09:34 +05:30
2021-09-30 23:02:18 +05:30
The higher the weight of a given repository storage path relative to other repository storages
paths, the more often it is chosen. That is,
`(storage weight) / (sum of all weights) * 100 = chance %`.
2017-08-17 22:00:37 +05:30
2021-10-27 15:23:28 +05:30
By default, if repository weights have not been configured earlier:
- `default` is weighted `100`.
- All other storages are weighted `0`.
NOTE:
If all storage weights are `0` (for example, when `default` does not exist), GitLab attempts to
create new repositories on `default`, regardless of the configuration or if `default` exists.
See [the tracking issue](https://gitlab.com/gitlab-org/gitlab/-/issues/36175) for more information.
2021-03-11 19:13:27 +05:30
## Move repositories
2021-03-08 18:12:59 +05:30
2021-09-30 23:02:18 +05:30
To move a repository to a different repository storage (for example, from `default` to `storage2`), use the
2022-07-23 23:45:48 +05:30
same process as [migrating to Gitaly Cluster](gitaly/index.md#migrate-to-gitaly-cluster).