debian-mirror-gitlab/doc/development/documentation/site_architecture/index.md

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

265 lines
9.5 KiB
Markdown
Raw Normal View History

2019-02-15 15:39:39 +05:30
---
2021-01-29 00:20:46 +05:30
stage: none
group: unassigned
2021-02-22 17:27:13 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#assignments
2019-02-15 15:39:39 +05:30
---
# Documentation site architecture
2019-12-26 22:10:19 +05:30
The [`gitlab-docs`](https://gitlab.com/gitlab-org/gitlab-docs) project hosts
the repository which is used to generate the GitLab documentation website and
2021-09-30 23:02:18 +05:30
is deployed to <https://docs.gitlab.com>. It uses the [Nanoc](https://nanoc.app/)
2019-12-26 22:10:19 +05:30
static site generator.
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
## Architecture
2019-02-15 15:39:39 +05:30
2021-02-22 17:27:13 +05:30
While the source of the documentation content is stored in the repositories for
each GitLab product, the source that is used to build the documentation
2019-12-26 22:10:19 +05:30
site _from that content_ is located at <https://gitlab.com/gitlab-org/gitlab-docs>.
2019-09-30 21:07:59 +05:30
The following diagram illustrates the relationship between the repositories
from where content is sourced, the `gitlab-docs` project, and the published output.
```mermaid
graph LR
2022-07-16 23:28:13 +05:30
A[gitlab-org/gitlab/doc]
B[gitlab-org/gitlab-runner/docs]
C[gitlab-org/omnibus-gitlab/doc]
D[gitlab-org/charts/gitlab/doc]
E[gitlab-org/cloud-native/gitlab-operator/doc]
Y[gitlab-org/gitlab-docs]
A --> Y
B --> Y
C --> Y
D --> Y
E --> Y
Y -- Build pipeline --> Z
Z[docs.gitlab.com]
M[//ee/]
N[//runner/]
O[//omnibus/]
P[//charts/]
Q[//operator/]
Z --> M
Z --> N
Z --> O
Z --> P
Z --> Q
2019-09-30 21:07:59 +05:30
```
2021-02-22 17:27:13 +05:30
GitLab docs content isn't kept in the `gitlab-docs` repository.
2019-12-26 22:10:19 +05:30
All documentation files are hosted in the respective repository of each
product, and all together are pulled to generate the docs website:
2021-09-04 01:27:46 +05:30
- [GitLab](https://gitlab.com/gitlab-org/gitlab/-/tree/master/doc)
2022-07-16 23:28:13 +05:30
- [Omnibus GitLab](https://gitlab.com/gitlab-org/omnibus-gitlab/-/tree/master/doc)
2021-09-04 01:27:46 +05:30
- [GitLab Runner](https://gitlab.com/gitlab-org/gitlab-runner/-/tree/main/docs)
2022-07-16 23:28:13 +05:30
- [GitLab Chart](https://gitlab.com/gitlab-org/charts/gitlab/-/tree/master/doc)
- [GitLab Operator](https://gitlab.com/gitlab-org/cloud-native/gitlab-operator/-/tree/master/doc)
2019-12-26 22:10:19 +05:30
2022-04-04 11:22:00 +05:30
Learn more about [the docs folder structure](folder_structure.md).
2022-08-13 15:12:31 +05:30
### Documentation in other repositories
If you have code and documentation in a repository other than the [primary repositories](#architecture),
you should keep the documentation with the code in that repository.
Then you can either:
- [Add the repository to the list of products](https://gitlab.com/gitlab-org/gitlab-docs/-/blob/main/doc/development.md#add-a-new-product)
published at <https://docs.gitlab.com>.
- [Add an entry in the global navigation](global_nav.md#add-a-navigation-entry) for
<https://docs.gitlab.com> that links to the documentation in that repository.
View [an example](https://gitlab.com/gitlab-org/gitlab-docs/-/blob/fedb6378a3c92274ba3b6031df0d34455594e4cc/content/_data/navigation.yaml#L2944-L2946).
2019-02-15 15:39:39 +05:30
## Assets
To provide an optimized site structure, design, and a search-engine friendly
website, along with a discoverable documentation, we use a few assets for
the GitLab Documentation website.
2022-04-04 11:22:00 +05:30
### External libraries
GitLab Docs is built with a combination of external:
2019-02-15 15:39:39 +05:30
2022-04-04 11:22:00 +05:30
- [JavaScript libraries](https://gitlab.com/gitlab-org/gitlab-docs/-/blob/main/package.json).
- [Ruby libraries](https://gitlab.com/gitlab-org/gitlab-docs/-/blob/main/Gemfile).
2019-02-15 15:39:39 +05:30
### SEO
- [Schema.org](https://schema.org/)
- [Google Analytics](https://marketingplatform.google.com/about/analytics/)
2022-06-21 17:19:12 +05:30
- [Google Tag Manager](https://developers.google.com/tag-platform/tag-manager)
2019-02-15 15:39:39 +05:30
2019-12-04 20:38:33 +05:30
## Global navigation
2019-02-15 15:39:39 +05:30
2019-12-21 20:55:43 +05:30
Read through [the global navigation documentation](global_nav.md) to understand:
2019-12-04 20:38:33 +05:30
- How the global navigation is built.
- How to add new navigation items.
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
<!--
## Helpers
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
TBA
-->
2019-02-15 15:39:39 +05:30
2020-04-08 14:13:33 +05:30
## Pipelines
The pipeline in the `gitlab-docs` project:
- Tests changes to the docs site code.
- Builds the Docker images used in various pipeline jobs.
- Builds and deploys the docs site itself.
- Generates the review apps when the `review-docs-deploy` job is triggered.
### Rebuild the docs site Docker images
Once a week on Mondays, a scheduled pipeline runs and rebuilds the Docker images
used in various pipeline jobs, like `docs-lint`. The Docker image configuration files are
2022-04-04 11:22:00 +05:30
located in the [Dockerfiles directory](https://gitlab.com/gitlab-org/gitlab-docs/-/tree/main/dockerfiles).
2020-04-08 14:13:33 +05:30
If you need to rebuild the Docker images immediately (must have maintainer level permissions):
2021-02-22 17:27:13 +05:30
WARNING:
2021-09-04 01:27:46 +05:30
If you change the Dockerfile configuration and rebuild the images, you can break the main
2020-06-23 00:09:42 +05:30
pipeline in the main `gitlab` repository as well as in `gitlab-docs`. Create an image with
2020-04-08 14:13:33 +05:30
a different name first and test it to ensure you do not break the pipelines.
2021-04-17 20:07:23 +05:30
1. In [`gitlab-docs`](https://gitlab.com/gitlab-org/gitlab-docs), go to **{rocket}** **CI/CD > Pipelines**.
2022-07-23 23:45:48 +05:30
1. Select **Run pipeline**.
2020-04-08 14:13:33 +05:30
1. See that a new pipeline is running. The jobs that build the images are in the first
2022-07-23 23:45:48 +05:30
stage, `build-images`. You can select the pipeline number to see the larger pipeline
graph, or select the first (`build-images`) stage in the mini pipeline graph to
2020-04-08 14:13:33 +05:30
expose the jobs that build the images.
2022-07-23 23:45:48 +05:30
1. Select the **play** (**{play}**) button next to the images you want to rebuild.
2020-04-08 14:13:33 +05:30
- Normally, you do not need to rebuild the `image:gitlab-docs-base` image, as it
rarely changes. If it does need to be rebuilt, be sure to only run `image:docs-lint`
after it is finished rebuilding.
### Deploy the docs site
Every four hours a scheduled pipeline builds and deploys the docs site. The pipeline
2021-09-04 01:27:46 +05:30
fetches the current docs from the main project's main branch, builds it with Nanoc
2020-04-08 14:13:33 +05:30
and deploys it to <https://docs.gitlab.com>.
2021-12-11 22:18:48 +05:30
To build and deploy the site immediately (must have the Maintainer role):
2020-04-08 14:13:33 +05:30
2021-04-17 20:07:23 +05:30
1. In [`gitlab-docs`](https://gitlab.com/gitlab-org/gitlab-docs), go to **{rocket}** **CI/CD > Schedules**.
2022-07-23 23:45:48 +05:30
1. For the `Build docs.gitlab.com every 4 hours` scheduled pipeline, select the **play** (**{play}**) button.
2020-04-08 14:13:33 +05:30
2021-12-11 22:18:48 +05:30
Read more about [documentation deployments](deployment_process.md).
2020-10-24 23:57:45 +05:30
2019-12-26 22:10:19 +05:30
## Using YAML data files
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
The easiest way to achieve something similar to
[Jekyll's data files](https://jekyllrb.com/docs/datafiles/) in Nanoc is by
2021-09-30 23:02:18 +05:30
using the [`@items`](https://nanoc.app/doc/reference/variables/#items-and-layouts)
2019-12-26 22:10:19 +05:30
variable.
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
The data file must be placed inside the `content/` directory and then it can
be referenced in an ERB template.
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
Suppose we have the `content/_data/versions.yaml` file with the content:
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
```yaml
versions:
2020-07-28 23:09:34 +05:30
- 10.6
- 10.5
- 10.4
2019-12-26 22:10:19 +05:30
```
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
We can then loop over the `versions` array with something like:
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
```erb
<% @items['/_data/versions.yaml'][:versions].each do | version | %>
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
<h3><%= version %></h3>
2019-02-15 15:39:39 +05:30
2019-12-26 22:10:19 +05:30
<% end &>
```
Note that the data file must have the `yaml` extension (not `yml`) and that
we reference the array with a symbol (`:versions`).
2021-12-11 22:18:48 +05:30
## Archived documentation banner
A banner is displayed on archived documentation pages with the text `This is archived documentation for
GitLab. Go to the latest.` when either:
- The version of the documentation displayed is not the first version entry in `online` in
`content/_data/versions.yaml`.
- The documentation was built from the default branch (`main`).
For example, if the `online` entries for `content/_data/versions.yaml` are:
```yaml
online:
- "14.4"
- "14.3"
- "14.2"
```
In this case, the archived documentation banner isn't displayed:
- For 14.4, the docs built from the `14.4` branch. The branch name is the first entry in `online`.
- For 14.5-pre, the docs built from the default project branch (`main`).
The archived documentation banner is displayed:
- For 14.3.
- For 14.2.
- For any other version.
2020-01-01 13:55:28 +05:30
## Bumping versions of CSS and JavaScript
2019-12-26 22:10:19 +05:30
2020-01-01 13:55:28 +05:30
Whenever the custom CSS and JavaScript files under `content/assets/` change,
2020-06-23 00:09:42 +05:30
make sure to bump their version in the front matter. This method guarantees that
2021-02-22 17:27:13 +05:30
your changes take effect by clearing the cache of previous files.
2019-12-26 22:10:19 +05:30
Always use Nanoc's way of including those files, do not hardcode them in the
layouts. For example use:
```erb
<script async type="application/javascript" src="<%= @items['/assets/javascripts/badges.*'].path %>"></script>
<link rel="stylesheet" href="<%= @items['/assets/stylesheets/toc.*'].path %>">
```
The links pointing to the files should be similar to:
```erb
<%= @items['/path/to/assets/file.*'].path %>
```
2021-02-22 17:27:13 +05:30
Nanoc then builds and renders those links correctly according with what's
2021-09-04 01:27:46 +05:30
defined in [`Rules`](https://gitlab.com/gitlab-org/gitlab-docs/blob/main/Rules).
2019-12-26 22:10:19 +05:30
## Linking to source files
2021-09-04 01:27:46 +05:30
A helper called [`edit_on_gitlab`](https://gitlab.com/gitlab-org/gitlab-docs/blob/main/lib/helpers/edit_on_gitlab.rb) can be used
2019-12-26 22:10:19 +05:30
to link to a page's source file. We can link to both the simple editor and the
web IDE. Here's how you can use it in a Nanoc layout:
- Default editor: `<a href="<%= edit_on_gitlab(@item, editor: :simple) %>">Simple editor</a>`
- Web IDE: `<a href="<%= edit_on_gitlab(@item, editor: :webide) %>">Web IDE</a>`
If you don't specify `editor:`, the simple one is used by default.
## Algolia search engine
2020-06-23 00:09:42 +05:30
The docs site uses [Algolia DocSearch](https://community.algolia.com/docsearch/)
2022-07-16 23:28:13 +05:30
for its search function.
Learn more in <https://gitlab.com/gitlab-org/gitlab-docs/-/blob/main/doc/docsearch.md>.
2019-12-26 22:10:19 +05:30
## Monthly release process (versions)
The docs website supports versions and each month we add the latest one to the list.
2021-11-18 22:05:49 +05:30
For more information, read about the [monthly release process](https://gitlab.com/gitlab-org/gitlab-docs/-/blob/main/doc/releases.md).
2019-12-26 22:10:19 +05:30
## Review Apps for documentation merge requests
If you are contributing to GitLab docs read how to [create a Review App with each
merge request](../index.md#previewing-the-changes-live).