debian-mirror-gitlab/doc/user/project/clusters/runbooks/index.md

221 lines
9 KiB
Markdown
Raw Normal View History

2020-05-24 23:13:21 +05:30
---
stage: Configure
group: Configure
2021-02-22 17:27:13 +05:30
info: To determine the technical writer assigned to the Stage/Group associated with this page, see https://about.gitlab.com/handbook/engineering/ux/technical-writing/#assignments
2020-05-24 23:13:21 +05:30
---
2021-03-11 19:13:27 +05:30
# Runbooks **(FREE)**
2018-12-13 13:39:08 +05:30
2019-09-30 21:07:59 +05:30
Runbooks are a collection of documented procedures that explain how to
carry out a particular process, be it starting, stopping, debugging,
2018-12-13 13:39:08 +05:30
or troubleshooting a particular system.
2020-05-24 23:13:21 +05:30
Using [Jupyter Notebooks](https://jupyter.org/) and the
[Rubix library](https://github.com/Nurtch/rubix),
2019-07-07 11:18:12 +05:30
users can get started writing their own executable runbooks.
2019-09-30 21:07:59 +05:30
Historically, runbooks took the form of a decision tree or a detailed
step-by-step guide depending on the condition or system.
2018-12-13 13:39:08 +05:30
2019-09-30 21:07:59 +05:30
Modern implementations have introduced the concept of an "executable
runbooks", where, along with a well-defined process, operators can execute
2018-12-13 13:39:08 +05:30
pre-written code blocks or database queries against a given environment.
2019-09-04 21:01:54 +05:30
## Executable Runbooks
2018-12-13 13:39:08 +05:30
2020-06-23 00:09:42 +05:30
> [Introduced](https://gitlab.com/gitlab-org/gitlab-foss/-/issues/45912) in GitLab 11.4.
2018-12-13 13:39:08 +05:30
2021-02-22 17:27:13 +05:30
The JupyterHub app offered via the GitLab Kubernetes integration now ships
2021-04-29 21:17:54 +05:30
with Nurtch's Rubix library, providing a simple way to create DevOps
2020-05-24 23:13:21 +05:30
runbooks. A sample runbook is provided, showcasing common operations. While
Rubix makes it simple to create common Kubernetes and AWS workflows, you can
also create them manually without Rubix.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
<i class="fa fa-youtube-play youtube" aria-hidden="true"></i>
2018-12-13 13:39:08 +05:30
Watch this [video](https://www.youtube.com/watch?v=Q_OqHIIUPjE)
2020-05-24 23:13:21 +05:30
for an overview of how this is accomplished in GitLab!
2018-12-13 13:39:08 +05:30
## Requirements
2021-02-22 17:27:13 +05:30
To create an executable runbook, you need:
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
- **Kubernetes** - A Kubernetes cluster is required to deploy the rest of the
applications. The simplest way to get started is to add a cluster using one
2021-02-22 17:27:13 +05:30
of the [GitLab integrations](../add_remove_clusters.md#create-new-cluster).
2020-05-24 23:13:21 +05:30
- **Ingress** - Ingress can provide load balancing, SSL termination, and name-based
virtual hosting. It acts as a web proxy for your applications.
- **JupyterHub** - [JupyterHub](https://jupyterhub.readthedocs.io/) is a multi-user
service for managing notebooks across a team. Jupyter Notebooks provide a
web-based interactive programming environment used for data analysis,
visualization, and machine learning.
2018-12-13 13:39:08 +05:30
## Nurtch
2020-05-24 23:13:21 +05:30
Nurtch is the company behind the [Rubix library](https://github.com/Nurtch/rubix).
Rubix is an open-source Python library that makes it easy to perform common
DevOps tasks inside Jupyter Notebooks. Tasks such as plotting Cloudwatch metrics
and rolling your ECS/Kubernetes app are simplified down to a couple of lines of
code. See the [Nurtch Documentation](http://docs.nurtch.com/en/latest/) for more
information.
2018-12-13 13:39:08 +05:30
## Configure an executable runbook with GitLab
2019-09-30 21:07:59 +05:30
Follow this step-by-step guide to configure an executable runbook in GitLab using
2020-05-24 23:13:21 +05:30
the components outlined above and the pre-loaded demo runbook.
2018-12-13 13:39:08 +05:30
2021-11-18 22:05:49 +05:30
1. Create an [OAuth application for JupyterHub](../../../../integration/oauth_provider.md).
1. When [installing JupyterHub with Helm](https://zero-to-jupyterhub.readthedocs.io/en/latest/jupyterhub/installation.html),
use the following values:
2021-09-04 01:27:46 +05:30
```yaml
#-----------------------------------------------------------------------------
# The gitlab and ingress sections must be customized!
#-----------------------------------------------------------------------------
gitlab:
clientId: <Your OAuth Application ID>
clientSecret: <Your OAuth Application Secret>
callbackUrl: http://<Jupyter Hostname>/hub/oauth_callback,
# Limit access to members of specific projects or groups:
# allowedGitlabGroups: [ "my-group-1", "my-group-2" ]
# allowedProjectIds: [ 12345, 6789 ]
# ingress is required for OAuth to work
ingress:
enabled: true
host: <JupyterHostname>
# tls:
# - hosts:
# - <JupyterHostanme>
# secretName: jupyter-cert
# annotations:
# kubernetes.io/ingress.class: "nginx"
# kubernetes.io/tls-acme: "true"
#-----------------------------------------------------------------------------
# NO MODIFICATIONS REQUIRED BEYOND THIS POINT
#-----------------------------------------------------------------------------
hub:
extraEnv:
JUPYTER_ENABLE_LAB: 1
extraConfig: |
c.KubeSpawner.cmd = ['jupyter-labhub']
c.GitLabOAuthenticator.scope = ['api read_repository write_repository']
async def add_auth_env(spawner):
'''
We set user's id, login and access token on single user image to
enable repository integration for JupyterHub.
See: https://gitlab.com/gitlab-org/gitlab-foss/issues/47138#note_154294790
'''
auth_state = await spawner.user.get_auth_state()
if not auth_state:
spawner.log.warning("No auth state for %s", spawner.user)
return
spawner.environment['GITLAB_ACCESS_TOKEN'] = auth_state['access_token']
spawner.environment['GITLAB_USER_LOGIN'] = auth_state['gitlab_user']['username']
spawner.environment['GITLAB_USER_ID'] = str(auth_state['gitlab_user']['id'])
spawner.environment['GITLAB_USER_EMAIL'] = auth_state['gitlab_user']['email']
spawner.environment['GITLAB_USER_NAME'] = auth_state['gitlab_user']['name']
c.KubeSpawner.pre_spawn_hook = add_auth_env
auth:
type: gitlab
state:
enabled: true
singleuser:
defaultUrl: "/lab"
image:
name: registry.gitlab.com/gitlab-org/jupyterhub-user-image
tag: latest
lifecycleHooks:
postStart:
exec:
command:
- "sh"
- "-c"
- >
git clone https://gitlab.com/gitlab-org/nurtch-demo.git DevOps-Runbook-Demo || true;
echo "https://oauth2:${GITLAB_ACCESS_TOKEN}@${GITLAB_HOST}" > ~/.git-credentials;
git config --global credential.helper store;
git config --global user.email "${GITLAB_USER_EMAIL}";
git config --global user.name "${GITLAB_USER_NAME}";
jupyter serverextension enable --py jupyterlab_git
proxy:
service:
type: ClusterIP
```
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. After JupyterHub has been installed successfully, open the **Jupyter Hostname**
in your browser. Click the **Sign in with GitLab** button to log in to
JupyterHub and start the server. Authentication is enabled for any user of the
GitLab instance with OAuth2. This button redirects you to a page at GitLab
requesting authorization for JupyterHub to use your GitLab account.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
![authorize Jupyter](img/authorize-jupyter.png)
2018-12-13 13:39:08 +05:30
2021-02-22 17:27:13 +05:30
1. Click **Authorize**, and GitLab redirects you to the JupyterHub application.
1. Click **Start My Server** to start the server in a few seconds.
2020-05-24 23:13:21 +05:30
1. To configure the runbook's access to your GitLab project, you must enter your
[GitLab Access Token](../../../profile/personal_access_tokens.md)
and your Project ID in the **Setup** section of the demo runbook:
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. Double-click the **DevOps-Runbook-Demo** folder located on the left panel.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
![demo runbook](img/demo-runbook.png)
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. Double-click the `Nurtch-DevOps-Demo.ipynb` runbook.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
![sample runbook](img/sample-runbook.png)
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
Jupyter displays the runbook's contents in the right-hand side of the screen.
The **Setup** section displays your `PRIVATE_TOKEN` and your `PROJECT_ID`.
Enter these values, maintaining the single quotes as follows:
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
```sql
2021-03-08 18:12:59 +05:30
PRIVATE_TOKEN = '<your_access_token>'
2020-05-24 23:13:21 +05:30
PROJECT_ID = '1234567'
```
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. Update the `VARIABLE_NAME` on the last line of this section to match the name of
the variable you're using for your access token. In this example, our variable
name is `PRIVATE_TOKEN`.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
```sql
VARIABLE_VALUE = project.variables.get('PRIVATE_TOKEN').value
```
2018-12-13 13:39:08 +05:30
2021-01-03 14:25:43 +05:30
1. To configure the operation of a runbook, create and configure variables.
2020-05-24 23:13:21 +05:30
For this example, we are using the **Run SQL queries in Notebook** section in the
sample runbook to query a PostgreSQL database. The first four lines of the following
code block define the variables that are required for this query to function:
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
```sql
%env DB_USER={project.variables.get('DB_USER').value}
%env DB_PASSWORD={project.variables.get('DB_PASSWORD').value}
%env DB_ENDPOINT={project.variables.get('DB_ENDPOINT').value}
%env DB_NAME={project.variables.get('DB_NAME').value}
```
2018-12-13 13:39:08 +05:30
2020-10-24 23:57:45 +05:30
1. Navigate to **Settings > CI/CD > Variables** to create
2020-05-24 23:13:21 +05:30
the variables in your project.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
![GitLab variables](img/gitlab-variables.png)
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. Click **Save variables**.
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
1. In Jupyter, click the **Run SQL queries in Notebook** heading, and then click
**Run**. The results are displayed inline as follows:
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
![PostgreSQL query](img/postgres-query.png)
2018-12-13 13:39:08 +05:30
2020-05-24 23:13:21 +05:30
You can try other operations, such as running shell scripts or interacting with a
Kubernetes cluster. Visit the
2019-09-30 21:07:59 +05:30
[Nurtch Documentation](http://docs.nurtch.com/) for more information.