Skip to content

Latest commit

 

History

History
211 lines (153 loc) · 8.72 KB

tiup-cluster-no-sudo-mode.md

File metadata and controls

211 lines (153 loc) · 8.72 KB
title summary
Deploy and Maintain an Online TiDB Cluster Using TiUP No-sudo Mode
Learn how to deploy and maintain an online TiDB cluster using the TiUP no-sudo mode.

Deploy and Maintain an Online TiDB Cluster Using TiUP No-sudo Mode

This document describes how to use the TiUP no-sudo mode to deploy a cluster.

Note:

For CentOS, only CentOS 8 or later versions are supported.

Prepare the user and configure the SSH mutual trust

This document takes the tidb user as an example.

  1. Log in to all the target machines as the root user, create a user named tidb and configure the system resource limits for this user as follows:

    Note:

    In no-sudo mode, configuring passwordless sudo for the tidb user is unnecessary, that is, you do not need to add the tidb user to the sudoers file.

    1. Add the tidb user:

      adduser tidb

    2. Configure the resource limits for the tidb user:

      cat << EOF >>/etc/security/limits.conf
tidb           soft    nofile         1000000
tidb           hard    nofile         1000000
tidb           soft    stack          32768
tidb           hard    stack          32768
tidb           soft    core           unlimited
tidb           hard    core           unlimited
EOF

  2. Start the systemd user mode for the tidb user on each target machine. This step is required and do not skip it.

    1. Use the tidb user to set the XDG_RUNTIME_DIR environment variable.

      sudo -iu tidb  # Switch to the tidb user
mkdir -p ~/.bashrc.d
echo "export XDG_RUNTIME_DIR=/run/user/$(id -u)" > ~/.bashrc.d/systemd
source ~/.bashrc.d/systemd

    2. Use the root user to start the user service.

      $ uid=$(id -u tidb) # Get the ID of the tidb user
$ systemctl start user@${uid}.service
$ systemctl status user@${uid}.service
user@1000.service - User Manager for UID 1000
Loaded: loaded (/usr/lib/systemd/system/user@.service; static; vendor preset>
Active: active (running) since Mon 2024-01-29 03:30:51 EST; 1min 7s ago
Main PID: 3328 (systemd)
Status: "Startup finished in 420ms."
Tasks: 6
Memory: 6.1M
CGroup: /user.slice/user-1000.slice/user@1000.service
        ├─dbus.service
        │ └─3442 /usr/bin/dbus-daemon --session --address=systemd: --nofork >
        ├─init.scope
        │ ├─3328 /usr/lib/systemd/systemd --user
        │ └─3335 (sd-pam)
        └─pulseaudio.service
          └─3358 /usr/bin/pulseaudio --daemonize=no --log-target=journal

    3. Execute systemctl --user. If no errors occur, it indicates that the systemd user mode has started successfully.

  3. Use the root user to execute the following command to enable lingering for the systemd user tidb.

    loginctl enable-linger tidb
loginctl show-user -p Linger tidb # This should show: Linger=yes

    You can read the systemd documentation for reference, Automatic start-up of systemd user instances.

  4. Generate a key using ssh-keygen on the control machine:

    ssh-keygen

  5. Copy the public key to the other machines in the cluster to establish SSH trust.

    • If you have set a password for the tidb user, you can use ssh-copy-id command to copy the public key to the target machine.

      ssh-copy-id tidb@host

      You need to replace host with the hostname of the target machine and run this command on each of the other machines in the cluster.

    • If you use a different method to copy the public key, make sure to check the permissions of the /home/tidb/.ssh/authorized_keys file after the copy.

      chown -R tidb:tidb /home/tidb/.ssh/authorized_keys
chmod 600 /home/tidb/.ssh/authorized_keys

Prepare the topology file

  1. Execute the following command to generate the topology file.

    tiup cluster template > topology.yaml

  2. Edit the topology file.

    Compared with the regular mode, when using TiUP in no-sudo mode, you need to add a line systemd_mode: "user" in the global module of the topology.yaml file. The systemd_mode parameter is used to set whether to use the systemd user mode. If this parameter is not set, the default value is system, meaning sudo permissions are required.

    Additionally, in no-sudo mode, because the non-root tidb user does not have permission to use the /data directory as deploy_dir or data_dir, you must select a path accessible to non-root users. The following example uses relative paths, and the actual paths used are /home/tidb/data/tidb-deploy and /home/tidb/data/tidb-data. The rest of the topology file remains the same as in the regular mode. Another option is to use the root user to create the directories and then use chown to change the ownership to tidb:tidb.

    global:
  user: "tidb"
  systemd_mode: "user"
  ssh_port: 22
  deploy_dir: "data/tidb-deploy"
  data_dir: "data/tidb-data"
  arch: "amd64"
  ...

Manually repair failed check items

Note:

If you use a minimal install, make sure the tar package is installed. Otherwise, the tiup cluster check command will fail.

Executing tiup cluster check topology.yaml --user tidb can generate some failed check items. The following is an example.

Node            Check         Result  Message
----            -----         ------  -------
192.168.124.27  thp           Fail    THP is enabled, please disable it for best performance
192.168.124.27  command       Pass    numactl: policy: default
192.168.124.27  os-version    Pass    OS is CentOS Stream 8
192.168.124.27  network       Pass    network speed of ens160 is 10000MB
192.168.124.27  disk          Warn    mount point / does not have 'noatime' option set
192.168.124.27  disk          Fail    multiple components tikv:/home/blackcat/data/tidb-deploy/tikv-20160/data/tidb-data,tikv:/home/blackcat/data/tidb-deploy/tikv-20161/data/tidb-data are using the same partition 192.168.124.27:/ as data dir
192.168.124.27  selinux       Pass    SELinux is disabled
192.168.124.27  cpu-cores     Pass    number of CPU cores / threads: 16
192.168.124.27  cpu-governor  Warn    Unable to determine current CPU frequency governor policy
192.168.124.27  swap          Warn    swap is enabled, please disable it for best performance
192.168.124.27  memory        Pass    memory size is 9681MB
192.168.124.27  service       Fail    service firewalld is running but should be stopped

In no-sudo mode, the tidb user does not have sudo permissions. As a result, running tiup cluster check topology.yaml --apply --user tidb cannot automatically fix the failed check items. You need to manually fix it by using the root user on the target machines.

For more information, see TiDB Environment and System Configuration Check. Note that you need to skip the step Manually configure the SSH mutual trust and sudo without password in the document.

Deploy and manage the cluster

To use the tidb user created in preceding steps and avoid creating a new one, add --user tidb when running the following deploy command:

tiup cluster deploy mycluster v8.5.0 topology.yaml --user tidb

Note:

You need to replace v8.5.0 in the preceding command with the TiDB version that you want to deploy and mycluster with the name you want to give to your cluster.

Start the cluster:

tiup cluster start mycluster

Scale out the cluster:

tiup cluster scale-out mycluster scale.yaml --user tidb

Scale in the cluster:

tiup cluster scale-in mycluster -N 192.168.124.27:20160

Upgrade the cluster:

tiup cluster upgrade mycluster v8.2.0

FAQ

The Trying to run as user instance, but $XDG_RUNTIME_DIR is not set. error occurs when starting user@.service

This issue might be caused by the absence of pam_systemd.so in your /etc/pam.d/system-auth.ued file.

To resolve this issue, use the following command to check whether the /etc/pam.d/system-auth.ued file contains the pam_systemd.so module. If not, append session optional pam_systemd.so to the end of the file.

grep 'pam_systemd.so' /etc/pam.d/system-auth.ued || echo 'session     optional      pam_systemd.so' >> /etc/pam.d/system-auth.ued