Arch VM Installation Script

[aegisnir]

Hey everyone, I just wanted to share an installation script I made to install this on Arch. This is mainly for me but figured I would share it with the community in case it helps anyone else. It installs everything in about 5 minutes.

This is meant to be run as root. I realize people may not be comfortable with that but again, this was made for myself so I could quickly spin up a VM and have a working instance with all my settings in <10 minutes from start to finish. It creates a headless LAN accessible instance with user authentication so I can access the instance from any PC. It is also designed to utilize hugepages for increase performance on unraid local shares. I highly recommend reading and understand this script before executing. I have only been using Arch linux for about 5-10 hours and put this together while I was setting it up. I take no responsibility for any problems you encounter by using my script.

Users specified in /mnt/ai/data/users/users.auth. Format is username:password and one entry per line. I do not like how this file is needed for user accounts and if anyone knows a better way, please share. chown and chmod as needed to increase security but there should be a better way.

My initial webui-user.sh is stored in /mnt/ai/backup/webui-user.sh and the settings are as follows. The script pulls this and overwrites the default one from the git clone command. Once installed and running, it will not touch this one again and will continue using the default location. This just lets me specify all my arguments before it starts for the first time:

COMMANDLINE_ARGS="--xformers --opt-split-attention --update-check --update-all-extensions --no-progressbar-hiding --enable-insecure-extension-access --listen --data-dir /mnt/ai/data/ --gradio-allowed-path /mnt/ai/data/ --gradio-auth-path /mnt/ai/users/users.auth"

If anyone has any recommendations or critiques, please feel free to comment!

#######################################################################################################################################
# Arch Install Manual
# Reboot after installation is complete and the WebUI launches for the first time.
#######################################################################################################################################

#######################################################################################################################################
# Prepare unraid FLASH device for hugepages by adding the following to the "append" line under Syslinux configuration/Unraid OS.  This will enable 32GBs of hugepages for unraid.  Containers may use hugepages before VMs can grab it so provision a bit extra.  Hugepages increase performance of virtio-fs and allows >2GB/s speeds when using local unraid shares:
#
# hugepagesz=2M hugepages=16384
#
# Prepare VM for hugepages by adding <hugepages/> under <memoryBacking> in the XML:
#######################################################################################################################################

#######################################################################################################################################
# Install dependencies.  Haveged is for additional entropy to allow OpenSSH to start faster on boot.  Haveged and openssh are not needed if you will not be running a headless server
#######################################################################################################################################
pacman -S --noconfirm openssh haveged git python3 nvidia

#######################################################################################################################################
# Create AI user which the app will run as.  Does not include sudo permissions.
#######################################################################################################################################
useradd -m ai
read -p "You will be prompted to create a password for the AI user.  Please press enter to continue."
passwd ai

#######################################################################################################################################
# Create AI directory and create fstab entry
#######################################################################################################################################
mkdir /mnt/ai
chmod 755 /mnt/ai
chown ai:ai /mnt/ai
echo "# mount unraid AI directory" | sudo tee -a /etc/fstab
echo "ai /mnt/ai virtiofs rw,noatime,_netdev 0 2" | sudo tee -a /etc/fstab
systemctl daemon-reload
mount -t virtiofs -o rw,noatime,_netdev ai /mnt/ai

#######################################################################################################################################
# Enable hugepages.  Hugepagesize is 2048KB by default.  Setting nr_hugepages to 2048 will allow 4GBs of hugepages. (nr_hugepages)*(Hugepagesize)=Total Hugepages
#######################################################################################################################################
echo "" | sudo tee -a /etc/fstab
echo "# enable hugepages" | sudo tee -a /etc/fstab
echo "hugetlbfs       /dev/hugepages  hugetlbfs       mode=01770,gid=kvm        0 0" | sudo tee -a /etc/fstab
echo 2048 > /proc/sys/vm/nr_hugepages
echo "vm.nr_hugepages = 2048" | sudo tee -a /etc/sysctl.d/40-hugepage.conf
systemctl daemon-reload
umount /dev/hugepages
mount /dev/hugepages

#######################################################################################################################################
# Create a service to start Automatic1111 on boot and enable logging and crash detection with auto-restart.  Check with "systemctl status automatic1111.service" and "cat /var/log/sdwebui.log" to verify is service starts.  It may appear stuck for several minutes but it will launch eventually and the log will update.
# Credit: https://github.com/AUTOMATIC1111/stable-diffusion-webui/discussions/6049
#######################################################################################################################################
touch /etc/systemd/system/automatic1111.service
echo "[Unit]" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "Description=Stable Diffusion AUTOMATIC1111 Web UI service" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "After=network.target" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "StartLimitIntervalSec=0" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "[Service]" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "Type=simple" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "Restart=always" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "RestartSec=1" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "User=ai" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "ExecStart=/usr/bin/env bash /mnt/ai/apps/stable-diffusion/automatic1111/stable-diffusion-webui/webui.sh" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "WorkingDirectory=/mnt/ai/apps/stable-diffusion/automatic1111/stable-diffusion-webui" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "StandardOutput=append:/var/log/sdwebui.log" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "StandardError=append:/var/log/sdwebui.log" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "[Install]" | sudo tee -a /etc/systemd/system/automatic1111.service
echo "WantedBy=multi-user.target" | sudo tee -a /etc/systemd/system/automatic1111.service
touch /var/log/sdwebui.log
chmod 755 /var/log/sdwebui.log
chown ai:ai /var/log/sdwebui.log
systemctl enable automatic1111.service

#######################################################################################################################################
# Switch to AI user before installing Automatic1111
#######################################################################################################################################
sudo su -l ai -c '
mkdir -p /mnt/ai/data/extensions
mkdir -p /mnt/ai/apps/stable-diffusion/automatic1111/
cd /mnt/ai/apps/stable-diffusion/automatic1111/
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui
cd stable-diffusion-webui
cp /mnt/ai/backup/webui-user.sh /mnt/ai/apps/stable-diffusion/automatic1111/stable-diffusion-webui/
python3 -m venv venv
./webui.sh
'
exit

[YabbaYabbaYabba]

Fantastic, well done!