Netbox services not found after install

[patmatterson]

Centos8 and netbox 2.9.11:
Both netbox services fail to register even though upgrade.sh completed without errors.

# sudo /opt/netbox/upgrade.sh
Removing old virtual environment...
Creating a new virtual environment at /opt/netbox/venv...
Installing Python system packages (pip3 install wheel 'pip>=21')...
Collecting wheel
  Using cached https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl
Collecting pip>=21
  Using cached https://files.pythonhosted.org/packages/fe/ef/60d7ba03b5c442309ef42e7d69959f73aacccd0d86008362a681c4698e83/pip-21.0.1-py3-none-any.whl
Installing collected packages: wheel, pip
  Found existing installation: pip 9.0.3
    Uninstalling pip-9.0.3:
      Successfully uninstalled pip-9.0.3
Successfully installed pip-21.0.1 wheel-0.36.2
Installing core dependencies (pip3 install -r requirements.txt)...
Collecting Django==3.1
  Using cached Django-3.1-py3-none-any.whl (7.8 MB)
Collecting django-cacheops==5.1.0
  Using cached django_cacheops-5.1-py2.py3-none-any.whl (38 kB)
Collecting django-cors-headers==3.4.0
  Using cached django_cors_headers-3.4.0-py3-none-any.whl (11 kB)
Collecting django-debug-toolbar==2.2
  Using cached django_debug_toolbar-2.2-py3-none-any.whl (198 kB)
Collecting django-filter==2.3.0
  Using cached django_filter-2.3.0-py3-none-any.whl (73 kB)
Collecting django-mptt==0.11.0
  Using cached django_mptt-0.11.0-py2.py3-none-any.whl (109 kB)
Collecting django-pglocks==1.0.4
  Using cached django_pglocks-1.0.4-py3-none-any.whl
Collecting django-prometheus==2.0.0
  Using cached django_prometheus-2.0.0-py2.py3-none-any.whl (27 kB)
Collecting django-rq==2.3.2
  Using cached django_rq-2.3.2-py2.py3-none-any.whl (45 kB)
Collecting django-tables2==2.3.1
  Using cached django_tables2-2.3.1-py2.py3-none-any.whl (90 kB)
Collecting django-taggit==1.3.0
  Using cached django_taggit-1.3.0-py3-none-any.whl (45 kB)
Collecting django-timezone-field==4.0
  Using cached django_timezone_field-4.0-py3-none-any.whl (7.6 kB)
Collecting djangorestframework==3.11.0
  Using cached djangorestframework-3.11.0-py3-none-any.whl (911 kB)
Collecting drf-yasg[validation]==1.17.1
  Using cached drf_yasg-1.17.1-py2.py3-none-any.whl (1.1 MB)
Collecting gunicorn==20.0.4
  Using cached gunicorn-20.0.4-py2.py3-none-any.whl (77 kB)
Collecting Jinja2==2.11.2
  Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Collecting Markdown==3.2.2
  Using cached Markdown-3.2.2-py3-none-any.whl (88 kB)
Collecting netaddr==0.8.0
  Using cached netaddr-0.8.0-py2.py3-none-any.whl (1.9 MB)
Collecting Pillow==7.2.0
  Using cached Pillow-7.2.0-cp36-cp36m-manylinux1_x86_64.whl (2.2 MB)
Collecting psycopg2-binary==2.8.5
  Using cached psycopg2_binary-2.8.5-cp36-cp36m-manylinux1_x86_64.whl (2.9 MB)
Collecting pycryptodome==3.9.8
  Using cached pycryptodome-3.9.8-cp36-cp36m-manylinux1_x86_64.whl (13.7 MB)
Collecting PyYAML==5.3.1
  Using cached PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl
Collecting svgwrite==1.4
  Using cached svgwrite-1.4-py3-none-any.whl (66 kB)
Collecting asgiref~=3.2.10
  Using cached asgiref-3.2.10-py3-none-any.whl (19 kB)
Collecting pytz
  Using cached pytz-2021.1-py2.py3-none-any.whl (510 kB)
Collecting sqlparse>=0.2.2
  Using cached sqlparse-0.4.1-py3-none-any.whl (42 kB)
Collecting funcy<2.0,>=1.8
  Using cached funcy-1.15-py2.py3-none-any.whl (32 kB)
Collecting six>=1.4.0
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting redis>=3.0.0
  Using cached redis-3.5.3-py2.py3-none-any.whl (72 kB)
Collecting django-js-asset
  Using cached django_js_asset-1.2.2-py2.py3-none-any.whl (5.8 kB)
Collecting prometheus-client>=0.7
  Using cached prometheus_client-0.9.0-py2.py3-none-any.whl (53 kB)
Collecting rq>=1.2
  Using cached rq-1.7.0-py2.py3-none-any.whl (62 kB)
Collecting inflection>=0.3.1
  Using cached inflection-0.5.1-py2.py3-none-any.whl (9.5 kB)
Collecting uritemplate>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting packaging
  Using cached packaging-20.9-py2.py3-none-any.whl (40 kB)
Collecting coreschema>=0.0.4
  Using cached coreschema-0.0.4-py3-none-any.whl
Collecting coreapi>=2.3.3
  Using cached coreapi-2.3.3-py2.py3-none-any.whl (25 kB)
Collecting ruamel.yaml>=0.15.34
  Using cached ruamel.yaml-0.16.12-py2.py3-none-any.whl (111 kB)
Collecting swagger-spec-validator>=2.1.0
  Using cached swagger_spec_validator-2.7.3-py2.py3-none-any.whl (27 kB)
Requirement already satisfied: setuptools>=3.0 in ./venv/lib/python3.6/site-packages (from gunicorn==20.0.4->-r requirements.txt (line 15)) (39.2.0)
Collecting MarkupSafe>=0.23
  Using cached MarkupSafe-1.1.1-cp36-cp36m-manylinux2010_x86_64.whl (32 kB)
Collecting importlib-metadata
  Using cached importlib_metadata-3.7.0-py3-none-any.whl (11 kB)
Collecting importlib-resources
  Using cached importlib_resources-5.1.0-py3-none-any.whl (24 kB)
Collecting requests
  Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting itypes
  Using cached itypes-1.2.0-py2.py3-none-any.whl (4.8 kB)
Collecting click>=5.0.0
  Using cached click-7.1.2-py2.py3-none-any.whl (82 kB)
Collecting ruamel.yaml.clib>=0.1.2
  Using cached ruamel.yaml.clib-0.2.2-cp36-cp36m-manylinux1_x86_64.whl (549 kB)
Collecting jsonschema
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting typing-extensions>=3.6.4
  Using cached typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting zipp>=0.5
  Using cached zipp-3.4.0-py3-none-any.whl (5.2 kB)
Collecting attrs>=17.4.0
  Using cached attrs-20.3.0-py2.py3-none-any.whl (49 kB)
Collecting pyrsistent>=0.14.0
  Using cached pyrsistent-0.17.3-cp36-cp36m-linux_x86_64.whl
Collecting pyparsing>=2.0.2
  Using cached pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.3-py2.py3-none-any.whl (137 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Installing collected packages: MarkupSafe, zipp, urllib3, typing-extensions, sqlparse, pytz, Jinja2, idna, chardet, certifi, asgiref, uritemplate, six, ruamel.yaml.clib, requests, pyrsistent, pyparsing, itypes, importlib-metadata, Django, coreschema, attrs, ruamel.yaml, redis, PyYAML, packaging, jsonschema, inflection, djangorestframework, coreapi, click, swagger-spec-validator, rq, prometheus-client, importlib-resources, funcy, drf-yasg, django-js-asset, svgwrite, pycryptodome, psycopg2-binary, Pillow, netaddr, Markdown, gunicorn, django-timezone-field, django-taggit, django-tables2, django-rq, django-prometheus, django-pglocks, django-mptt, django-filter, django-debug-toolbar, django-cors-headers, django-cacheops
Successfully installed Django-3.1 Jinja2-2.11.2 Markdown-3.2.2 MarkupSafe-1.1.1 Pillow-7.2.0 PyYAML-5.3.1 asgiref-3.2.10 attrs-20.3.0 certifi-2020.12.5 chardet-4.0.0 click-7.1.2 coreapi-2.3.3 coreschema-0.0.4 django-cacheops-5.1 django-cors-headers-3.4.0 django-debug-toolbar-2.2 django-filter-2.3.0 django-js-asset-1.2.2 django-mptt-0.11.0 django-pglocks-1.0.4 django-prometheus-2.0.0 django-rq-2.3.2 django-tables2-2.3.1 django-taggit-1.3.0 django-timezone-field-4.0 djangorestframework-3.11.0 drf-yasg-1.17.1 funcy-1.15 gunicorn-20.0.4 idna-2.10 importlib-metadata-3.7.0 importlib-resources-5.1.0 inflection-0.5.1 itypes-1.2.0 jsonschema-3.2.0 netaddr-0.8.0 packaging-20.9 prometheus-client-0.9.0 psycopg2-binary-2.8.5 pycryptodome-3.9.8 pyparsing-2.4.7 pyrsistent-0.17.3 pytz-2021.1 redis-3.5.3 requests-2.25.1 rq-1.7.0 ruamel.yaml-0.16.12 ruamel.yaml.clib-0.2.2 six-1.15.0 sqlparse-0.4.1 svgwrite-1.4 swagger-spec-validator-2.7.3 typing-extensions-3.7.4.3 uritemplate-3.0.1 urllib3-1.26.3 zipp-3.4.0
Installing local dependencies (pip3 install -r local_requirements.txt)...
Requirement already satisfied: setuptools>=36 in ./venv/lib/python3.6/site-packages (from -r local_requirements.txt (line 1)) (39.2.0)
Collecting napalm
  Using cached napalm-3.2.0-py2.py3-none-any.whl (230 kB)
Collecting napalm-ros
  Using cached napalm_ros-1.0.1-py3-none-any.whl
Collecting pyeapi>=0.8.2
  Using cached pyeapi-0.8.4-py3-none-any.whl
Collecting netmiko>=3.1.0
  Using cached netmiko-3.3.3-py3-none-any.whl (168 kB)
Collecting lxml>=4.3.0
  Using cached lxml-4.6.2-cp36-cp36m-manylinux1_x86_64.whl (5.5 MB)
Collecting paramiko>=2.6.0
  Using cached paramiko-2.7.2-py2.py3-none-any.whl (206 kB)
Requirement already satisfied: netaddr in ./venv/lib/python3.6/site-packages (from napalm->-r local_requirements.txt (line 2)) (0.8.0)
Collecting future
  Using cached future-0.18.2-py3-none-any.whl
Collecting textfsm
  Using cached textfsm-1.1.0-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: jinja2 in ./venv/lib/python3.6/site-packages (from napalm->-r local_requirements.txt (line 2)) (2.11.2)
Collecting junos-eznc>=2.2.1
  Using cached junos_eznc-2.5.4-py2.py3-none-any.whl (195 kB)
Requirement already satisfied: requests>=2.7.0 in ./venv/lib/python3.6/site-packages (from napalm->-r local_requirements.txt (line 2)) (2.25.1)
Collecting scp
  Using cached scp-0.13.3-py2.py3-none-any.whl (8.2 kB)
Requirement already satisfied: pyYAML in ./venv/lib/python3.6/site-packages (from napalm->-r local_requirements.txt (line 2)) (5.3.1)
Collecting ciscoconfparse
  Using cached ciscoconfparse-1.5.29-py3-none-any.whl (93 kB)
Collecting cffi>=1.11.3
  Using cached cffi-1.14.5-cp36-cp36m-manylinux1_x86_64.whl (401 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Requirement already satisfied: six in ./venv/lib/python3.6/site-packages (from junos-eznc>=2.2.1->napalm->-r local_requirements.txt (line 2)) (1.15.0)
Collecting ncclient>=0.6.3
  Using cached ncclient-0.6.9-py2.py3-none-any.whl
Collecting yamlordereddictloader
  Using cached yamlordereddictloader-0.4.0-py3-none-any.whl
Collecting transitions
  Using cached transitions-0.8.7-py2.py3-none-any.whl (80 kB)
Collecting pyserial
  Using cached pyserial-3.5-py2.py3-none-any.whl (90 kB)
Requirement already satisfied: pyparsing in ./venv/lib/python3.6/site-packages (from junos-eznc>=2.2.1->napalm->-r local_requirements.txt (line 2)) (2.4.7)
Requirement already satisfied: MarkupSafe>=0.23 in ./venv/lib/python3.6/site-packages (from jinja2->napalm->-r local_requirements.txt (line 2)) (1.1.1)
Collecting tenacity
  Using cached tenacity-6.3.1-py2.py3-none-any.whl (36 kB)
Requirement already satisfied: importlib-resources in ./venv/lib/python3.6/site-packages (from netmiko>=3.1.0->napalm->-r local_requirements.txt (line 2)) (5.1.0)
Collecting ntc-templates
  Using cached ntc_templates-1.6.0-py3-none-any.whl (261 kB)
Collecting pynacl>=1.0.1
  Using cached PyNaCl-1.4.0-cp35-abi3-manylinux1_x86_64.whl (961 kB)
Collecting bcrypt>=3.1.3
  Using cached bcrypt-3.2.0-cp36-abi3-manylinux2010_x86_64.whl (63 kB)
Collecting cryptography>=2.5
  Using cached cryptography-3.4.6-cp36-abi3-manylinux2014_x86_64.whl (3.2 MB)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./venv/lib/python3.6/site-packages (from requests>=2.7.0->napalm->-r local_requirements.txt (line 2)) (1.26.3)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.6/site-packages (from requests>=2.7.0->napalm->-r local_requirements.txt (line 2)) (2020.12.5)
Requirement already satisfied: chardet<5,>=3.0.2 in ./venv/lib/python3.6/site-packages (from requests>=2.7.0->napalm->-r local_requirements.txt (line 2)) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in ./venv/lib/python3.6/site-packages (from requests>=2.7.0->napalm->-r local_requirements.txt (line 2)) (2.10)
Collecting librouteros==3.*
  Using cached librouteros-3.1.0-py3-none-any.whl
Collecting colorama
  Using cached colorama-0.4.4-py2.py3-none-any.whl (16 kB)
Collecting passlib
  Using cached passlib-1.7.4-py2.py3-none-any.whl (525 kB)
Collecting dnspython
  Using cached dnspython-2.1.0-py3-none-any.whl (241 kB)
Requirement already satisfied: zipp>=0.4 in ./venv/lib/python3.6/site-packages (from importlib-resources->netmiko>=3.1.0->napalm->-r local_requirements.txt (line 2)) (3.4.0)
Installing collected packages: pycparser, cffi, pynacl, future, cryptography, bcrypt, textfsm, paramiko, lxml, yamlordereddictloader, transitions, tenacity, scp, pyserial, passlib, ntc-templates, ncclient, dnspython, colorama, pyeapi, netmiko, junos-eznc, ciscoconfparse, napalm, librouteros, napalm-ros
Successfully installed bcrypt-3.2.0 cffi-1.14.5 ciscoconfparse-1.5.29 colorama-0.4.4 cryptography-3.4.6 dnspython-2.1.0 future-0.18.2 junos-eznc-2.5.4 librouteros-3.1.0 lxml-4.6.2 napalm-3.2.0 napalm-ros-1.0.1 ncclient-0.6.9 netmiko-3.3.3 ntc-templates-1.6.0 paramiko-2.7.2 passlib-1.7.4 pycparser-2.20 pyeapi-0.8.4 pynacl-1.4.0 pyserial-3.5 scp-0.13.3 tenacity-6.3.1 textfsm-1.1.0 transitions-0.8.7 yamlordereddictloader-0.4.0
Applying database migrations (python3 netbox/manage.py migrate)...
Operations to perform:
  Apply all migrations: admin, auth, circuits, contenttypes, dcim, extras, ipam, secrets, sessions, taggit, tenancy, users, virtualization
Running migrations:
  No migrations to apply.
Collecting static files (python3 netbox/manage.py collectstatic --no-input)...

209 static files copied to '/opt/netbox/netbox/static', 770 unmodified.
Removing stale content types (python3 netbox/manage.py remove_stale_contenttypes --no-input)...
Removing expired user sessions (python3 netbox/manage.py clearsessions)...
Clearing cache data (python3 netbox/manage.py invalidate all)...
Upgrade complete! Don't forget to restart the NetBox services:
  > sudo systemctl restart netbox netbox-rq

Appears to have finished with no issue.

# sudo systemctl restart netbox netbox-rq
Failed to restart netbox.service: Unit netbox.service not found.
Failed to restart netbox-rq.service: Unit netbox-rq.service not found.

Checked on installed services:

# systemctl list-units --type=service
UNIT                               LOAD   ACTIVE SUB     DESCRIPTION
atd.service                        loaded active running Job spooling tools
auditd.service                     loaded active running Security Auditing Service
chronyd.service                    loaded active running NTP client/server
crond.service                      loaded active running Command Scheduler
dbus.service                       loaded active running D-Bus System Message Bus
dracut-shutdown.service            loaded active exited  Restore /run/initramfs on shutdown
firewalld.service                  loaded active running firewalld - dynamic firewall daemon
[email protected]                 loaded active running Getty on tty1
import-state.service               loaded active exited  Import network configuration from initramfs
irqbalance.service                 loaded active running irqbalance daemon
iscsi-shutdown.service             loaded active exited  Logout off all iSCSI sessions on shutdown
kdump.service                      loaded active exited  Crash recovery kernel arming
kmod-static-nodes.service          loaded active exited  Create list of required static device nodes for the current kernel
libstoragemgmt.service             loaded active running libstoragemgmt plug-in server daemon
lvm2-monitor.service               loaded active exited  Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling
lvm2-pvscan@8:2.service            loaded active exited  LVM event activation on device 8:2
mcelog.service                     loaded active running Machine Check Exception Logging Daemon
NetworkManager-wait-online.service loaded active exited  Network Manager Wait Online
NetworkManager.service             loaded active running Network Manager
nis-domainname.service             loaded active exited  Read and set NIS domainname from /etc/sysconfig/network
plymouth-quit-wait.service         loaded active exited  Hold until boot process finishes up
plymouth-quit.service              loaded active exited  Terminate Plymouth Boot Screen
plymouth-read-write.service        loaded active exited  Tell Plymouth To Write Out Runtime Data
plymouth-start.service             loaded active exited  Show Plymouth Boot Screen
polkit.service                     loaded active running Authorization Manager
postgresql.service                 loaded active running PostgreSQL database server
redis.service                      loaded active running Redis persistent key-value database
rhsmcertd.service                  loaded active running Enable periodic update of entitlement certificates.
rngd-wake-threshold.service        loaded active exited  Hardware RNG Entropy Gatherer Wake threshold service
rngd.service                       loaded active running Hardware RNG Entropy Gatherer Daemon
rsyslog.service                    loaded active running System Logging Service
selinux-autorelabel-mark.service   loaded active exited  Mark the need to relabel after reboot
smartd.service                     loaded active running Self Monitoring and Reporting Technology (SMART) Daemon
sshd.service                       loaded active running OpenSSH server daemon
sssd.service                       loaded active running System Security Services Daemon
systemd-journal-flush.service      loaded active exited  Flush Journal to Persistent Storage
systemd-journald.service           loaded active running Journal Service
systemd-logind.service             loaded active running Login Service
systemd-modules-load.service       loaded active exited  Load Kernel Modules
systemd-random-seed.service        loaded active exited  Load/Save Random Seed
systemd-remount-fs.service         loaded active exited  Remount Root and Kernel File Systems
systemd-sysctl.service             loaded active exited  Apply Kernel Variables
systemd-tmpfiles-setup-dev.service loaded active exited  Create Static Device Nodes in /dev
systemd-tmpfiles-setup.service     loaded active exited  Create Volatile Files and Directories
systemd-udev-settle.service        loaded active exited  udev Wait for Complete Device Initialization
systemd-udev-trigger.service       loaded active exited  udev Coldplug all Devices
systemd-udevd.service              loaded active running udev Kernel Device Manager
systemd-update-utmp.service        loaded active exited  Update UTMP about System Boot/Shutdown
systemd-user-sessions.service      loaded active exited  Permit User Sessions
tuned.service                      loaded active running Dynamic System Tuning Daemon
[email protected]         loaded active exited  /run/user/0 mount wrapper
[email protected]                     loaded active running User Manager for UID 0
vdo.service                        loaded active exited  VDO volume services
vgauthd.service                    loaded active running VGAuth Service for open-vm-tools
vmtoolsd.service                   loaded active running Service for virtual machines hosted on VMware

Nothing there for netbox.

Try again (bang head against wall)

# sudo systemctl restart netbox netbox-rq
Failed to restart netbox.service: Unit netbox.service not found.
Failed to restart netbox-rq.service: Unit netbox-rq.service not found.

Appreciate any thoughts!

[DanSheps]

THose files need to be moved to your systemd's configuration directory from the contrib directory. The upgrade script does not install them automatically.

[patmatterson]

That was it. Appreciate it!

[AutomateIP]

@DanSheps can this be added to install instructions? That step is not there and most distros (Centos8 instructions) default to systemd anyways.

[kkthxbye-code]

@jfloresr - Isn't it right here?

https://netbox.readthedocs.io/en/stable/installation/4-gunicorn/

https://netbox.readthedocs.io/en/stable/installation/migrating-to-systemd/

[AutomateIP]

Yes and I saw it after I figured it out. upgrade.sh has you issue a restart when it finished which is before the Gunicorn instructions. Perhaps it should be caveated or noted somehow. Thanks for the reply. Joksan Flores Customer Delivery Architect ***@***.******@***.***> Tel: +1 919-392-2635 Mobile: +1 919-710-2045 From: kkthxbye ***@***.***> Sent: Monday, December 6, 2021 9:17 AM To: netbox-community/netbox ***@***.***> Cc: Joksan Flores (jfloresr) ***@***.***>; Mention ***@***.***> Subject: Re: [netbox-community/netbox] Netbox services not found after install (Discussion #5882) @jfloresr<https://github.com/jfloresr> - Isn't it right here? https://netbox.readthedocs.io/en/stable/installation/4-gunicorn/ — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<#5882 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AJ6EA3PEEWWN4H7T7Y5ERGTUPTAW3ANCNFSM4YG7GZXA>. Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[berkeleycowboy]

This is configuration is very confusing. I've been through the installation at least six times and have followed the installation guide closely.
There are two places where you are expected to "look ahead" to complete the existing task.

1. The SECRET_KEY is generated after the configuration.py is mentioned.
2. I don't quite understand it yet but it appears I'm expected to "look ahead" in the Gunicorn section for stuff related to the Netbox installation.

For someone that is installing for the first time this is very confusing. You are unable to validate your work as you progress through the installation.