class 'django.db.utils.ProgrammingError'

[smolko345]

Hey guys,

First I am gonna try to describe the steps done:

2 months back I have installed netbox v3.0.0 on the new Vm and run the full upgrade process as per official documentation https://docs.netbox.dev/en/stable/installation/upgrading/
This was sucessfull and I was able to restore the DB from our production netbox v2.11.12.
The new version v3.0.0 was accessible with the correct data. We didn't use the v3.0.0 ( we wanted to postpone ) and continued working with v2.11.12.
After 2 months I am trying to restore the current DB state again but I cannot access the new version now. Steps done:

1. Copy /reports, /scripts and /media to the new version v3.0.0
   /opt/netbox/netbox/reports
   /opt/netbox/netbox/scripts
   /opt/netbox/netbox/media/

2. Drop and recreate new DB from the Prod backup
   psql -c 'drop database netbox'
   psql -c 'create database netbox'
   psql netbox < netbox.sql

3. Run the ./upgrade.sh script PYTHON=/opt/python37/bin/python3 /opt/netbox/upgrade.sh

Error at the end of the upgrade.sh

Successfully built pyvmomi python-ldap
Installing collected packages: pyasn1, pyasn1-modules, lxml, dnspython, pyvmomi, python-ldap, django-auth-ldap
Successfully installed django-auth-ldap-4.1.0 dnspython-2.2.1 lxml-4.9.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 python-ldap-3.4.3 pyvmomi-7.0.3

ERROR: Database schema migrations are out of synchronization. (No
data has been lost.) If attempting to upgrade to NetBox v3.0 or
later, first upgrade to a v2.11 release to ensure schema migrations
have been correctly prepared. For further detail on the exact error,
run the following commands:

source /opt/netbox-3.0.0/venv/bin/activate
python3 netbox/manage.py showmigrations

After that when accessing netbox, it gives me the following error

Server Error
A database programming error was detected while processing this request. Common causes include the following:
Database migrations missing - When upgrading to a new NetBox release, the upgrade script must be run to apply any new database migrations. You can run migrations manually by executing python3 manage.py migrate from the command line.
Unsupported PostgreSQL version - Ensure that PostgreSQL version 9.6 or higher is in use. You can check this by connecting to the database using NetBox's credentials and issuing a query for SELECT VERSION().

The complete exception is provided below:
<class 'django.db.utils.ProgrammingError'>
column extras_customfield.created does not exist
LINE 1: SELECT "extras_customfield"."created", "extras_customfield"....
^

Python version: 3.7.11
NetBox version: 3.0.0
Postgres version: postgresql12
Redis version: redis-4.0.2-1.el7.x86_64

Thank you in advance for any suggestions how to solve this

[candlerb]

For further detail on the exact error, run the following commands:

source /opt/netbox-3.0.0/venv/bin/activate
python3 netbox/manage.py showmigrations

Please run those commands, and report what you see when you run them.

Also, what does psql --version show? It's possible you have a different server running than you expect (this has been reported before).

After that when accessing netbox, it gives me the following error

Yes, it will do - if the migrations didn't complete successfully then the database will be missing columns or entire tables that the Python code assumes are there.

[smolko345]

Hi, thank you for your answer

there is the output:

(venv) [root@ntversion3 netbox]# python3 netbox/manage.py showmigrations
Traceback (most recent call last):
File "netbox/manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/django/core/management/init.py", line 419, in execute_from_command_line
utility.execute()
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/django/core/management/init.py", line 395, in execute
django.setup()
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/django/init.py", line 24, in setup
apps.populate(settings.INSTALLED_APPS)
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/django/apps/registry.py", line 114, in populate
app_config.import_models()
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/django/apps/config.py", line 301, in import_models
self.models_module = import_module(models_module_name)
File "/opt/python37/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1006, in _gcd_import
File "", line 983, in _find_and_load
File "", line 967, in _find_and_load_unlocked
File "", line 677, in _load_unlocked
File "", line 728, in exec_module
File "", line 219, in _call_with_frames_removed
File "/opt/netbox-3.0.0/netbox/circuits/models.py", line 6, in
from dcim.models import CableTermination, PathEndpoint
File "/opt/netbox-3.0.0/netbox/dcim/models/init.py", line 1, in
from .cables import *
File "/opt/netbox-3.0.0/netbox/dcim/models/cables.py", line 19, in
from .devices import Device
File "/opt/netbox-3.0.0/netbox/dcim/models/devices.py", line 15, in
from extras.models import ConfigContextModel
File "/opt/netbox-3.0.0/netbox/extras/models/init.py", line 4, in
from .models import CustomLink, ExportTemplate, ImageAttachment, JobResult, JournalEntry, Report, Script, Webhook
File "/opt/netbox-3.0.0/netbox/extras/models/models.py", line 13, in
from rest_framework.utils.encoders import JSONEncoder
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/rest_framework/utils/encoders.py", line 14, in
from rest_framework.compat import coreapi
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/rest_framework/compat.py", line 71, in
import markdown
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/markdown/init.py", line 29, in
from .core import Markdown, markdown, markdownFromFile # noqa: E402
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/markdown/core.py", line 26, in
from . import util
File "/opt/netbox-3.0.0/venv/lib/python3.7/site-packages/markdown/util.py", line 87, in
INSTALLED_EXTENSIONS = metadata.entry_points().get('markdown.extensions', ())
AttributeError: 'EntryPoints' object has no attribute 'get'

SQL Version -
[root@ntversion3 netbox]# psql --version
psql (PostgreSQL) 12.11

[candlerb]

It looks to me that you might have hit the (intentional) bug which is that Netbox installations are not reproducible. What I mean is, if it was possible to install Netbox 3.0.0 a year ago, there is no guarantee that it will still be possible to install it today. This is because Netbox doesn't pin its dependencies - so if a version of one of these changes, it may not be compatible with an old version of Netbox.

The solution depends on exactly what version of Netbox you want to run.

If you want to run the latest Netbox (v3.3.5), then just upgrade directly to that. As long as you have previously had 2.11.X working then you can jump directly to any 3.x version, and you're fine.

If you must run Netbox v3.0.x, then at least go to the latest on this minor version, which is v3.0.12. There is a chance it will fix this problem, and it will certainly have a ton of other bug fixes.

If you must run Netbox v3.0.0 then I'm afraid you're into some debugging pain. If you know someone who still has a working v3.0.0 installation, then ask them to run pip freeze >req.txt and then you can install exactly the same versions of packages on your local system.

I'm not 100% sure this is your problem, but it seems the most likely to me, since the error is complaining about some dependency (markdown) which is not part of Netbox itself.

[smolko345]

Thank you, I will try to install the new version and see if it gone resolve my issue.