UPGRADE ERROR - cannot import name 'force_text' from 'django.utils.encoding

[nikos82]

NetBox version

v3.3.10

Python version

3.10

Steps to Reproduce

HI,
During the upgrade from 3.3.10 to 3.4.3 , i am getting the below error message

ImportError: cannot import name 'force_text' from 'django.utils.encoding' (/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/utils/encoding.py)

Expected Behavior

successful upgrade

Observed Behavior

  File "/opt/netbox-3.4.3/netbox/manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 420, in execute
    django.setup()
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/__init__.py", line 24, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/apps/registry.py", line 91, in populate
    app_config = AppConfig.create(entry)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/apps/config.py", line 228, in create
    import_module(entry)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/graphene_django/__init__.py", line 1, in <module>
    from .fields import DjangoConnectionField, DjangoListField
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/graphene_django/fields.py", line 18, in <module>
    from .utils import maybe_queryset
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/graphene_django/utils/__init__.py", line 2, in <module>
    from .utils import (
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/graphene_django/utils/utils.py", line 6, in <module>
    from django.utils.encoding import force_text
**ImportE**rror: cannot import name 'force_text' from 'django.utils.encoding' (/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/utils/encoding.py)****

[candlerb]

Could you edit your post and put three backticks (```) on a line of their own, before and after the backtrace? It will make it clearer, especially where double-underscores are concerned (so that e.g. __init.py__ doesn't appear as init.py)

Can you show the output from:

ls -l /opt/netbox

and

source /opt/netbox/venv/bin/activate
pip freeze

Also, do you have any plugins installed?

[nikos82]

ls -l /opt/netbox
lrwxrwxrwx 1 root root 18 Ιαν  24 12:50 /opt/netbox -> /opt/netbox-3.4.3/
pip freeze
aniso8601==7.0.0
asgiref==3.6.0
async-timeout==4.0.2
attrs==22.2.0
bleach==5.0.1
certifi==2022.12.7
cffi==1.15.1
charset-normalizer==3.0.1
click==8.1.3
coreapi==2.3.3
coreschema==0.0.4
cryptography==39.0.0
defusedxml==0.7.1
Django==4.0.7
django-cors-headers==3.13.0
django-debug-toolbar==3.6.0
django-filter==22.1
django-graphiql-debug-toolbar==0.2.0
django-js-asset==2.0.0
django-mptt==0.13.4
django-pglocks==1.0.4
django-prometheus==2.2.0
django-redis==5.2.0
django-rich==1.4.0
django-rq==2.5.1
django-tables2==2.4.1
django-taggit==3.0.0
django-timezone-field==5.0
djangorestframework==3.13.1
drf-yasg==1.21.3
ghp-import==2.1.0
graphene==2.1.9
graphene-django==2.15.0
graphql-core==2.3.2
graphql-relay==2.0.1
gunicorn==20.1.0
idna==3.4
importlib-metadata==6.0.0
inflection==0.5.1
itypes==1.2.0
Jinja2==3.1.2
jsonschema==3.2.0
Markdown==3.4.1
markdown-it-py==2.1.0
MarkupSafe==2.1.2
mdurl==0.1.2
mergedeep==1.3.4
mkdocs==1.3.0
mkdocs-autorefs==0.4.1
mkdocs-material==8.5.1
mkdocs-material-extensions==1.1.1
mkdocstrings==0.19.0
mkdocstrings-python-legacy==0.2.3
netaddr==0.8.0
oauthlib==3.2.2
packaging==23.0
Pillow==9.2.0
prometheus-client==0.16.0
promise==2.3
psycopg2-binary==2.9.3
pycparser==2.21
Pygments==2.14.0
PyJWT==2.6.0
pymdown-extensions==9.9.2
pyrsistent==0.19.3
python-dateutil==2.8.2
python3-openid==3.2.0
pytkdocs==0.16.1
pytz==2022.7.1
PyYAML==6.0
pyyaml_env_tag==0.1
redis==4.4.2
requests==2.28.2
requests-oauthlib==1.3.1
rich==13.2.0
rq==1.12.0
ruamel.yaml==0.17.21
ruamel.yaml.clib==0.2.7
Rx==1.6.3
sentry-sdk==1.9.8
singledispatch==4.0.0
six==1.16.0
social-auth-app-django==5.0.0
social-auth-core==4.3.0
sqlparse==0.4.3
svgwrite==1.4.3
swagger-spec-validator==3.0.3
tablib==3.2.1
text-unidecode==1.3
typing_extensions==4.4.0
tzdata==2022.7
uritemplate==4.1.1
urllib3==1.26.14
watchdog==2.2.1
webencodings==0.5.1
zipp==3.11.0

do you have any plugins installed?
No

[candlerb]

It seems to me that you have a broken /opt/netbox/requirements.txt

For Netbox 3.4.3, your /opt/netbox/requirements.txt should contain:

Django==4.1.5

But your pip freeze shows Django==4.0.7 (you did remember to do source /opt/netbox/venv/bin/activate immediately beforehand?)

The two most likely problems are:

1. Your requirements.txt (which is part of the netbox-3.4.3 release bundle) is broken. Compare it with this one. If they don't match, you should rm -rf /opt/netbox-3.4.3 and unzip/untar from a fresh bundle. Don't untar over what you already have; you must make sure there are no left-overs from previous versions of Netbox. (This assumes you didn't install Netbox from git; if you did, you wouldn't be using a symlink from /opt/netbox to /opt/netbox-3.4.3)
2. You are not running Netbox within a virtualenv, but all those packages have been installed globally. That will definitely break things. Follow the installation instructions properly; inside /opt/netbox run ./upgrade.sh and this will create a new virtualenv with all the right package versions.

The only other case where I saw that force_text error was in #8702 where the OP had not used a virtualenv.

For comparison, here is the pip freeze output from my Netbox v3.4.3 (I do have a couple of plugins installed)

(venv) root@netbox3:~# pip freeze
alabaster==0.7.13
aniso8601==9.0.1
asgiref==3.6.0
astroid==2.13.3
astunparse==1.6.3
async-timeout==4.0.2
attrs==22.2.0
Babel==2.11.0
backports.zoneinfo==0.2.1
bcrypt==4.0.1
black==23.1a1
bleach==5.0.1
build==0.10.0
CacheControl==0.12.11
certifi==2022.12.7
cffi==1.15.1
cfgv==3.3.1
charset-normalizer==3.0.1
ciscoconfparse==1.7.2
cleo==2.0.1
click==8.1.3
colorama==0.4.6
coreapi==2.3.3
coreschema==0.0.4
crashtest==0.4.1
cryptography==39.0.0
defusedxml==0.7.1
deprecat==2.1.1
dill==0.3.6
distlib==0.3.6
Django==4.1.5
django-cors-headers==3.13.0
django-filter==22.1
django-graphiql-debug-toolbar==0.2.0
django-js-asset==2.0.0
django-mptt==0.14.0
django-pglocks==1.0.4
django-prometheus==2.2.0
django-redis==5.2.0
django-rich==1.4.0
django-rq==2.6.0
django-tables2==2.5.1
django-taggit==3.1.0
django-timezone-field==5.0
django_debug_toolbar==3.8.1
djangorestframework==3.14.0
dnspython==2.3.0
docutils==0.17.1
drf-yasg==1.21.4
dulwich==0.20.50
ecdsa==0.18.0
exceptiongroup==1.1.0
filelock==3.9.0
future==0.18.3
ghp-import==2.1.0
graphene==3.2.1
graphene-django==3.0.0
graphql-core==3.2.3
graphql-relay==3.2.0
gunicorn==20.1.0
html5lib==1.1
identify==2.5.13
idna==3.4
imagesize==1.4.1
importlib-metadata==4.13.0
importlib-resources==5.10.2
inflection==0.5.1
iniconfig==2.0.0
isort==5.11.4
itypes==1.2.0
jaraco.classes==3.2.3
jeepney==0.8.0
Jinja2==3.1.2
jsonschema==4.17.3
junos-eznc==2.6.6
keyring==23.13.1
lazy-object-proxy==1.9.0
librouteros==3.2.1
lockfile==0.12.2
loguru==0.6.0
lxml==4.9.2
Markdown==3.3.7
markdown-it-py==2.1.0
MarkupSafe==2.1.2
mccabe==0.7.0
mdurl==0.1.2
mergedeep==1.3.4
mkdocs==1.4.2
mkdocs-autorefs==0.4.1
mkdocs-material==9.0.6
mkdocs-material-extensions==1.1.1
mkdocstrings==0.20.0
mkdocstrings-python-legacy==0.2.3
more-itertools==9.0.0
msgpack==1.0.4
mypy-extensions==0.4.3
napalm==3.4.1
napalm-ros==1.2.2
ncclient==0.6.13
netaddr==0.8.0
netbox-plugin-prometheus-sd @ git+https://github.com/FlxPeters/netbox-plugin-prometheus-sd@ea6ee219e88a479e31a843732386cfc4038ab854
netbox-topology-views @ git+https://github.com/mattieserver/netbox-topology-views@c0b36ca8d32fd7330b59f59d19f96df6783b3742
netmiko==3.4.0
nodeenv==1.7.0
ntc-templates==3.2.0
oauthlib==3.2.2
packaging==23.0
paramiko==3.0.0
passlib==1.7.4
pathspec==0.10.3
pbr==5.11.1
pep517==0.13.0
pexpect==4.8.0
Pillow==9.4.0
pkg_resources==0.0.0
pkginfo==1.9.6
pkgutil_resolve_name==1.3.10
platformdirs==2.6.2
pluggy==1.0.0
poetry==1.3.2
poetry-core==1.4.0
poetry-plugin-export==1.2.0
pre-commit==2.20.0
prometheus-client==0.15.0
promise==2.3
psycopg2-binary==2.9.5
ptyprocess==0.7.0
pyasn1==0.4.8
pycparser==2.21
pyeapi==0.8.4
Pygments==2.14.0
PyJWT==2.6.0
pylint==2.15.10
pymdown-extensions==9.9.2
PyNaCl==1.5.0
pyparsing==3.0.9
pyproject_hooks==1.0.0
pyroma==4.1
pyrsistent==0.19.3
pyserial==3.5
pytest==7.2.1
python-dateutil==2.8.2
python-jose==3.3.0
python3-openid==3.2.0
pytkdocs==0.16.1
pytz==2022.7.1
PyYAML==6.0
pyyaml_env_tag==0.1
rapidfuzz==2.13.7
redis==4.4.2
regex==2022.10.31
requests==2.28.2
requests-oauthlib==1.3.1
requests-toolbelt==0.10.1
rich==13.2.0
rq==1.12.0
rsa==4.9
ruamel.yaml==0.17.21
ruamel.yaml.clib==0.2.7
scp==0.14.4
SecretStorage==3.3.3
sentry-sdk==1.13.0
shellingham==1.5.0.post1
six==1.16.0
snowballstemmer==2.2.0
social-auth-app-django==5.0.0
social-auth-core==4.3.0
Sphinx==4.3.0
sphinx-bootstrap-theme==0.8.0
sphinxcontrib-devhelp==1.0.2
sphinxcontrib-htmlhelp==2.0.0
sphinxcontrib-jsmath==1.0.1
sphinxcontrib-qthelp==1.0.3
sphinxcontrib-serializinghtml==1.1.5
sphinxcontrib.applehelp==1.0.3
sqlparse==0.4.3
stevedore==4.1.1
svgwrite==1.4.3
swagger-spec-validator==3.0.3
tablib==3.3.0
tenacity==8.1.0
text-unidecode==1.3
textfsm==1.1.3
toml==0.10.2
tomli==2.0.1
tomlkit==0.11.6
transitions==0.9.0
trove-classifiers==2023.1.20
typing_extensions==4.4.0
tzdata==2022.7
uritemplate==4.1.1
urllib3==1.26.14
virtualenv==20.16.7
virtualenv-clone==0.5.7
virtualenvwrapper==4.8.4
watchdog==2.2.1
webencodings==0.5.1
wrapt==1.14.1
yamlordereddictloader==0.4.0
zipp==3.11.0

[nikos82]

i managed to update the requirements.txt file following your steps and seems to be better now but unfortunately i am getting a new message is related the DB.

---

Applying database migrations (python3 netbox/manage.py migrate)...
Operations to perform:
Apply all migrations: admin, auth, circuits, contenttypes, dcim, django_rq, extras, ipam, sessions, social_django, taggit, tenancy, users, virtualization, wireless
Running migrations:
Applying virtualization.0033_unique_constraints...Traceback (most recent call last):
File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 87, in _execute
return self.cursor.execute(sql)
psycopg2.errors.DuplicateTable: relation "virtualization_vminterface_unique_virtual_machine_name" already exists

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/netbox-3.4.3/netbox/manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/__init__.py", line 440, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/base.py", line 402, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/base.py", line 448, in execute
    output = self.handle(*args, **options)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/base.py", line 96, in wrapped
    res = handle_func(*args, **kwargs)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/core/management/commands/migrate.py", line 349, in handle
    post_migrate_state = executor.migrate(
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 135, in migrate
    state = self._migrate_all_forwards(
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
    state = self.apply_migration(
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/migrations/executor.py", line 252, in apply_migration
    state = migration.apply(state, schema_editor)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/migrations/migration.py", line 130, in apply
    operation.database_forwards(
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/migrations/operations/models.py", line 1040, in database_forwards
    schema_editor.add_constraint(model, self.constraint)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/base/schema.py", line 515, in add_constraint
    self.execute(sql, params=None)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/base/schema.py", line 199, in execute
    cursor.execute(sql, params)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
    return self._execute_with_wrappers(
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
    return executor(sql, params, many, context)
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
    with self.db.wrap_database_errors:
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/opt/netbox-3.4.3/venv/lib/python3.10/site-packages/django/db/backends/utils.py", line 87, in _execute
    return self.cursor.execute(sql)
**django.db.utils.ProgrammingError: relation "virtualization_vminterface_unique_virtual_machine_name" already exists**

[candlerb]

i managed to update the requirements.txt file

Note that I asked you to update the whole netbox package, not just requirements.txt. (I have no idea how it got into that state where the directory claimed to be /opt/netbox-3.4.3, but actually contained files from an older version)

Your database seems in a pretty broken state now. What you need to do is restore your postgres database from the last backup you took with Netbox 3.3.10, and then run ./upgrade.sh again. It will apply all the necessary updates from that point. Instructions for restoring the backup are here.

[nikos82]

Is a lab environment in order to test new versions :).
I would like to thank you for your assistance