Upgrading from 2.8 is failing...

[greod]

Hello everyone,

First of all : thanks a lot for this awesome piece of software that Netbox is... We never came across a better IPAM software that is easy enought for low tech people to apprehend, but complex enough to respond to the most advanced needs.

Now, to my question :

I'm in the process of upgrading an old version of Netbox (2.5... don't ask why we never upgraded before...) to something fancier and (definitely) more recent... I managed to upgrade everything to 2.8.9 after upgrading the server OS and libraries (Debian 9 => 10 => 11 and python 3.5 => 3.9).

However, even after searching everywhere, I'm stuck on the upgrade from 2.8.9 to 2.9.11 or any later releases (2.11.12 is not working either).

Here is the error I have running the upgrade script for 2.9.11 or 2.11.12, at the Database migration step :

Operations to perform:
Apply all migrations: admin, auth, circuits, contenttypes, dcim, extras, ipam, secrets, sessions, taggit, tenancy, users, virtualization
Running migrations:
Applying auth.0012_alter_user_first_name_max_length... OK
Applying virtualization.0015_vminterface... OK
Applying ipam.0037_ipaddress_assignment... OK
Applying virtualization.0016_replicate_interfaces...
Replicating 0 VM interfaces...
Replicating assigned objects...
OK
Applying virtualization.0017_update_jsonfield... OK
Applying virtualization.0018_custom_field_data... OK
Applying tenancy.0010_custom_field_data... OK
Applying users.0007_proxy_group_user... OK
Applying users.0008_objectpermission... OK
Applying users.0009_replicate_permissions...Traceback (most recent call last):
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
psycopg2.errors.SyntaxError: ERROR: syntax error on or near « ON »
LINE 1: ...ctpermission_id", "contenttype_id") VALUES (1, 9) ON CONFLIC...
^

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/opt/netbox-2.11.12/netbox/manage.py", line 10, in
execute_from_command_line(sys.argv)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/init.py", line 419, in execute_from_command_line
utility.execute()
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/init.py", line 413, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/base.py", line 354, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/base.py", line 398, in execute
output = self.handle(*args, **options)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/base.py", line 89, in wrapped
res = handle_func(*args, **kwargs)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/core/management/commands/migrate.py", line 244, in handle
post_migrate_state = executor.migrate(
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/migrations/executor.py", line 117, in migrate
state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, fake_initial=fake_initial)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/migrations/executor.py", line 147, in _migrate_all_forwards
state = self.apply_migration(state, migration, fake=fake, fake_initial=fake_initial)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/migrations/executor.py", line 227, in apply_migration
state = migration.apply(state, schema_editor)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/migrations/migration.py", line 126, in apply
operation.database_forwards(self.app_label, schema_editor, old_state, project_state)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/migrations/operations/special.py", line 190, in database_forwards
self.code(from_state.apps, schema_editor)
File "/opt/netbox-2.11.12/netbox/users/migrations/0009_replicate_permissions.py", line 55, in replicate_permissions
obj_perm.object_types.add(perm.content_type)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/fields/related_descriptors.py", line 950, in add
self._add_items(
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/fields/related_descriptors.py", line 1130, in _add_items
self.through._default_manager.using(db).bulk_create([
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/cacheops/query.py", line 372, in bulk_create
objs = self._no_monkey.bulk_create(self, objs, *args, **kwargs)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/query.py", line 514, in bulk_create
returned_columns = self._batched_insert(
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/query.py", line 1293, in _batched_insert
self._insert(item, fields=fields, using=self.db, ignore_conflicts=ignore_conflicts)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/query.py", line 1270, in _insert
return query.get_compiler(using=using).execute_sql(returning_fields)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/models/sql/compiler.py", line 1416, in execute_sql
cursor.execute(sql, params)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/cacheops/transaction.py", line 97, in execute
result = self._no_monkey.execute(self, sql, params)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 66, in execute
return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
return executor(sql, params, many, context)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/utils.py", line 90, in exit
raise dj_exc_value.with_traceback(traceback) from exc_value
File "/opt/netbox-2.11.12/venv/lib/python3.9/site-packages/django/db/backends/utils.py", line 84, in _execute
return self.cursor.execute(sql, params)
django.db.utils.ProgrammingError: ERROR: syntax error on or near « ON »
LINE 1: ...ctpermission_id", "contenttype_id") VALUES (1, 9) ON CONFLIC...

Would you have any idea on why it happens... And how to solve this ? I searched everywhere for a similar issue, but didn't find anything relevant... Your help would be most helpful !

Kind regards.

[drmsoffall]

This looks like a PostgreSQL syntax error. Postgres minimum versions have changed over time and, as I remember it, aren't checked by the upgrade script. Make sure you're running at least v10 if you want to be safe per the docs; I've run v12 successfully with NetBox 2.11 in the past.

[greod]

Thanks a lot ! It was indeed a PostgreSQL version issue. The server was still running a 9.4 Cluster in parallel with a 9.6, 11 and 13...

For those who might have the same kind of issue, I had to follow these steps :

systemctl stop postgresql
pg_dropcluster --stop 13 main
pg_upgradecluster 9.4 main
systemctl start postgresql

The database is migrated from 9.4 to 13 (or the last version available on the server) automatically.

The upgrade process is way easier with a newer version of PostgreSQL, as I was able to migrate from 2.7 to 2.11 in one shot, without any error.

I add to the great piece of software, the great community, full of insightful members :-)