borg 1.1: issues with corrupted repositories

[neil541]

My old server crashed, i want recover the data from the bakcup. there are two backup, is 20240209 and 20240404.
when use borg list 20240404，will have error as below, but 20240209 list is ok ,but can't extract.

[root@minlei 2024bak]# borg list 20240404/Backup/
Exception ignored in: <bound method Repository.__del__ of <Repository /mnt/sdc1/2024bak/20240404/Backup>>
Traceback (most recent call last):
  File "/usr/lib64/python3.6/site-packages/borg/repository.py", line 189, in __del__
    assert False, "cleanup happened in Repository.__del__"
AssertionError: cleanup happened in Repository.__del__
Local Exception
Traceback (most recent call last):
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 4886, in main
    exit_code = archiver.run(args)
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 4818, in run
    return set_ec(func(args))
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 163, in wrapper
    with repository:
  File "/usr/lib64/python3.6/site-packages/borg/repository.py", line 199, in __enter__
    self.open(self.path, bool(self.exclusive), lock_wait=self.lock_wait, lock=self.do_lock)
  File "/usr/lib64/python3.6/site-packages/borg/repository.py", line 437, in open
    self.config.read_file(fd)
  File "/usr/lib64/python3.6/configparser.py", line 718, in read_file
    self._read(f, source)
  File "/usr/lib64/python3.6/configparser.py", line 1015, in _read
    for lineno, line in enumerate(fp, start=1):
  File "/usr/lib64/python3.6/encodings/ascii.py", line 26, in decode
    return codecs.ascii_decode(input, self.errors)[0]
UnicodeDecodeError: 'ascii' codec can't decode byte 0xd2 in position 1: ordinal not in range(128)

Platform: Linux minlei 3.10.0-1160.102.1.el7.x86_64 #1 SMP Tue Oct 17 15:42:21 UTC 2023 x86_64
Linux: CentOS Linux 7.9.2009 Core
Borg: 1.1.18  Python: CPython 3.6.8 msgpack: 0.5.6
PID: 4330  CWD: /mnt/sdc1/2024bak
sys.argv: ['/usr/bin/borg', 'list', '20240404/Backup/']
SSH_ORIGINAL_COMMAND: None

[root@minlei 2024bak]# borg extract 20240209/Backup::2023-09-21T08:01:02
Enter passphrase for key /mnt/2024bak/20240209/Backup: 
Object with key b07aadea24e7b05c40e999d2ab24e33c2592835113d8522400fb9d7c77b2e330 not found in repository /mnt/2024bak/20240209/Backup.
Traceback (most recent call last):
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 4886, in main
    exit_code = archiver.run(args)
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 4818, in run
    return set_ec(func(args))
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 178, in wrapper
    return method(self, args, repository=repository, **kwargs)
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 193, in wrapper
    return method(self, args, repository=repository, manifest=manifest, key=key, archive=archive, **kwargs)
  File "/usr/lib64/python3.6/site-packages/borg/archiver.py", line 792, in do_extract
    preload=True, hardlink_masters=hardlink_masters):
  File "/usr/lib64/python3.6/site-packages/borg/archive.py", line 483, in iter_items
    filter=lambda item: self.item_filter(item, filter)):
  File "/usr/lib64/python3.6/site-packages/borg/archive.py", line 214, in unpack_many
    for data in self.fetch_many(ids):
  File "/usr/lib64/python3.6/site-packages/borg/archive.py", line 257, in fetch_many
    for id_, data in zip(ids, self.repository.get_many(ids, is_preloaded=is_preloaded)):
  File "/usr/lib64/python3.6/site-packages/borg/repository.py", line 1153, in get_many
    yield self.get(id_)
  File "/usr/lib64/python3.6/site-packages/borg/repository.py", line 1149, in get
    raise self.ObjectNotFound(id, self.path) from None
borg.repository.Repository.ObjectNotFound: Object with key b07aadea24e7b05c40e999d2ab24e33c2592835113d8522400fb9d7c77b2e330 not found in repository /mnt/2024bak/20240209/Backup.

Platform: Linux minlei 3.10.0-1160.102.1.el7.x86_64 #1 SMP Tue Oct 17 15:42:21 UTC 2023 x86_64
Linux: CentOS Linux 7.9.2009 Core
Borg: 1.1.18  Python: CPython 3.6.8 msgpack: 0.5.6
PID: 8449  CWD: /mnt/2024bak
sys.argv: ['/usr/bin/borg', 'extract', '20240209/Backup::2023-09-21T08:01:02']
SSH_ORIGINAL_COMMAND: None

[ThomasWaldmann]

The issue with the repository 20240404/Backup/ is that its config file seems damaged.

20240404/Backup/config should be a normal, pure ASCII content text file - have a look at what you see in there.

[ThomasWaldmann]

The issue with the repository 20240209/Backup/ is that it is corrupted and misses some objects.

Make sure your hardware works correctly and the filesystem is OK (do a fsck).

Then run borg check --repair -v on the repository. That can't bring data back that is already lost, but it will do a best effort to bring the repo back into a consistent and usable state.

If you are not sure whether the hw and fs are ok, you can also first run without the --repair option and, if that worked normally, do the repair afterwards.

[neil541]

Yes, 20240404/Backup/config is damaged, can the file be repaired? thank you

[neil541]

thanks, run borg check --repair -v can repair the data but lost much data, if the backup is use 1.0 borgbackup version, and recover use 1.1 version, does it cause this issue?

[ThomasWaldmann]

config: it depends. if you did not use encryption, you could maybe create a temporary repository and use the config you get there as a template. make sure to change the id, so it is unique.

BTW, borg does a lot to avoid losing or damaging its repo config. But it happened on your system, so that likely means that your HW or OS does not work correctly / reliably (that might also explain the issues in the other repository).

IIRC, borg 1.1 should work with a borg 1.0 repository. If you want to make sure, read the change log. Both are very old versions.

[neil541]

Got it, thank you very much.