Skip to content

Archive not working? #14

@oscarminus

Description

@oscarminus

Yesterday, i have realized, that the storage of the cc-metric-store reached >500GB. After some investigationit seems that the archive function isn't working properly:

For example node n2cn0740: The last archive was created on July, 19th. Checkpoint files exist back to July, 13th. Other nodes show a similar behavior.

[root@srv-o2e-403-36 var]# ls archive/noctua2/n2cn0740/ -lah
insgesamt 496K
drwxr-xr-x    2 clustercockpit clustercockpit 4,0K 19. Jul 18:10 .
drwxr-xr-x 1122 clustercockpit clustercockpit  36K 26. Jul 18:10 ..
-rw-r--r--    1 clustercockpit clustercockpit 456K 19. Jul 18:10 1657642221.zip
[root@srv-o2e-403-36 var]# ls checkpoints/noctua2/n2cn0740/ -lah | head
insgesamt 537M
drwxr-xr-x    2 clustercockpit clustercockpit 4,0K 10. Aug 09:13 .
drwxr-xr-x 1124 clustercockpit clustercockpit  36K 28. Jul 12:10 ..
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 13. Jul 00:10 1657642221.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 13. Jul 06:10 1657663821.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 13. Jul 12:10 1657685421.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 13. Jul 18:10 1657707021.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 14. Jul 00:10 1657728621.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 14. Jul 06:10 1657750221.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 14. Jul 12:10 1657771821.json
[root@srv-o2e-403-36 var]# ls checkpoints/noctua2/n2cn0740/ -lah | tail
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  8. Aug 06:10 1659910221.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  8. Aug 12:10 1659931821.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  8. Aug 18:10 1659953421.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  9. Aug 00:10 1659975021.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  9. Aug 06:10 1659996621.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  9. Aug 12:10 1660018221.json
-rw-r--r--    1 clustercockpit clustercockpit 2,5M  9. Aug 15:12 1660039821.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M  9. Aug 21:13 1660050802.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 10. Aug 03:13 1660072402.json
-rw-r--r--    1 clustercockpit clustercockpit 4,8M 10. Aug 09:13 1660094002.json
[root@srv-o2e-403-36 var]# date
Mi 10. Aug 10:58:22 CEST 2022

The archive and checkpoint values in the config file are set as following:

    "checkpoints": {
        "interval": "6h",
        "directory": "./var/checkpoints",
        "restore": "6h"
    },
    "archive": {
        "interval": "168h",
        "directory": "./var/archive"
    },
    "retention-in-memory": "24h"

I didn't see anything related to archives in the log file.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions