Skip to content
This repository was archived by the owner on Apr 3, 2024. It is now read-only.

[bug] k3s does not work with TT Scheduler #28

@shanoaice

Description

@shanoaice

This might be a duplicate of #14, though I am not sure.
When I attempted to start the k3s systemd service, it fails.
Full journalctl -eu k3s.service log is here: https://fars.ee/XESP

This line in the log seems to be the cause:

k3s[5373]: time="2023-09-27T22:03:57+08:00" level=fatal msg="failed to find cpu cgroup (v2)"

I am pretty sure I am using cgroup v2 unified hierarchy, and I gave proper Delegate to the cpu cgroup:

$ cat /sys/fs/cgroup/cgroup.controllers
cpuset io memory hugetlb pids rdma misc
$ cat /etc/systemd/system/user@.service.d/delegate.conf 
[Service]
Delegate=cpu cpuset io memory pids
$ systemctl show user@60255.service -p Delegate
Delegate=yes
$ cat /sys/fs/cgroup/user.slice/user-60255.slice/user@60255.service/cgroup.controllers
cpuset io memory pids

The cpu cgroup controller seems to be mysteriously missing when TT Scheduler is used, which causes the failure of k3s. This is not observed on linux kernel with CFS and the same config (other than TT specific config).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions