-
Notifications
You must be signed in to change notification settings - Fork 37
Make eessi configure gpu node automatically #841
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
fbb37b9 to
7e7cb24
Compare
gpu node automatically
7e7cb24 to
2c45c6c
Compare
gpu node automatically
2c45c6c to
fa78672
Compare
| name: basic_users | ||
| when: enable_basic_users | ||
|
|
||
| - name: EESSI |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we should replace this whole EESSI block with running the configure task directly. But it is not obvious how to do this TBF ...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I've tried to describe it in https://wiki.stackhpc.com/doc/slurm-development-ZXjBRByl6K#h-only-inventory-vars
so you could change the entire eeesi thing to do this.
| cmd: "cvmfs_config setup" | ||
|
|
||
| # configure gpus | ||
| - name: Check for NVIDIA driver |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure whether there is always a /dev/nvidia0? Could you check with @jovial please for e.g MIG and vGPU configs? Else we'd have to do something like https://github.com/stackhpc/ansible-role-openhpc/blob/be6196540ca8007a0e45f2c3b2596ed0ff77fc13/library/gpu_info.py#L42 but TBH this approach here is much simpler!
| cmd: "cvmfs_config setup" | ||
|
|
||
| # configure gpus | ||
| - name: Check for NVIDIA driver |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Strictly, this is checking for the device, which is only present if the driver is loaded. So I suggest:
| - name: Check for NVIDIA driver | |
| - name: Check for NVIDIA GPU |
| path: /dev/nvidia0 | ||
| register: nvidia_driver | ||
|
|
||
| - name: Set fact if NVIDIA driver is present |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| - name: Set fact if NVIDIA driver is present | |
| - name: Set fact if NVIDIA GPU is present |
…pliance into configure-gpus Apply changes to task names
Add tasks to
eessi/configure.ymlandcompute-init.ymlto run the EESSIlink_nvidia_host_libraries.shscript on gpu nodes with nvidia drivers installed. The tasks will be run when eithersite.ymlis run or a rebuild via slurm is completed.