Replies: 1 comment 1 reply
-
Found out this issue and it seems that the contributors are used to check the possible leaks with this tool. I will go with this tool. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
How do you guys profile the memory usage of the deployed model?
I am deploying a model using triton serving, but turns out the host memory increases as the number of requests increases during the stress test. I am trying to figure out what part of my model occurs the leak and seeing this document.
I tried with nsys and capture the nsys report, but I couldn't find the memory heap stacks in the report...
Thank you in advance.
Beta Was this translation helpful? Give feedback.
All reactions