-
Notifications
You must be signed in to change notification settings - Fork 929
Fix integer overflows with indexed datatype creation. #6482
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Can one of the admins verify this patch? |
|
ok to test |
|
Looks like a false Mellanox Jenkins failure bot:mellanox:retest |
The types of count, disp, and extent passed into ompi_datatype_add() should be size_t, ptrdiff_t and ptrdiff_t, respectively. This prevents integer overflows and errors in computing the size of large indexed datatypes. Signed-off-by: Austen Lauria <[email protected]>
831a328 to
b61e624
Compare
|
I'm not sure why the IBM CI didn't fire on this PR. Let's try to force it. |
|
I assume this is a somewhat esoteric bug fix (i.e., not likely to happen in many real world cases).
|
|
It's a bit of an edge case, but a solid fix. We will want this in at least the v4.0.x series, and should be considered for the v3.x series too - IMHO. |
|
For some more context on how it was found, it can be reproduced by calling So it is probably not a common case. |
|
That works for me. I 👍'ed @jjhursey's post; I wouldn't mind seeing this PR'ed to v3.0.x/v3.1.x/v4.0.x. |
The types of count, disp, and extent passed into
ompi_datatype_add() should be size_t, ptrdiff_t and ptrdiff_t,
respectively. This prevents integer overflows and errors in
computing the size of large indexed datatypes.
Signed-off-by: Austen Lauria [email protected]