Skip to content

Conversation

@awlauria
Copy link
Contributor

The types of count, disp, and extent passed into
ompi_datatype_add() should be size_t, ptrdiff_t and ptrdiff_t,
respectively. This prevents integer overflows and errors in
computing the size of large indexed datatypes.

Signed-off-by: Austen Lauria [email protected]
(cherry picked from commit b61e624)
Signed-off-by: Austen Lauria [email protected]

The types of count, disp, and extent passed into
ompi_datatype_add() should be size_t, ptrdiff_t and ptrdiff_t,
respectively. This prevents integer overflows and errors in
computing the size of large indexed datatypes.

Signed-off-by: Austen Lauria <[email protected]>
(cherry picked from commit b61e624)
Signed-off-by: Austen Lauria <[email protected]>
@ompiteam-bot
Copy link

Can one of the admins verify this patch?

@jsquyres jsquyres changed the title Fix integer overflows with indexed datatype creation. v3.1.x: Fix integer overflows with indexed datatype creation. Mar 13, 2019
@jsquyres jsquyres added this to the v3.1.4 milestone Mar 13, 2019
@jsquyres
Copy link
Member

ok to test

@jsquyres jsquyres merged commit 4f8d80e into open-mpi:v3.1.x Mar 18, 2019
@awlauria awlauria deleted the indexed_datatype_overflows_v3.1.x branch March 17, 2022 17:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants