Skip to content

Conversation

@kirklandsign
Copy link
Contributor

@kirklandsign kirklandsign commented May 1, 2025

Temperature was garbage value, and could cause issue in llm generation sampler.

@pytorch-bot
Copy link

pytorch-bot bot commented May 1, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10619

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@kirklandsign kirklandsign marked this pull request as ready for review May 1, 2025 19:16
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 1, 2025
@kirklandsign kirklandsign added the release notes: misc Miscellaneous label May 1, 2025
@kirklandsign kirklandsign requested a review from Copilot May 1, 2025 19:48
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR addresses an uninitialized temperature variable in the Android JNI layer, which previously would have produced garbage values and caused issues in the LLama generation sampler.

  • Initializes temperature_ by providing a default value of 0.0f.
  • Ensures the passed temperature parameter properly updates temperature_ in the initialization routine.

@shoumikhin shoumikhin merged commit b8b43f6 into main May 1, 2025
8 of 9 checks passed
@shoumikhin shoumikhin deleted the android-fix-temperature branch May 1, 2025 19:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. release notes: misc Miscellaneous

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants