Skip to content

Optimized BGEMV for NEOVERSEV1 target #5394

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
martin-frbg merged 1 commit into from
Jul 23, 2025
Merged

Optimized BGEMV for NEOVERSEV1 target #5394

martin-frbg merged 1 commit into from
Jul 23, 2025

Conversation

@Mousius
Copy link
Contributor

@Mousius Mousius commented Jul 23, 2025 •
edited
Loading

  • Adds bgemv T based off of sbgemv T kernel
  • Adds bgemv N which is slightly alterated to not use Y as an accumulator due to the output being bf16 which results in loss of precision
  • Enables BGEMM_GEMV_FORWARD to proxy BGEMM to BGEMV with new kernels

@Mousius
Optimized BGEMV for NEOVERSEV1 target
2c3cdaf 
- Adds bgemv T based off of sbgemv T kernel
- Adds bgemv N which is slightly alterated to not use Y as an
accumulator due to the output being bf16 which results in loss of
precision
- Enables BGEMM_GEMV_FORWARD to proxy BGEMM to BGEMV with new kernels
@Mousius Mousius changed the title Optimized BGEMV for NEOVERSEN2, NEOVERSEV1 and NEOVERSEV2 targets Optimized BGEMV for NEOVERSEV1 target Jul 23, 2025
@martin-frbg martin-frbg added this to the 0.3.31 milestone Jul 23, 2025
@martin-frbg martin-frbg merged commit 392d381 into OpenMathLib:develop Jul 23, 2025
81 of 88 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

0.3.31

Development

Successfully merging this pull request may close these issues.

2 participants

@Mousius @martin-frbg