[Reference only] Shsanyal devpa 308 opt into main#2

Closed

tjtanaa wants to merge 10 commits intomainfrom

shsanyal_devpa_308_opt

Commits on Nov 10, 2024

opts v1
sanyalington
committed

Commits on Nov 18, 2024

opt logits and expsum calc
sanyalington
committed

Commits on Nov 20, 2024

Commits on Dec 1, 2024

fetch q in shared mem for better address patterns
sanyalington
committed

Commits on Dec 9, 2024

fp8 conversion optimizations; fast f32 -> bf16 rne conversion without inf/nan check
sanyalington
committed