[Reference Only] Shsanyal devpa 308 opt#1

Closed

tjtanaa wants to merge 10 commits intollama_fp8_12062024from

shsanyal_devpa_308_opt

Commits on Nov 10, 2024

opts v1
sanyalington
committed

Commits on Nov 18, 2024

opt logits and expsum calc
sanyalington
committed

Commits on Nov 20, 2024

Commits on Dec 1, 2024

fetch q in shared mem for better address patterns
sanyalington
committed

Commits on Dec 9, 2024

fp8 conversion optimizations; fast f32 -> bf16 rne conversion without inf/nan check
sanyalington
committed