[Feat] HKV: optimize for small dim and format#234

rhdong wants to merge 1 commit intoNVIDIA-Merlin:masterNVIDIA-Merlin/HierarchicalKV:masterfrom

rhdong:rhdong/small-dim-draftrhdong/HierarchicalKV:rhdong/small-dim-draftCopy head branch name to clipboard