Skip to content

Add fp16 mixed precision softmax#1950

Draft
kaix-nv wants to merge 28 commits into
mainfrom
kaix/sparse_attn_quant_mixed_fp16
Draft

Add fp16 mixed precision softmax#1950
kaix-nv wants to merge 28 commits into
mainfrom
kaix/sparse_attn_quant_mixed_fp16