Flash-MSA: Accelerating Million-Token Training with Sparse Attention Kernels

(nanduruganesh.github.io)

35 points | by rawsh 12 hours ago ago

4 comments