A Self-Pruning Transformer: Extreme KV-Cache Compression w/Universal Attention

 (arxiv.org)

6 points | by matt_d 11 hours ago ago

No comments yet.