Fathom: Per-query read depth for sparse decoding over offloaded KV caches

 (arxiv.org)

1 points | by vivekkalyanaran 4 hours ago ago

1 comments