4 points | by erans 13 hours ago ago
2 comments
I also added a Mac version: https://selfhostllm.org/mac/ so you can know which models you can run on your Mac and get an estimated tokens/sec.
Very useful, thanks. I'm missing a reset button though.
I also added a Mac version: https://selfhostllm.org/mac/ so you can know which models you can run on your Mac and get an estimated tokens/sec.
Very useful, thanks. I'm missing a reset button though.