185 points | by admp 13 hours ago ago
4 comments
Relevant: https://news.ycombinator.com/item?id=44111452
Those who are expert at this, how many TPUs i need to run lets say
Gemini flash 2.5 and pro 2.5 models for 1 user?
Can I get a PCIe card with multiple units and An easy interface? Say 4 TPUs and 8 ram slots? $5,000???
Ah, and a psuedo dupe of https://news.ycombinator.com/item?id=44944592 but I'll be straight that I think the current point spread is accurate because I much prefer the repo link to some random .com domain
Relevant: https://news.ycombinator.com/item?id=44111452
Those who are expert at this, how many TPUs i need to run lets say
Gemini flash 2.5 and pro 2.5 models for 1 user?
Can I get a PCIe card with multiple units and An easy interface? Say 4 TPUs and 8 ram slots? $5,000???
Ah, and a psuedo dupe of https://news.ycombinator.com/item?id=44944592 but I'll be straight that I think the current point spread is accurate because I much prefer the repo link to some random .com domain