Hacker News: frontier AIfrontier ai1h agoenergy 110
Ask HN: Can anyone run frontier AI models at usable speeds?
image: Hacker News: frontier AI
Eight months ago, EXO labs promised fast inference on local hardware. But it is not fast enough. It takes a minute and a half to get a response through hermes, using Kimi K2.6. Is there hardware that a dev can buy that can actually offset cloud bills? Comments URL: https://news.ycombinator.com/item?id=50394913 Points: 1 # Comments: 0
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.