Hacker News56m agoenergy 106

Show HN: Which Mac runs which LLM, and how fast

image: Hacker News

Pick a Mac and a model, get the memory it needs and the tokens/sec to expect. Covers M1 to M6, every unified memory size, Q4 to FP16. Formula fitted and validated on our own measurements on two machines.

read the original at Hacker News →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.