Hacker News22h agoenergy 51
Why Is Speculative Decoding Fast?
image: Hacker News
It's not because you do less work. It's because you change the kind of work the GPU is doing.
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.