Hacker Newstransformer3h agoenergy 110
Scaling Hierarchical Networks
image: Hacker News
A newer generation of H-Nets learns directly from raw bytes, and matches an open-source 3B Transformer with 10x less compute and data.
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.