r/singularitycontext window1h agoenergy 116
Mirendil announces Fern v0.1: Their first model with a 10M context window
image: r/singularity
They claim it was created with a single researcher and under $10 million spent on the model. Theyve only said that it is somewhere between 0.1 and 0.5T parameters in size. Benchmarks aren't super impressive, but they claim this is just the first very early checkpoint and that they also have two much larger models undergoing training right now.
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.