r/singularitybenchmark3h agoenergy 111

Muse Wonder (high) scores 1.96 on the Short Story Creative Writing Benchmark, compared with 0.56 for Muse Spark 1.3 (high). Gemini 4 Argon (high) scores 0.80, up from −2.17 for Gemini 3.1 Pro Preview.

image: r/singularity

https://github.com/lechmazur/writing/ Argon's improvement over Gemini 3.1 Pro is large. It won all 50 matched story comparisons. Required objects, abilities, and constraints more often affect what happens in the story. Characters' solutions have clearer preparation and consequences, and relationships more often involve reciprocal needs. Gemini 3.1 Pro more frequently supplies symbolic ingredients and then explains that the problem has been solved. Argon still has recognizable habits: repeated names, explanatory narration, and endings that resolve emotional conflict too neatly. Stronger construction has not eliminated repetition or made its writing consistently subtle. https://github.com/lechmazur/writing/blob/main/reports/pair_analysis/gemini-4-argon-high__vs__gemini-3.1-pro-preview__comparator_v2_eval_v4_gemini_argon_vs_gemini31_20261013_n50__subjective_v5_habits_range.md The Creative Writing Benchmark tests how well models turn constrained briefs into complete 600-800-word stories. Each brief specifies 10 required elements, including a character, object, setting, motivation, and tone, that must meaningfully shape the story. Judges assess prose, originality, coherence, characteriz

read the original at r/singularity →
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.