🤖Fable 5 Performance Drops Post-Subscription Launch
Fable 5's Smarts Slipped After Going Subs
TL;DR
Fable 5's performance plummeted after being made permanently available in subscription plans, with reasoning capabilities dropping consistently over weeks. The model's performance varies greatly, with some days better than others, but the trend is clear: more data centers are needed to maintain peak performance.
Fable 5's performance dropped significantly after being made permanently available in subscription plans. The model felt dumber, with reasoning capabilities falling consistently over weeks. This isn't just a one-off issue; it's a trend that aligns with specific product announcements and releases. The drop in performance isn't just about a few bad days; it's a consistent trend where most invocations receive little to no thinking tokens. The findings, captured over a six-week period, highlight that access to frontier models no longer guarantees access to the inference regime that can reliably reproduce frontier model capabilities. As usage increases, models get dumber until more data centers are added, but performance improves once more data centers are brought online.
Key Points
Fable 5's performance dropped after being made permanently available in subscription plans, with reasoning capabilities falling over weeks.
August saw a dramatic drop in thinking tokens compared to July, measured five different ways.
The model's reasoning fell consistently over weeks, with fluctuations across multi-day episodes.
Some performance drops aligned with specific product announcements and releases.
Performance varies greatly, with some days feeling great and others terrible, but more data centers improve it.
Why It Matters
If you're relying on Fable 5 for critical reasoning tasks, the drop in performance could impact your workflows. The model's performance is affected by the inference regime served, meaning that as usage increases, models get dumber until more data centers are added. This affects teams using Fable 5 for complex reasoning tasks, where performance consistency is crucial.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 3,483 builders reading daily.