Discussion about this post

User's avatar
Murali's avatar

Fantastic observation and insight! I have been thinking about this a LOT. I will add another wrinkle that has not pemeated the zeitgeist that much. We can all agree the cost per token usage going down has resulted in an explosion of usage and as you say here, the joules are joules, they dont care.

Here is the kicker: Historically these companies that offered SaaS pricing assuming the unit cost economics went down over time and were fixed, not its joules. So the most successful your customer, the more costly it is for you to afford them. So, rationinng of token usage which has already started will only continue and take an extreme shape. The logical cosequence of that will be people will use frontier models less and less and the Enterprises will shift to open source models that they manage themselves and can control the economics with upfront capex and not be hostage to surprises in opex cost. Uber and Microsoft are just a small sample what is likely to follow. My two cents.

Herve Cuviliez's avatar

And the Token Price war will intensify

New model on the block

The most intelligence per dollar.

Amazing results from @pathway_com team on ARC-AGI-1 : $0.0007 at 29.5%

~11x cheaper than GPT 5.6 Luna

Paper:

https://huggingface.co/papers/2608.09888

2 more comments...

No posts

Ready for more?