Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Whenever someone figures out why it's consuming so many tokens lately, that's the post worth upvoting.


What do you mean? Costs spiked with the introduction of the 1M context window I believe due to larger average cached input tokens, which dominate cost.


Nah, there's apparently a few caching bugs, one --resume and some noisy tool use. I have a little app that monitors and resets the context window at 70% usage based on 200k tokens and I'm about to run out of weekly allowance after just a couple days. Never happened before




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: