> Supposedly the performance of Owen-coder is comparable to the likes of Sonnet4. If I invest in a homelab that can host something like Qwen3 I'll recoup my costs in about 20 months without having to rely on Anthropic.
Presently, look up the Cerebra Coder subscription. It’s cut down my reliance on paying per token by about 80% due to the model being good for most development tasks and the rate limits are such that I never hit them per day, alongside being faster than anything else out there.
Lots of folks also just explore new models on OpenRouter as they come on, albeit they don’t seem to have caching support so it can get expensive.
Aside from that, self-hosting can be worth it but you need lots of memory and beefy compute to have good performance without quantizing things super far. There’s a really big difference between the 30B and 480B versions of Qwen Coder and while the smaller models are getting better, feels like there are diminishing returns there.
Presently, look up the Cerebra Coder subscription. It’s cut down my reliance on paying per token by about 80% due to the model being good for most development tasks and the rate limits are such that I never hit them per day, alongside being faster than anything else out there.
Lots of folks also just explore new models on OpenRouter as they come on, albeit they don’t seem to have caching support so it can get expensive.
Aside from that, self-hosting can be worth it but you need lots of memory and beefy compute to have good performance without quantizing things super far. There’s a really big difference between the 30B and 480B versions of Qwen Coder and while the smaller models are getting better, feels like there are diminishing returns there.