The power of small models isn't only that you can run them on local hardware. You can also fully own your data and workflow, and choose/fine-tune models for your specific use-case.

for clarity, I'm not agreeing with GP that small models will mean doom for data center projects