Yeah but I presume this has more to do with latency than overall compute, right?

Yes latency, and the usual preference of ownership over rentership. Similarly their are benefits to running local AI too, like data privacy and control.