I am pretty sure there are many people living in swiss with temporary visa's and those will then be de facto kicked out, if they do not get their permissions extended.

Either these are already counted in the 9.5M, or they will continue not to be counted.

This. As immigrant I don't feel threatened by this at all. I can't vote, and I wouldn't vote for SVP but as far as I can tell this makes kinda sense.