How about making it a site where only people who answer questions can even be eligible to be moderators?

What if moderators had to actually have karma from recently answering questions or they lose mod privileges?

Wouldn't that be a fresh change. You'd have to actually work to be a mod.

...

It shouldn't be controversial. That mods currently make visitors unwelcome is disgrace. :(

That SO incentivizes that behavior is ridiculous.