But I personally find small town or rural living too parochial. Not that there aren't plenty of opinionated people in the city, but it's easier to blend in, and go about your business unmolested. Harder to go against the grain in Smallville.
But that does bring up a point about not wanting to live in certain places for, shall we call it, "compatability" reasons. Just about anywhere one can live, there are places where you wouldn't want to make a wrong turn and end up there, whether it's a bad neighborhood in the hood, or up a holler somewhere wherein they "don't take kindly to strangers". But that covers a lot of territory, i.e. much of the planet...