All I want is for the game to remain small enough that running games is doable and it retains the small town feeling where people know each other.

The number of characters that actually know everyone else is very, very limited. I highly dislike this argument because it's not valid for most of the characters in the game. As some other people pointed out, adding two teams wouldn't even ruin that.