You're right. In small towns, actions have consequences and people pay heavy prices for failing to conform and/or disgracing themselves.
You can't very well hide in a small town. People know who you are and tend not to forget what you've done. They aren't easy places for messed up people. City life is easier. There, social dregs can blend in and be forgotten.
On the minus side, small town suicides are more common. There are standards of conduct that are difficult to escape. On the plus side, small town decency and strength are ingrained in nearly everyone. The easiest place to live therefore depends on the person. Which is important to you?
You've written something intelligent, zz. You should do it more often.