"When you make statements that are counteractive to the presentation you've been making, half or more of your audience may disown you," the Big & Rich singer said.