Well, the left claims Trump needs them.
You're position on this is indistinguishable from the hardcore left. I say 'hardcore' because the left is solidly behind the erstwhile Nazis, Antifa. That makes the left as harcare as Antifa.
Since you're so familiar with the Nazis, I'm sure you recall how Hitler's thugs would shut down the opposition with violence.
Say what you will about the Charlottesville Nazis, but they weren't there to shut anyone down. In fact, one could argue they got out-Nazi'd by Antifa.
You don't allow that the opposing argument is legitimate. Some people [a majority if you believe the polls] believe the statues have at least some historical import. Just because someone holds that opinion doesn't make them a Nazi sympathizer.
And if you think this country has that many Nazi sympathizers, I feel bad for you. I'd consider moving somewhere else, in fact.