There are circumstances in which I see why you might wish to do so. The Iraqi people pulling down Saddam Hussein's statues is one of those. They did so immediately after his defeat.
But making a case against a statue of a man who is commemorated for events of 150 years ago isn't one of them. He did some good things and some bad things. Same as folks living now will turn out to have backed policies which people will one day find iniquitous.
Some folks saw some good in his life. Maybe he represents a sense of Southern independence to some people now. And to some he is a reconciling figure once the civil war was over. Others bring up things they (and most folks today) think are wrong. A statue can represent both of these things. That people can be seen in different ways.
"I look upon secession as anarchy. If I owned the four millions of slaves in the South I would sacrifice them all to the Union; but how can I draw my sword upon Virginia, my native state?" These words of General Lee's aren't those of a slave-owning zealot. In context, they seem reasonably honourable in a situation for him in which choosing sides was tricky. Indeed, they are not so different from Lincoln's own in assessing the relative value of the Union and slavery. But he decided he was a Virginian above either of these things.
I'd just leave the statues alone. Leaving them alone isn't an expression of support for Robert E Lee. It's just saying that it isn't necessary to rip the scab off a wound.