Toppling Confederate statues suggests that the North(Union) was actually some sort of advocate for black people. Abraham Lincoln did not even want to end slavery, his proposal was to continue slavery where it already existed, but only prohibit it in westward expansion states. Ending slavery was purely economic and political, and had to do with removing the oligarch type plantation owners of the South and their monopolies, and preparing for the industrial Revolution, with a society based on ingenuity and invention, as in New York during the late 1800's(electricity, modern railway, shipping and trade, steel,stock market,etc) Ending slavery was to bring about this shift from agricultural monopolies to the technological society we have today. Had NOTHING to do with civil rights.
VERY few at the time gave a shit about black lives mattering, from the North or South.