Implying *you* are on the right side of History.
Basically, nobody knows.
Equal rights for gay people, right or wrong side of History? The future will tell us. Well, Roman Empire and Greek empire which were quite gay friendly may give you some hints.
Women's equality? Let's see... Natality well under renewing rate, abortions skyrocketing, relatively low wages for all excepted for the 1%, structural high jobless rate, small jobs... Present seems to give you some kind of hints too. So, right or wrong side?
Implying all white people were in favor of colonialism... Please, check back your History books, if you have some, and learn who actually initiated and ruled colonialism, for what reasons, and if the average "white angry men" of these times weren't the first victims of colonialism.
Slavery, then segregation? Again, check your History books and learn who was segregated first. Again some hints, African tribes, Roman empire, middle age Europe...
Now, I won't tell you: *you* are on the wrong side of History, for I don't know. I have some ideas, of course; but the future will tell us who were wrong of right.
In all case, I'll never blame or accuse yourself, personally, by incorporating your miserable being in a group of people from history you share some characteristics with, notwithstanding what you actually did.
History is History.