Did you even read the quote? He is clearly not saying he would go back to that time because women can’t vote. Here is his stated reason:

"because in those days we had people who fought for real social change, and they were called Republicans.”

His actual reason is still dumb. You don’t have to make up a false meaning to his statement to disagree with it. It’s disagreeable all on its own.