Where does “異性” come from?

異性 (Japanese): the opposite sex the other gender to which one is referring