There are also the words paramor - an illicit lover of a married person, (so presumably either sex) and leman - a lover or seetheart, usually an illicit lover()again, probably either sex). The dictionary says that a Mistress is a woman, apart from his wife, with whom a married man has a sexual relationship, usually prolonged.

Love Lynne