I see no reason that a man should have any issue with worshiping a goddess any more than a woman would in worshiping a male deity. It is undeniable that women, particularly in the Abrahamic faiths, have been doing just that for thousands of years, though they do like to sneak in the divine feminine under the cloak of the Virgin Mary.