IMHO the final conclusion that consuming deepfake porn is wrong mainly because deepfakes of men are rarely produced is unsatisfying as I don't see behaviour which is different between genders necessarily as evil. Men consume more porn and are usually early adopters and indeed, all the deepfakes of male actors I found were gay porn.
Downstream effects like sharing deepfakes are unfair because it show people in situations they never have been. However, there is even a subtle difference in consuming deepfake porn others have made and fantasies: Consuming other people's porn may shape one's fantasies, while having fantasies or creating deepfakes yourself just reproduce your own ideas. I am not sure if it is a meaningful difference, but it is certainly one you could base consistent morals distinguishing both actions on.