。、、。
That's not it. Putting aside sexism, putting aside misogyny, men and women are just different.
Literal
That is-not. Gender-discrimination [and-やら] female-contempt [and-やら], that-kind-of thing [with-とは] not-related-[and-く], man [and-と] woman [topic-は] different-are-[explanation-んだ].
そうじゃない is a casual denial/clarification: 'that's not what I mean.' やら...やら lists items in a slightly emphatic way — 'what with X and Y.' ~とは関係なく ('without relation to X') is a fixed expression scoping out a concern. 男と女は違う is the core claim; んだ gives it explanatory force. The sentence delicately tries to differentiate a biological-essentialist claim from ideological positions — a rhetorical move that itself is culturally specific.