But then again in my case it isn't "ruining the non-genderedness of my LJ", since I said in the first place I was happy to take requests for other pronouns.

The use of gender-free language, because of the very fact that it is used universally, has no such implications.

Logically true, but it still might have associations that a particular person dislikes.

I think that makes sense if you think of pronouns as a sort of name. There are names which are clearly "not my name". But there are also some names which logically belong to me but which (for whatever reason) I don't enjoy being called.

I would be interested myself if aegidian would like to elaborate on the feelings/reasons behind wanting to be referred to by male pronouns, but not from the point of view of "justify it" - just out of curiosity.