No kidding, if there's a culture that requires me to have a broadsword strapped to my back at all times, SIGN ME UP!
I would have been torn about this a while ago, but I recently read a great article written by a Muslim woman about this and why it is her choice and for her not a woman's rights issue.. so now I would just say no, let's not ban all instances of a style of dress just because it means something to some people.
I wish I could find the article though to link to.