at the end of the day its going to be your word vs his (unless you had several people hear it). The timekeeper is obviously on his side. While what he said was obviously disgusting I think your best off forgetting about it.
Not because I see not big deal but I think it would be a big waste of your time trying to fight a battle that doesnt look like you can win. Then again, it depends on how much time you have
