I'm really surprised at a lot of what people mention but considering nobody has mentioned my most hair raising sound I guess I'm kind of a freak as well.
It absolutely drives me nuts when I hear the sound of paper towel, or napkins in those metal napkin holders some restaurants have, being pulled out of their containers. If I have to pull out paper towel in a restroom I will do it as fast as possible to avoid that sound as much as I can.