^ Your form also matters. Holding the camera to your face means you've got another contact point. Placing the viewfinder against your eye socket helps hold it more steady as will holding your arms against your body instead of out in front of you. Positioning the shoulder strap so it's tight before you take the shot could also help steady the camera. Also control your breathing...basically pretend you're a sniper.
Or get a support like a tri or monopod. There are a ton of instructables of bodging your own tri/monopod out of a bolt and some string. It may seem silly but having tried it, it does help. There are also people who have used PVC tubing, ski poles, dowels and the like for a decent alternative.
__________________
|