In the house I sold in April 2009, I had built a deck that was one story up (walk-out) and did not get a permit. I also built a fence without a permit. The real property report went fine - based on my experience you have nothing to worry about.
There are lots of people that tow the line on this site, however, so be prepared for some doom and gloom mumbo jumbo. You'll be fine, though.
