I'd start with an acoustic guitar. I have this Sierra Alpine, which is quite good for the price. There is a pickup too if you want to play through an amp. A decent little Vox amp could be had for $150.
http://boutiquemusicinc.com/e-store/...roducts_id=727