Go to a church lobster dinner! Just ask around, and the locals will tell you where good ones are! They are not preachy- everyone has faith in tasty, reasonably priced food!
Also, get yourself a Cows Ice Cream buy 9 get 1 free card. I used mine up after only 2 days on the Island.
