If you like old things and history definitely check out the Citadel. Also, I remember there being a very old cemetery going back to the first days of the settlement.
I think it's this one:
http://oldburyingground.ca. Call me odd but I like walking through old cemeteries.