Just got back from Vic. If you want the best fish n chips of your life, hit up Red Fish Blue Fish in the Inner Harbour.
http://www.redfish-bluefish.com/
I hadn't been there for 3-4 years. The place is reaching NY level line ups. But it is so worth it. Be prepared to wait for 30 mins, even if you show up right when they open at 11:30am.
Also a +1 for Salish Sea Aquarium. Great little place. Good interactive exhibits for kids. Good to kill 30-45mins before heading to the airport.