I second the suggestion to do Top of the Rock over Empire State Building. I got the same advice when I went to NYC. Friend said it took over 3 hours to do Empire.
Take the free ferry and drive by the Statue. Island was a waste of time.
Sounds like you have tons to do so far if you're only there 3 days! Sounds like fun.
