For me it's not quite Cal-gree. There is an "a" in there after the 'g"... it 's just on the unstressed part of the word, so it's harder to distinguish.
But as soon as I hear someone say Cal-gary (like the name Gary) they've just signaled that their probably not a native Calgarian. I know there are exceptions... but generally, it works.
