Nothing selfish about it. You look out for yourself #1 before the company you work for (unless you're an owner).
Unfortunately, the way to go about it is to not use any references from your current company. And no, it's not detrimental to request they don't contact your current employer. They get it all the time.
__________________
|