Thanks for the suggestions guys.
Took out a couple screws and it pulled away from the wall and it's neighbour pretty easy actually. Thankfully the cabinet it was screwed in to was the microwave section, so nothing was relying on the part I took out.
The good news is the crown moulding stayed up so I think I can get a piece of wood stained to match and cover up the space that is not used by the new fridge.