You signed a contract, and theoretically the employer is entitled to damages if you breach that contract (depending on what is actually in there, in terms of probationary periods, notice, etc). In reality, nobody would ever bother doing anything against you since you are too insignificant.
The only thing you have to worry about is burning bridges. I would just be honest and tell them exactly what the situation is, and hope there are no hard feelings.