You should go this time.
If you know you don't like an activity or the people involved say no from the beginning, much easier.
As others have said, it's not about the golf, it's about the team building and networking which can be very beneficial to your career.
|