There’s no getting away from the fact that gold is softer than stainless steel but unless you are planning on playing competitive beach volleyball, I would be wearing my Rolex on a beach vacation. Memories with the watch are more important than the worrying about the slight risk of minor cosmetic damage.
This becomes a philosophy point of view on if you are actually wearing a Rolex or is the Rolex wearing you in this short life?
I personally wouldn’t own a watch I couldn’t take on a family vacation.