I can only relate my experience with Rolex as I don’t own AP ...
I’ll say it depends on the reference. Heavier, larger watches require a snug fit, (Deepsea, SD43, Skydweller), lighter weight references can be worn as you describe (GMT’s, DJ’s etc).
I like a slightly loose fit overall, which is why I gravitate toward Stainless Steel references that are light weight, and I wear heavier references sparingly