If you like it, buy it. Why let others influence what you like?
On a side note, a young nephew of mine who knows I'm into watches. Especially Rolex, bought me a 50mm Armitron chronograph quartz watch for Christmas. None of my watches even come close to 50mm. Not wanting to disappoint him since it's the thought not the gift that counts. I've been wearing it the last several days. Long story short. The 50mm size is somewhat growing on me. It's really not that bad.