are you the guy who found his style in high school and is going to ride it out until you die?
or do you switch up your hair, facial hair, clothes, etc. pretty regularly?
Things that matter in terms of aesthetics for men will tend to rely on
1) Level of physical fitness ( Are you ripped or not? Do you look good shirtless or not?)
2) Body fat percentage
You could wear beat down clothes from Goodwill or Salvation Army, but if you are purely ripped to the gills and you have a sharp jawline and your arms and abs are popping out, then you will make everything you wear look better.
Look at women and weight. Women who are heavier have lots of techniques and tricks and strategies to morph the general public perception of their physical appearance to make it look like they weigh less than they do. Yoga pants are essentially a 20 dollar version of SFX that any average woman in America can afford. But nothing beats just being in really good shape.
If you exercise, eat correctly, hydrate correctly, sleep correctly, don't abuse drugs or tobacco or alcohol, then it's not difficult to look good for most people. The hard work is in the foundation, not the SFX.
A minimalist style is never minimalist on someone who is chiseled out.
Imagine Phoebe Cates from Fast Times At Ridgemont High era wearing the ugliest outfit in all of women's fashion. Would it matter that much?
People who make a lot of changes to their appearance are playing games with that paper thin SFX strategy. Build a good foundation and you don't need ILM and Weta Workshop to make you presentable to pull quality and drop loads.