I get that. At the same time, I don't think it's necessarily dumb to leave at any point in particular. It's not as if the blinds are some huge amount.
As the night goes on and I get a feel for the table, I like and tend to play more hands. So for me, paying the blinds and then having the button, I'm almost always playing those 3 hands. It's part of the enjoyment for me.
Yes, the cutoff is great and if I didn't get to play the blinds or the button because of raises and crap cards, then I'll stick around for the CO. But then as it keeps going around and position gets worst, I have no interest to play the rest of the "free cards".
Also, because of position, I almost never fold the button unless the cards are really poor and there's a substantial raise. I typically have stronger post-flop play, especially in position, and I seem to do well with that approach.
So for all those reasons, I typically play the button and then call it a night. I see the flipside to it but never thought of it as being some kind of egregious fault.
For example, I NEVER straddle. It's a common thing, especially for certain players that do it every time they can, and I've never understood the allure and I think overall is a losing strategy.