For me, the building aspect (which I am only slightly getting better at) is what sets it apart from other BR/FPS games. It introduces a lot of creativity and variability that makes other games, IMO, seem just flat in comparison. Valorant and COD Warzone are supposed to be the hot new games, and watching other people play them, even if they're good, is like watching paint dry to me.
I also find the strategy behind the initial drop -- both when I'm playing terribly and when it's being played by people who are actually good -- to be pretty fascinating. But I do get what you're saying, not a lot happens early on (or middle on) in high-level games, and then the games usually end in pure chaos. I would push back some against the idea that most materials = wins near the end as well, there are ways to counter someone who just cranks way up above you.