We had a pool growing up...well, we BUILT a pool when I was 8 or so. When we first build the pool, our house didn't have central AC. We were in the pool all summer. A few years later, we got central AC, and I was older (more video games, less outside) - we used the pool maybe 1/3 of what we used to.
When my wife and I bought our house, we specifically DIDN'T want a pool because of my memory of how much work it was. There are days where it'd be really nice, and we've been tempted to build one, but I still default to how, at least in NJ, you get use for 4-5 months of the year, and again, how much work it is. We've got young kids right now - I could totally see it being great and tons of fun for for about 6-7 years, but again, once they get older, who knows.