Ok, so you were ~34 when you bought the first 20 year term policy? Just to put some numbers out there, lets say it was $500k. Fair?
At "select preferred" (one step down from the best health classification) a 34 year old could buy a $500k 20 year term policy for $370/yr. I just monkeyed around a built a whole life policy with a $5k a year premium and the same $500k of coverage (you can do that with some more flexible policies). I get it, it's much, much more. 13 years in, which is where you are now, the term could be continued for another 7 if you wanted for the same 370 a year, or a new 20 year term could be purchased for $930/yr assuming the same health classification.
But if you had purchased the whole life you'd have ~$71k of cash, for a net additional premium (5,000-370) 4,630 for 13 years. I get it, that ROR of 2.71 net after tax sucks (mainly because of how low interest rates are today). But if you were to now go out and buy another term policy for 930 a year, your additional net cost to just continue with the whole life policy would be 4,070, and because of how I built the whole life policy the premium drops from $5k to 2,883 after 20 years (so the additional net cost would be only 1,953). 20 years from now, though, at your "retirement age" of 67 you'd have just a shade over $313k of cash value, and $632k of life insurance. I ran the ROR of your additional premiums in the WL over that entire 33 years - 4.53%.
And I also understand that's not amazing either (with interest rates where they are, and thus dividends from insurance companies also being so low), when you compare it to equities over 20-30 years. But I haven't seen a CD paying that (maybe a better comparison, when factoring in liquidity) since 9/11.
If you make it to 67 - "term you" walks away with zero cash and zero death benefit. "WL you" walks away with $313 in cash value if you wanted/needed it, and $632k of a death benefit, which could really open up some other assets for you.