Even wealthy retirees don't like to tap into these assets, relying instead on income streams like annuities and Social Security.