‘My wife and I are both retired’: Do we dip into our $2.3 million fund to pay off our $300,000 mortgage at 2.9%?
The short answer
– Mathematically, a 2.9% fixed mortgage is very hard to beat as a liability. If you can earn a safe after-tax return around or above 2.9%, keeping the mortgage and investing a “mortgage bucket” usually wins.
– Behaviorally, the guaranteed, risk-free “return” of 2.9% from paying it off, plus the peace of mind and cash-flow relief, can be worth more than the spreadsheet says.
– Practically, many retirees land on a middle path: make a partial principal payment and recast the loan to reduce the monthly payment, while keeping liquidity and investment flexibility.
What this decision really hinges on
1) Your after-tax cost of the mortgage
– If you don’t itemize deductions, your after-tax cost is likely the full 2.9%.
– If you itemize and actually get a benefit from mortgage interest (many retirees do not, given the large standard deduction and SALT cap), your after-tax cost is 2.9% × (1 – marginal tax rate).
2) What you can safely earn instead
– If you can lock in a ladder of Treasuries/CDs/agency bonds with an after-tax yield near or above 2.9% for the remaining term of the mortgage, the math favors keeping the loan and investing the payoff amount in that “liability-matching” ladder.
– If safe yields available to you are clearly below 2.9% after tax, paying down becomes more attractive.
3) Cash-flow and sequence-of-returns risk
– A $300,000 mortgage at 2.9% might carry a monthly payment roughly in the $1,200–$1,600 range depending on the remaining term. Eliminating that payment reduces your annual withdrawal need by, say, $14,000–$19,000.
– On a $2.3 million portfolio, that could lower your withdrawal rate by about 0.6–0.8 percentage points. That reduction can materially improve retirement sustainability, especially if markets drop early in retirement.
– But you can get similar sequence-risk protection by setting aside a dedicated, safe “mortgage bucket” to cover those payments for the remainder of the loan.
4) Taxes and where the payoff money comes from
– Paying from pre-tax IRAs/401(k)s can be costly. A $300,000 IRA withdrawal could:
– Push you into higher federal and state brackets.
– Trigger Medicare IRMAA surcharges for two years.
– Increase the taxation of Social Security benefits.
– Paying from taxable accounts might realize capital gains. Manage lot selection and brackets carefully.
– If most of your $2.3 million is in tax-deferred accounts, a lump-sum payoff is usually tax-inefficient. Consider gradual paydown or a mortgage bucket instead.
5) Liquidity and optionality
– Money put into home equity is hard to access without borrowing again (HELOC, cash-out refi, or reverse mortgage), potentially at worse terms later.
– If paying off would leave you with less than 1–2 years of living expenses in cash/short-term bonds, consider keeping the mortgage or doing only a partial paydown.
6) Personal comfort and legacy goals
– Some retirees value the debt-free milestone more than the probability-weighted outperformance of investing. If being mortgage-free significantly improves your well-being, that matters.
– If you plan to leave sizable assets to heirs or charity, keeping cheap, fixed-rate debt while allowing investments to compound can increase the estate—though with more volatility.
How to frame the math with simple guardrails
– Guaranteed return from payoff: roughly 2.9% after tax if you don’t itemize.
– Keep mortgage if you can lock in a safe, after-tax yield comparable to or higher than 2.9% for the term of the loan, and the payment doesn’t stress your budget.
– Favor payoff or partial payoff if:
– Safe yields available to you are well below 2.9% after tax, or
– The payment meaningfully stresses cash flow or sleep-at-night, or
– You have ample taxable liquidity and won’t harm your tax picture.
Three practical paths
A) Keep the mortgage; build a mortgage bucket
– Set aside enough in a ladder of T-bills/notes, CDs, or high-quality bonds to cover all remaining payments (principal and interest) or at least 5–10 years of them.
– Benefit: You immunize the cash-flow risk while preserving flexibility and potentially earning more than 2.9% after tax.
B) Partial prepayment with a recast
– Make a lump-sum principal payment (for example, $100k–$200k) and ask your lender to recast the loan. A recast lowers the monthly payment while keeping the same 2.9% rate and original term, typically for a small fee.
– Benefit: Materially lower payment and sequence risk while retaining significant liquidity. This is often the “best of both worlds.”
C) Full payoff
– Most compelling if you can do it from taxable cash with minimal capital gains and still keep a robust emergency fund, and if the emotional/cash-flow relief is highly valuable to you.
– Less compelling if it requires a large IRA withdrawal or leaves you cash-poor.
Key tax considerations before you act
– Verify whether you itemize. If you take the standard deduction, you likely get no tax break from mortgage interest.
– Model your AGI for the next two years. Avoid tripping Medicare IRMAA thresholds with a big one-time distribution.
– If paying from taxable accounts, map out capital gains by lot. Aim to stay within favorable capital-gains brackets, and consider spreading the payoff over two tax years.
– Coordinate with RMDs and Roth conversions. Keeping the mortgage might let you do more Roth conversions at controlled brackets before RMD age, improving lifetime tax efficiency.
Other factors to weigh
– Inflation hedge: Fixed-rate debt becomes easier to service if inflation runs above 2.9%. Paying off sacrifices that hedge.
– Long-term care and big-ticket risks: Preserving liquid assets can be valuable if future care needs arise.
– Prepayment rules: Confirm there’s no prepayment penalty and that your lender offers recasts.
– Insurance and taxes continue: Even with no mortgage, property taxes and homeowners insurance remain, so budget accordingly.
A simple decision checklist
1) What’s the remaining term and monthly payment? Is the payment stressing your budget?
2) After-tax mortgage cost: Is it effectively the full 2.9%?
3) Safe after-tax yields you can lock in today for a ladder of similar duration?
4) Where would payoff funds come from? What are the tax and IRMAA impacts?
5) How much liquidity remains if you pay off? Will you still have 1–2 years of expenses in cash/short-term bonds?
6) How much do you value the certainty and peace of mind of being debt-free?
A quick illustration
– Suppose your payment is $1,250 per month ($15,000 per year). Paying off cuts your portfolio withdrawals by $15,000. On $2.3 million, that reduces your withdrawal rate by roughly 0.65 percentage points. That’s meaningful for sequence-of-returns risk.
– The alternative is setting aside $300,000 in a Treasury/CD ladder. If its after-tax yield is at or above 2.9%, that bucket will fund the mortgage and potentially leave a surplus, while you keep the option to redirect funds later.
Bottom line
With a $2.3 million nest egg and a $300,000 mortgage at 2.9%, you don’t need to rush to pay it off. The rate is low, and in many environments you can match or beat 2.9% after tax with high-quality fixed income while preserving flexibility. If the monthly payment pinches or you simply want the psychological lift of being mortgage-free, consider a sizable partial prepayment and a recast to slash the payment without sacrificing too much liquidity. Avoid a full payoff funded by large pre-tax withdrawals unless you’ve modeled the tax and Medicare ripple effects.
If you want a one-sentence rule: Keep the mortgage if you can safely earn around or more than 2.9% after tax and the payment doesn’t bother you; otherwise, do a partial paydown and recast—or pay it off from taxable assets only if it won’t dent your cash cushion or inflate your taxes.
