The housing shortage is finally easing, but even with more listings available, the market still historically unaffordable to a huge swath of buyers. Here’s why.