Weakening consumer sentiment in the overall economy is weighing heavily on mortgage demand from both homeowners and homebuyers.