Many homeowners find themselves in “serious traps” after being mis-sold properties, a watchdog says.