Banks warn that people do not want to appear rude rather than cutting off unsolicited phone calls.