The current chief executive of the Financial Conduct Authority will become the Bank’s 121st governor.