The first non-British governor to lead the Bank in its 325-year history steps down this weekend.