The chancellor has been criticised for making the trip while the government is under pressure from rising borrowing costs.