Rail union leaders have written to Prime Minister Boris Johnson with “severe concerns”.