“No point” in further discussions with the EU unless it changes course, Downing Street says.