A “clear message” must be sent to civil servants about ending home working, minister says.