Breaking up the Arcadia empire is “the only way” forward, former chief executive Lord Rose says.