Areas with a high proportion of workers in struggling sectors will be hardest hit by the pandemic, the party says.