There's been a growing air of pessimism around the labour market since Labour's maiden Budget, and with good reason.