Job losses for high earners hit the economy. For low-wage workers, they hit home