Even if all the wealth in the economy was owned by one agent alone, with zero weight in the social welfare function, the accumulation of wealth should not be taxed. The workers lose by having the capital-rich pay taxes on the accumulation of capital.