That is the way it works. The companies value is maintained at the expense of the person retiring the shares. Aka. a buyback benefits the company, but comes at a significant cost to an individual to do so.

^That being said....the earlier that a buyback and retirement occurs...the more likely that money spent will equate to money earned in the future.

Early retirement of shares results in more progressive increase in the pps. of a successful company and can then help to offset the original cost of share buyback and retirement.