A control apparatus of a radiotherapy system of the present invention includes an irradiation object detecting section configured to calculate a target position based on a position of a specific part of a sample and a swing position control section configured to control a drive unit to drive a radiation irradiating unit which irradiates a therapeutic radiation, such that the radiation irradiating unit directs to a post-correction target position at a control time after the measurement time. The post-correction target position indicates a position near a position to which the radiation irradiating unit directs rather than the target position in the preparation period before a therapy period, and the target position in the therapy period.