A manipulator system includes a medical instrument which is capable of being inserted into a body a manipulator which is capable of holding the instrument a holding detector which detects a holding state where the manipulator holds the instrument an instruction-receiving part which detects an instruction for operating the instrument and a controller which operates the instrument only in a case where the instruction-receiving part detects the instruction when the holding detector detects the holding state.