A delivery system has a delivery capsule with a detachable portion including first and second open ends with a tapered wall extending therebetween to compress and guide a collapsible heart valve into the delivery capsule. The detachable portion may be detached from the delivery capsule after loading the collapsible heart valve to leave a smooth distal surface on the delivery capsule. Detachment of the detachable portion may occur by breaking or removing a frangible member interposed between the detachable portion and the delivery capsule.