A method is for segmenting an object in a medical image with a plurality of iteration steps. In an embodiment of the method, each iteration step includes generating a plurality of patches, a portion of the input image and a patch location being assigned to each patch, the patch location being indicative of the location of the portion of the input image relative to the input image. For each patch of the plurality of patches, the method includes determining a vote location based on the portion of the input image assigned to that patch and determining a target location based on the vote location and the patch location assigned to that patch. Finally, in an embodiment the method includes generating a vote map, each patch of the plurality of patches contributing to a pixel value at the target location of the patch in the vote map.
