Topological evolution of a lesion within a time series of medical imagery is provided. In various embodiments, a time series of medical images is read. Each of the images depicts a subject anatomy and a lesion. The lesion has a size and a contour within each of the medical images. At least one anatomical label is read for the subject anatomy within each of the plurality of images. Based upon the contour of the lesion within each of the medical images and based on the at least one anatomical label, a further contour of the lesion is predicted outside of the time series.