Provided is an image management apparatus that enables, by a simple work, a label assignment to images such as in-vivo images captured by a capsule endoscope. The image management apparatus includes: an input unit 10 that receives input of a signal according to an operation from outside; a storage unit 14 that stores a plurality of types of labels to be assigned to the images; an image processing unit 13 that calculates feature quantity of each of the images; an image selecting unit 17 that selects an image according to the signal received by the input unit; a label extracting unit 18 that extracts, based on the feature quantity, one or more types of labels among the plurality of types of labels; a display control unit 19 that generates one or more icons corresponding to the one or more types of labels and causes the generated icons to be displayed on a screen; and a label assigning unit 20 that assigns, when an operation signal associating the image selected by the image selecting unit with an icon selected from the one or more icons is input, to the selected image, a label corresponding to the icon associated with the selected image.