The disclosure relates to a device for removing at least one teat cup (1a) from a teat of an animal. The device comprises a cylinder (2) provided with a movable piston (3) dividing an inner space of the cylinder in a first compartment (4) and a second compartment (5) and a valve mechanism (9) adapted to connect a vacuum source (8) to the first compartment (4) when it is in a first position and to break this connection when it is in a second position. The device comprises a passage (15) leading into the first chamber (4) and a valve member (16) adapted to allow a flow through the passage (15) to the first compartment (4) during occasions when an operator moves the teat cup (1a) from a storing position to a teat attaching position.