A breast pump (1) comprises a cup member (2) and a container (3). The cup member (2) has a breast engaging portion (4) configured to seal to a breast. The container (3) is configured to be removably and sealingly connected to the cup member (2). The container (3) is configured to be deformed by a user and released to create suction on the breast to pump breast milk into the container (3). A breast pump (1) and feeding kit for pumping, storing and feeding breast milk is also disclosed. The kit comprises a deformable container (3) which may be attached to one of a cup member (2), a teat (18), or a lid (32). The teat (18) is configured to feed breast milk from the container (3) to a baby. The lid (32) is configured to secure the breast milk in the container for storage.