Herein a milk analysis apparatus (2) comprising an analysis unit (4) for analysing milk is disclosed. The milk analysis apparatus (2) further comprises, a milk collecting container (8), a syringe pump (10) for pumping liquid from the milk collecting container (8) to the analysis unit (4), an inlet conduit (12) extending from the milk collecting container (8) to the syringe pump (10), an outlet conduit (14) extending from the syringe pump (10) towards the analysis unit (4), an inlet valve (16) arranged in the inlet conduit (12), and an outlet valve (18) arranged in the outlet conduit (14). The milk analysis apparatus (2) further comprises a passage conduit (24) connected to the outlet valve (18), which passage conduit (24) is divided into a bypass passage (26) and an analysis passage (6) for conducting liquid through the analysis unit (4). A bypass valve (32) is arranged in the bypass passage (26) and a one-way valve (34) is connected to the analysis passage (6). Further a method of operating a milk analysis apparatus (2) is disclosed.