The present application discloses a simple process for the purification of human milk oligosaccharides (HMOs) produced by microbial fermentation. The process uses a combination of a cationic ion exchanger treatment, an anionic ion exchanger treatment and electrodialysis, which allows efficient purification of large quantities of neutral HMOs at high purity. Contrary to the purification currently used in fermentative production of neutral HMOs, the presented process allows the provision of HMOs without the need of a chromatographic separation. The so purified HMOs may be obtained in solid form by spray drying, as crystalline material or as sterile filtered concentrate. The provided HMOs are free of proteins and recombinant material originating from the used recombinant microbial strains and thus very well-suited for use in food and feed applications.