A plant pot holding device (1) includes one or more panels (10) each having a number of compartments formed with a wider front portion and a narrower rear portion for detachably engaging with plant pots (30), the plant pots (30) each include a lower notch (31) for engaging with the lower inclined surface (17) of the panel (10) and an upper engaging surface (32) and a latch (34) for engaging with the panel (10) and for detachably attaching and latching the plant pots (30) to the panel (10), the panels (10) each include one or more couplers (14) and one or more socket openings (12) for selectively engaging with each other and for detachably coupling the panels (10) together to form various spatial or three-dimensional shapes and for detachably supporting a number of plant pots (30).