An agricultural robot system and method of harvesting, pruning, culling, weeding,measuring and managing of agricultural crops. Uses autonomous and semi-autonomousrobot(s) comprising machine-vision using cameras that identify and locatethe fruit on each tree, points on a vine to prune, etc., or may be utilized in measuringagricultural parameters or aid in managing agricultural resources. The camerasmay be coupled with an arm or other implement to allow views from inside the plantwhen performing the desired agricultural function. A robot moves through a fieldfirst to "map" the plant locations, number and size of fruit and approximatepositions of fruit or map the cordons and canes of grape vines. Once the map is complete,a robot or server can create an action plan that a robot may implement. An actionplan may comprise operations and data specifying the agricultural functionto perform.