#$%^&*AU2019240661A120191024.pdf#####ABSTRACT Disclosed is a method, comprising: sensing a physical object at a first location using at least one or more outward facing cameras of a head-mounted user display device and recognizing a type of the physical object sensed at the first location by the headmounted user display device by: capturing one or more field-of-view images, extracting one or more sets of points from the one or more field-of-view images, extracting one or more fiducials for at least one physical object in the one or more field-of-view images based on at least some of the one or more sets of points, processing at least some of the one or more fiducials for the at least one physical object to identify the type of the physical object sensed at the first location, wherein processing at least some of the one or more fiducials comprises comparing the one or more fiducials to sets of previously stored fiducials； associating a virtual object with the sensed physical object based on the type of the physical object as a result of both recognizing the type of the sensed physical object at the first location by the head-mounted user display device using the at least one or more outward facing cameras and identifying a predetermined relationship between the virtual object and the type of the sensed physical object recognized at the first location by the head-mounted user display device； receiving virtual world data representing a virtual world, the virtual would data including at least data corresponding to manipulation of the virtual object in the virtual world by a first user at the first location； transmitting at least the virtual world data corresponding to manipulation of the virtual object by the first user at the first location to a head-mounted user display device, wherein the head-mounted user display device renders a display image associated withat least a portion of the virtual world data including at least
