A teleconferencing system for providing remote assistance comprises a local user apparatus that captures both the field of view of the local user along with physiological state of the local user, and a remote user apparatus to allow the remote user to view what the local user is seeing and doing. The local user and remote user have a shared view and a shared audio link, and the remote user can provided assistance to the local user in performing tasks at the local site. Additionally the physiological state of the local user is monitored, and from the physiological state data, an estimate of the emotional state or physiological state of the local user is provided to the remote user. The remote user can interact or assist the local user, including controlling the amount and/or type of assistance provided to the local user based on their current emotional state.
