Adjustment of training protocols in virtual reality (VR) or augmented reality (AR) environments based on biofeedback are provided. In various embodiments, motion data is collected for a user while the user performs a training protocol in a virtual environment. A biometric measurement is collected for the user while the user performs the training protocol. The motion data and the biometric measurement are provided to a learning system at a remote server. The learning system determines an adjustment to the training protocol based on the motion data and the biometric measurement. The adjustment is provided by the learning system and is applied to the training protocol. In various embodiments, the adjustment, the motion data, and/or the biometric measurement may be logged in an electronic health record.