A method to determine a body pose of a user in a virtual reality or augmented reality system includes acquiring sensor data from a plurality of sensors in a garment worn by a user. The sensor data is processed to generate a processed sensor data set, wherein the processed sensor data set is scaled for the size of the user. The processed sensor data set is converted to a pose data set. The pose vector data set is then used by a viewer device to render the body pose of the user.