Embodiments of the present invention generally pertain to implantable medical devices, and methods for use therewith, that detect exposure to magnetic fields produced by magnetic resonance imaging (MRI) systems. In accordance with specific embodiments, a sensor output is produced using an implantable sensor that is configured to detect acceleration, sound and/or vibration, but is not configured to detect a magnetic field. Such a sensor can be an accelerometer sensor, a strain gauge sensor or a microphone sensor, but is not limited thereto. In dependence on the produced sensor output, there is a determination whether of whether the IMD is being exposed to a time-varying gradient magnetic field from an MRI system. In accordance with certain embodiments, when there is a determination that the IMD is being exposed to a time-varying gradient magnetic field from an MRI system, then a mode switch to an MRI safe mode is performed.