Techniques are provided for use with implantable medical devices such as pacemakers for optimizing interventricular (VV) pacing delays for use with cardiac resynchronization therapy (CRT). In one example, ventricular electrical depolarization events are detected within a patient in whom the device is implanted. The onset of isovolumic ventricular mechanical contraction is also detected based on cardiomechanical signals detected by the device, such as cardiogenic impedance (Z) signals, S1 heart sounds or left atrial pressure (LAP) signals. Then, an electromechanical time delay (T_QtoVC) between ventricular electrical depolarization and the onset of isovolumic ventricular mechanical contraction is determined. VV pacing delays are set to minimize the time delay to the onset of isovolumic ventricular mechanical contraction. Various techniques for identifying the onset of isovolumic ventricular contraction based on Z, S1 or LAP or other cardiomechanical signals are described. In some examples, CRT nonresponders are specifically identified and/or heart failure progression is tracked.