A miniaturized controller includes communication and control circuitry for monitoring and controlling an implantable medical device (IMD). The miniaturized controller includes a display that allows it to essentially mimic the IMD control functionality of a traditional IMD controller. The size of the miniaturized controller, which may be approximately 1.1 cubic inches, enables it to be carried discreetly by a patient during the patient's daily activities. While the miniaturized controller functions as a standalone IMD controller in a first mode of operation, it is also wearable by the patient to function as a smartwatch, for example, in a second mode of operation. In the second mode of operation, the miniaturized controller, which may include sensors for measuring physiological parameters of the patient as well as patient motion when worn by the patient, is capable of providing closed-loop control of the IMD.