A tissue penetrating electrode for interfacing with a nerve includes an electrode carrier having an electrically conductive core and an electrically insulative layer disposed on the conductive core, an electrically insulative tip at its proximal end configured to penetrate into tissue, and at least one electrical contact formed from the conductive core and positioned along a radial surface of the electrode. A method of making a tissue penetrating electrode includes providing an electrode carrier having an electrically conductive core and an electrically insulative layer disposed on the conductive core. The electrode carrier has an electrically insulative tip at its proximal end configured to penetrate into tissue. The method further includes removing a portion of the insulative layer on a radial surface of the electrode carrier in order to expose the conductive core and form at least one electrical contact. A hearing device including a tissue penetrating electrode is also disclosed.