The present teachings provide devices to change the pressure in a chamber of a heart and methods of making and using thereof. One aspect of the present teachings provides a device comprising a distal portion, a middle portion, and a proximal portion. The distal portion and proximal portion of the device are configured to be deployed inside the left and right atrium respectively with a minimum contact with the septal tissue. The middle portion of the device is configured to secure the device across an aperture on the atrial septum. The device further includes at least one retrieval portion with a plurality of struts. The distal end of the struts is connected with a proximal end of the proximal portions. The proximal end of the struts come together at a location near the axial center of the device. The radial expansion of the proximal portion will lead to the radially outward movement of the struts. And a radially inward movement of the struts will cause the proximal portion of the device to collapse radially. The device includes a delivery profile and a deployment profile.