An image processing linkage system includes: an image processing apparatus and a portable terminal device connectable with each other, wherein the image processing apparatus includes a display unit, and a transmitting unit, the portable terminal device includes a display unit, a receiving unit, a display control unit, an operation information converting unit, and a transmitting unit, and the image processing apparatus receives the operation information transmitted from the portable terminal device, and executes a process corresponding to the operation information.