A method of beam angle optimization for an IMRT radiotherapy treatment includes providing a patient model having one or more regions of interest (ROIs), defining a delivery coordinate space (DCS), for each ROI, solving an adjoint transport to obtain an adjoint solution field from the ROI, for each vertex in the DCS, evaluating an adjoint photon fluence by performing ray tracing of the adjoint solution field, evaluating a dose of the ROI using the adjoint photon fluence, for each vertex in the DCS, evaluating a respective beam's eye view (BEV) score of each pixel of a BEV plane using the doses of the one or more ROIs, determining one or more BEV regions in the BEV plane based on the BEV scores, determining a BEV region connectivity manifold based on the BEV regions, and determining a set of IMRT fields based on the BEV region connectivity manifold.