A method of trajectory optimization for radiotherapy treatment includes providing a patient model having one or more regions of interest (ROIs), defining a delivery coordinate space (DCS), for each ROI, solving an adjoint transport to obtain an adjoint solution field from the ROI, for each vertex in the DCS, evaluating an adjoint photon fluence by performing ray tracing of the adjoint solution field, evaluating a dose of the ROI using the adjoint photon fluence, for each vertex in the DCS, evaluating a respective beam's eye view (BEV) score of each pixel of a BEV plane using the doses of the one or more ROIs, determining one or more BEV regions in the BEV plane based on the BEV scores, determining a BEV region connectivity manifold based on the BEV regions, and determining one or more optimal treatment trajectories based on the BEV region connectivity manifold.