A computer-implemented method for automatically generating a radiology report includes a computer receiving an input dataset comprising a plurality of multidimensional patient images and patient information and parsing the input dataset using learned models to determine a clinical domain and relevant image annotations. The computer populates an annotation table using the relevant image annotations and applies one or more domain-specific scriptable rules to populate a report template based on the annotation table. The computer may then generate a natural language radiology report based on the report template.#