Engineering Commons^™

Automatic Segmentation Of Subfigure Image Panels For Multimodal Biomedical Document Retrieval, Beibei Cheng, Sameer K. Antani, R. Joe Stanley, George R. Thoma

Electrical and Computer Engineering Faculty Research & Creative Works

Biomedical images are often referenced for clinical decision support (CDS), educational purposes, and research. The task of automatically finding the images in a scientific article that are most useful for the purpose of determining relevance to a clinical situation is traditionally done using text and is quite challenging. We propose to improve this by associating image features from the entire image and from relevant regions of interest with biomedical concepts described in the figure caption or discussion in the article. However, images used in scientific article figures are often composed of multiple panels where each sub-figure (panel) is referenced in …