Sort:
Open Access Issue
DPN: Dynamics Priori Networks for Radiology Report Generation
Tsinghua Science and Technology 2025, 30(2): 600-609
Published: 09 December 2024
Abstract PDF (5.1 MB) Collect
Downloads:7

Radiology report generation is of significant importance. Unlike standard image captioning tasks, radiology report generation faces more pronounced visual and textual biases due to constrained data availability, making it increasingly reliant on prior knowledge in this context. In this paper, we introduce a radiology report generation network termed Dynamics Priori Networks (DPN), which leverages a dynamic knowledge graph and prior knowledge. Concretely, we establish an adaptable graph network and harness both medical domain knowledge and expert insights to enhance the model’s intelligence. Notably, we introduce an image-text contrastive module and an image-text matching module to enhance the quality of the generated results. Our method is evaluated on two widely available datasets: X-ray collection from Indiana University (IU X-ray) and Medical Information Mart for Intensive Care, Chest X-Ray (MIMIC-CXR), where it demonstrates superior performance, particularly excelling in critical metrics.

Open Access Issue
Autism Spectrum Disorder Classification with Interpretability in Children Based on Structural MRI Features Extracted Using Contrastive Variational Autoencoder
Big Data Mining and Analytics 2024, 7(3): 781-793
Published: 28 August 2024
Abstract PDF (5.2 MB) Collect
Downloads:22

Autism Spectrum Disorder (ASD) is a highly disabling mental disease that brings significant impairments of social interaction ability to the patients, making early screening and intervention of ASD critical. With the development of the machine learning and neuroimaging technology, extensive research has been conducted on machine classification of ASD based on structural Magnetic Resonance Imaging (s-MRI). However, most studies involve with datasets where participants’ age are above 5 and lack interpretability. In this paper, we propose a machine learning method for ASD classification in children with age range from 0.92 to 4.83 years, based on s-MRI features extracted using Contrastive Variational AutoEncoder (CVAE). 78 s-MRIs, collected from Shenzhen Children’s Hospital, are used for training CVAE, which consists of both ASD-specific feature channel and common-shared feature channel. The ASD participants represented by ASD-specific features can be easily discriminated from Typical Control (TC) participants represented by the common-shared features. In case of degraded predictive accuracy when data size is extremely small, a transfer learning strategy is proposed here as a potential solution. Finally, we conduct neuroanatomical interpretation based on the correlation between s-MRI features extracted from CVAE and surface area of different cortical regions, which discloses potential biomarkers that could help target treatments of ASD in the future.

Total 2