DDKG: A Dual Domain Knowledge Guidance strategy for localization and diagnosis of non-displaced femoral neck fractures

• Published in: Medical image analysis 2025-02, Vol.100, p.103393, Article 103393
• Main Authors: Yang, Jing, Wang, Lianxin, Lin, Chen, Wang, Jiacheng, Wang, Liansheng
• Format: Article
• Language: English
• Subjects: Deep Learning; Domain knowledge; Femoral Neck Fractures - diagnostic imaging; Humans; Large language models; Non-displaced femoral neck fractures; Radiographic Image Interpretation, Computer-Assisted - methods
• ISSN: 1361-8415; 1361-8423; 1361-8423
• DOI: 10.1016/j.media.2024.103393

X-ray is the primary tool for diagnosing fractures, crucial for determining their type, location, and severity. However, non-displaced femoral neck fractures (ND-FNF) can pose challenges in identification due to subtle cracks and complex anatomical structures. Most deep learning-based methods for diagnosing ND-FNF rely on cropped images, necessitating manual annotation of the hip location, which increases annotation costs. To address this challenge, we propose Dual Domain Knowledge Guidance (DDKG), which harnesses spatial and semantic domain knowledge to guide the model in acquiring robust representations of ND-FNF across the whole X-ray image. Specifically, DDKG comprises two key modules: the Spatial Aware Module (SAM) and the Semantic Coordination Module (SCM). SAM employs limited positional supervision to guide the model in focusing on the hip joint region and reducing background interference. SCM integrates information from radiological reports, utilizes prior knowledge from large language models to extract critical information related to ND-FNF, and guides the model to learn relevant visual representations. During inference, the model only requires the whole X-ray image for accurate diagnosis without additional information. The model was validated on datasets from four different centers, showing consistent accuracy and robustness. Codes and models are available at https://github.com/Yjing07/DDKG. •DDKG for detecting non-displaced femoral neck fractures with dual-domain knowledge.•SAM targets the hip joint with limited supervision to improve fracture detection.•SCM uses radiological reports and LLM priors to guide visual representation learning.•We validated the model’s efficacy on four hospital datasets.