Kim, Daniel Al-Masni, Mohammed A. Lee, Jaehun Kim, Dong-Hyun Ryu, Kanghyun 2025-05-19T06:30:08Z 2025-05-19T06:30:08Z 2025-05-15 2025-02 https://pubs.kist.re.kr/handle/201004/152442 RegistFormer, our novel reference-augmented image synthesis framework, generates aligned pseudo-CT images (with respect to MR) from misaligned MR and CT pairs. RegistFormer addresses the limitations of intensity-based registration methods, which often fail due to dissimilar image features and complex deformation fields. Unlike conventional image-to-image (I2I) translation methods, our method uses a misaligned CT scan as an auxiliary input to guide the synthesis task through the Deformation-Aware Cross-Attention (DACA) mechanism. DACA integrates the deformation field from a registration method to aggregate spatially matched features from the misaligned CT into MR spatial coordinates. Additionally, we propose a novel combination of loss functions for training with datasets of misaligned MR-CT pairs in a self-supervised manner, eliminating the need for pre-aligned training data. Experiments were conducted with the synthRAD202311https://synthrad2023.grand-challenge.org/ MR-CT pelvis pair dataset. RegistFormer outperforms past state-of-the-art methods, including I2I, registration, and hybrid (registration + I2I), across metrics evaluating both structure alignment and distribution similarity. Moreover, RegistFormer demonstrates superior performance in zero-shot segmentation downstream tasks, highlighting its clinical value. Source code: https://github.com/danny4159/RegistFormer English Institute of Electrical and Electronics Engineers Inc. Improving Pelvic MR-CT Image Alignment with Self-Supervised Reference-Augmented Pseudo-CT Generation Framework Conference 10.1109/WACV61041.2025.00044 1 2025 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2025, pp.347 - 356 2025 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2025 347 356 US Tucson, AZ 2025-02-26 Proceedings - 2025 IEEE Winter Conference on Applications of Computer Vision, WACV 2025