Kim, Kwonyoung Park, Jungin Sohn, Kwanghoon 2025-12-23T03:00:06Z 2025-12-23T03:00:06Z 2025-12-19 2026-01 1545-598X https://pubs.kist.re.kr/handle/201004/153842 Parameter-efficient fine-tuning (PEFT) adapts large pretrained foundation models to downstream tasks, such as remote sensing scene classification, by learning a small set of additional parameters while keeping the pretrained parameters frozen. While PEFT offers substantial training efficiency over full fine-tuning (FT), it still incurs high inference costs due to reliance on both pretrained and task-specific parameters. To address this limitation, we propose a novel PEFT approach with model truncation, termed truncated parameter-efficient fine-tuning (TruncPEFT), enabling efficiency gains to persist during inference. Observing that predictions from final and intermediate layers often exhibit high agreement, we truncate a set of final layers and replace them with a lightweight attention module. Additionally, we introduce a token dropping strategy to mitigate interclass interference, reducing the model's sensitivity to visual similarities between different classes in remote sensing data. Extensive experiments on seven remote sensing scene classification datasets demonstrate the effectiveness of the proposed method, significantly improving training, inference, and GPU memory efficiencies while achieving comparable or even better performance than prior PEFT methods and full FT. English Institute of Electrical and Electronics Engineers Geospatial Domain Adaptation With Truncated Parameter-Efficient Fine-Tuning Article 10.1109/LGRS.2025.3633718 3 IEEE Geoscience and Remote Sensing Letters, v.23 IEEE Geoscience and Remote Sensing Letters 23 N 001631862200021 2-s2.0-105022281928 Geochemistry & Geophysics Engineering, Electrical & Electronic Remote Sensing Imaging Science & Photographic Technology Geochemistry & Geophysics Engineering Remote Sensing Imaging Science & Photographic Technology Article CLASSIFICATION BENCHMARK DATASET Remote sensing Adaptation models Diamond Predictive models Transformers Sports Accuracy Training Semantics Scene classification Model truncation parameter-efficient fine-tuning (PEFT) remote sensing scene classification vision transformer