Not checkedNot checked for notices yet.
Local Information Interaction Transformer for Hyperspectral and LiDAR Data Classification
Yuwen Zhang, Yishu Peng, Bing Tu and 1 more
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · 2023
doi:10.1109/jstars.2022.3232995 (opens in a new tab)
We email you when a new notice or a question about this paper appears.
Abstract
The multisource remote sensing classification task has two main challenges. 1) How to capture hyperspectral image (HSI) and light detection and ranging (LiDAR) features cooperatively to fully mine the complementary information between data. 2) How to adaptively fuse multisource features, which should not only overcome the imbalance between HSI and LiDAR data but also avoid the generation of redundant information. The local information interaction transformer (LIIT) model proposed herein can effectively address these above issues. Specifically, multibranch feature embedding is first performed to help in the fine-grained serialization of multisource features; subsequently, a local-based multisource feature interactor (L-MSFI) is designed to explore HSI and LiDAR features together. This structure provides an information transmission environment for multibranch features and further alleviates the homogenization processing mode of the self-attention process. More importantly, a multisource feature selection module (MSTSM) is developed to dynamically fuse HSI and LiDAR features to solve the problem of insufficient fusion. Experiments were carried out on three multisource remote-sensing classification datasets, the results of which show that LIIT has more performance advantages than the state-of-the-art CNN and transformer methods.
Abstract licence: CC BY-NC-ND
References52
- 15.
Attention Is All You Need · 2017
39 more references, whose wording the paper’s licence keeps private.
All 52 referencesReads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.