Integrated Sensing and Assistive Intelligence (InSAI) Lab
School of AI and Robotics, Hunan University (HNU)
"Building a utopia where integrated sensing systems empower and enhance human capabilities, especially benefiting people with disabilities."
🌟 Featured Open-Source Benchmarks & Models
🚗 DeLiVER & CMNeXt (CVPR 2023)
Arbitrary-modal semantic segmentation covering Depth, LiDAR, Events, Multiple Views, and RGB under 4 severe weather conditions and 5 sensor failure corner cases.
🌐 SynPASS & Trans4PASS / Trans4PASS+ (CVPR 2022)
Distortion-aware Vision Transformers tailored for 360° panoramic cameras and omnidirectional scene understanding, featuring the 9,080-frame SynPASS benchmark.
🎯 Core Research Directions
- Multimodal Perception & Scene Understanding: Vision-Language Modeling, 2D/3D Vision, and sensor fusion in complex, adverse real-world environments.
- Autonomous Systems & Panoramic Vision: Semantic Mapping, Panoramic Sensing, Distortion-aware Transformers, and Bird’s-Eye-View (BEV) perception.
- Embodied Intelligence: Perception, navigation, and decision-making linking foundation models with robotic action, including Sim2Real adaptation.
- Assistive Technologies: Wearable assistive systems, navigation aids, and accessible interfaces designed around human capabilities.
- Brain-Computer Interface & Document Understanding: Cognitive state sensing, assistive BCI, and intelligent layout/reading assistance.