insailab commited on
Commit
aa15ae9
ยท
verified ยท
1 Parent(s): 39f8461

docs: add official InSAI Lab organization card

Browse files
Files changed (1) hide show
  1. README.md +92 -5
README.md CHANGED
@@ -1,10 +1,97 @@
1
  ---
2
- title: README
3
- emoji: ๐Ÿ“š
4
- colorFrom: gray
5
- colorTo: indigo
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: InSAI Lab Profile
3
+ emoji: ๐Ÿ›๏ธ
4
+ colorFrom: indigo
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
+ <div align="center">
11
+
12
+ <img src="https://cdn-avatars.huggingface.co/v1/production/uploads/69d4baff8e85a8e1ae8370a5/qqeGpW3kQ8GVDcazES1nW.png" width="120px" alt="InSAI Lab Logo" />
13
+
14
+ # Integrated Sensing and Assistive Intelligence (InSAI) Lab
15
+ ### School of AI and Robotics, Hunan University (HNU)
16
+
17
+ <p align="center">
18
+ <a href="https://insailab.org"><img src="https://img.shields.io/badge/Official-Website-blue?style=flat-square&logo=googlechrome" /></a>
19
+ <a href="https://github.com/InSAI-Lab"><img src="https://img.shields.io/badge/GitHub-InSAI--Lab-181717?style=flat-square&logo=github" /></a>
20
+ <a href="https://huggingface.co/InSAI-Lab"><img src="https://img.shields.io/badge/HuggingFace-InSAI--Lab-FFD21E?style=flat-square&logo=huggingface" /></a>
21
+ <a href="mailto:jiamingzhang@hnu.edu.cn"><img src="https://img.shields.io/badge/Email-Contact_Us-red?style=flat-square&logo=gmail" /></a>
22
+ </p>
23
+
24
+ *"Building a utopia where integrated sensing systems empower and enhance human capabilities, especially benefiting people with disabilities."*
25
+
26
+ </div>
27
+
28
+ ---
29
+
30
+ ## ๐ŸŽฏ About InSAI Lab
31
+
32
+ The **InSAI** (pronounced like *"Insight"*) Lab operates within the **School of AI and Robotics at Hunan University**.
33
+ Our mission is to merge interdisciplinary fields โ€” including **computer vision, robotics, intelligent transportation systems, assistive technologies, and human-computer interaction (HCI)** โ€” to develop deployable **Assistive Intelligence**.
34
+
35
+ ### Core Research Directions
36
+ - ๐ŸŒ **Multimodal Perception & Scene Understanding:** Vision-Language Modeling, 2D/3D Vision, and sensor fusion in complex, adverse real-world environments.
37
+ - ๐Ÿš— **Autonomous Systems & Panoramic Vision:** Semantic Mapping, Panoramic Sensing, Distortion-aware Transformers, and Birdโ€™s-Eye-View (BEV) perception.
38
+ - ๐Ÿค– **Embodied Intelligence:** Perception, navigation, and decision-making linking foundation models with robotic action, including Sim2Real adaptation.
39
+ - โ™ฟ **Assistive Technologies:** Wearable assistive systems, navigation aids, and accessible interfaces designed around human capabilities.
40
+ - ๐Ÿง  **Brain-Computer Interface & Document Understanding:** Cognitive state sensing, assistive BCI, and intelligent layout/reading assistance.
41
+
42
+ ---
43
+
44
+ ## ๐ŸŒŸ Featured Open-Source Projects on Hugging Face
45
+
46
+ ### 1. [DeLiVER & CMNeXt (CVPR 2023)](https://huggingface.co/InSAI-Lab/CMNeXt)
47
+ > **Delivering Arbitrary-Modal Semantic Segmentation**
48
+
49
+ A comprehensive benchmark and cross-modal architecture scaling dynamically across **1 to 81 modalities** (Depth, LiDAR, Events, Multi-Views, RGB) under 4 severe weather conditions and 5 sensor failure corner cases.
50
+
51
+ | Resource | Hugging Face Repository | Description |
52
+ | :--- | :--- | :--- |
53
+ | ๐Ÿ“ฆ **Dataset** | [`InSAI-Lab/DELIVER`](https://huggingface.co/datasets/InSAI-Lab/DELIVER) | Full multimodal dataset package (12.22 GB) |
54
+ | ๐Ÿค– **Model Zoo** | [`InSAI-Lab/CMNeXt`](https://huggingface.co/InSAI-Lab/CMNeXt) | 37 trained checkpoints covering DELIVER, KITTI-360, MFNet, NYU Depth V2, UrbanLF, MCubeS, and SegFormer/Swin backbones |
55
+ | ๐Ÿ“„ **Paper** | [arXiv:2303.01480](https://arxiv.org/abs/2303.01480) | CVPR 2023 Paper |
56
+
57
+ ```bash
58
+ # Quick download via Hugging Face CLI
59
+ hf download InSAI-Lab/DELIVER DELIVER.tar.gz --type dataset --local-dir ./data
60
+ hf download InSAI-Lab/CMNeXt --local-dir ./checkpoints
61
+ ```
62
+
63
+ ---
64
+
65
+ ### 2. [SynPASS & Trans4PASS / Trans4PASS+ (CVPR 2022)](https://huggingface.co/InSAI-Lab/Trans4PASS)
66
+ > **Transformers for Panoramic Semantic Segmentation & Domain Adaptation**
67
+
68
+ Distortion-aware Vision Transformers tailored for 360ยฐ panoramic cameras and omnidirectional scene understanding, featuring the 9,080-frame SynPASS benchmark.
69
+
70
+ | Resource | Hugging Face Repository | Description |
71
+ | :--- | :--- | :--- |
72
+ | ๐Ÿ“ฆ **Dataset** | [`InSAI-Lab/SynPASS`](https://huggingface.co/datasets/InSAI-Lab/SynPASS) | 9,080 high-res panoramic semantic segmentation benchmark (4.79 GB) |
73
+ | ๐Ÿค– **Model Zoo** | [`InSAI-Lab/Trans4PASS`](https://huggingface.co/InSAI-Lab/Trans4PASS) | 40 checkpoints across Cityscapes, Stanford2D3D, Structured3D, and MPA domain adaptation snapshots |
74
+ | ๐Ÿ“„ **Papers** | [arXiv:2203.01452](https://arxiv.org/abs/2203.01452) / [arXiv:2207.11860](https://arxiv.org/abs/2207.11860) | CVPR 2022 & arXiv Preprints |
75
+
76
+ ```bash
77
+ # Quick download via Hugging Face CLI
78
+ hf download InSAI-Lab/SynPASS SynPASS.tar.gz --type dataset --local-dir ./datasets
79
+ hf download InSAI-Lab/Trans4PASS --local-dir ./workdirs
80
+ ```
81
+
82
+ ---
83
+
84
+ ## ๐Ÿ”ฌ Recent Selected Publications
85
+ - **IEEE T-PAMI 2026:** *OneBEV++: Towards Unifying Birdโ€™s-Eye-View Semantic Mapping with Panoramas*
86
+ - **CVPR 2026:** *More than the Sum: Panorama-Language Models for Adverse Omni-Scenes*
87
+ - **ICML 2026:** *Position: Assistive Agents Need Accessibility Alignment*
88
+ - **BMVC 2026:** *XยฒLocalizer: Cross-grained Alignment for Progressive Cross-view Video Geo-localization*
89
+ - **CVPR 2023:** *Delivering Arbitrary-Modal Semantic Segmentation (DeLiVER & CMNeXt)*
90
+ - **CVPR 2022:** *Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation (Trans4PASS)*
91
+
92
+ ---
93
+
94
+ ## ๐Ÿค Connect & Collaborate
95
+ - ๐ŸŒ **Official Website:** [https://insailab.org](https://insailab.org)
96
+ - ๐Ÿ’ป **GitHub Organization:** [https://github.com/InSAI-Lab](https://github.com/InSAI-Lab)
97
+ - ๐Ÿ“ฌ **Recruitment & Inquiries:** [jiamingzhang@hnu.edu.cn](mailto:jiamingzhang@hnu.edu.cn)