docs: add official InSAI Lab organization card
Browse files
README.md
CHANGED
|
@@ -1,10 +1,97 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
title: InSAI Lab Profile
|
| 3 |
+
emoji: ๐๏ธ
|
| 4 |
+
colorFrom: indigo
|
| 5 |
+
colorTo: blue
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
<div align="center">
|
| 11 |
+
|
| 12 |
+
<img src="https://cdn-avatars.huggingface.co/v1/production/uploads/69d4baff8e85a8e1ae8370a5/qqeGpW3kQ8GVDcazES1nW.png" width="120px" alt="InSAI Lab Logo" />
|
| 13 |
+
|
| 14 |
+
# Integrated Sensing and Assistive Intelligence (InSAI) Lab
|
| 15 |
+
### School of AI and Robotics, Hunan University (HNU)
|
| 16 |
+
|
| 17 |
+
<p align="center">
|
| 18 |
+
<a href="https://insailab.org"><img src="https://img.shields.io/badge/Official-Website-blue?style=flat-square&logo=googlechrome" /></a>
|
| 19 |
+
<a href="https://github.com/InSAI-Lab"><img src="https://img.shields.io/badge/GitHub-InSAI--Lab-181717?style=flat-square&logo=github" /></a>
|
| 20 |
+
<a href="https://huggingface.co/InSAI-Lab"><img src="https://img.shields.io/badge/HuggingFace-InSAI--Lab-FFD21E?style=flat-square&logo=huggingface" /></a>
|
| 21 |
+
<a href="mailto:jiamingzhang@hnu.edu.cn"><img src="https://img.shields.io/badge/Email-Contact_Us-red?style=flat-square&logo=gmail" /></a>
|
| 22 |
+
</p>
|
| 23 |
+
|
| 24 |
+
*"Building a utopia where integrated sensing systems empower and enhance human capabilities, especially benefiting people with disabilities."*
|
| 25 |
+
|
| 26 |
+
</div>
|
| 27 |
+
|
| 28 |
+
---
|
| 29 |
+
|
| 30 |
+
## ๐ฏ About InSAI Lab
|
| 31 |
+
|
| 32 |
+
The **InSAI** (pronounced like *"Insight"*) Lab operates within the **School of AI and Robotics at Hunan University**.
|
| 33 |
+
Our mission is to merge interdisciplinary fields โ including **computer vision, robotics, intelligent transportation systems, assistive technologies, and human-computer interaction (HCI)** โ to develop deployable **Assistive Intelligence**.
|
| 34 |
+
|
| 35 |
+
### Core Research Directions
|
| 36 |
+
- ๐ **Multimodal Perception & Scene Understanding:** Vision-Language Modeling, 2D/3D Vision, and sensor fusion in complex, adverse real-world environments.
|
| 37 |
+
- ๐ **Autonomous Systems & Panoramic Vision:** Semantic Mapping, Panoramic Sensing, Distortion-aware Transformers, and Birdโs-Eye-View (BEV) perception.
|
| 38 |
+
- ๐ค **Embodied Intelligence:** Perception, navigation, and decision-making linking foundation models with robotic action, including Sim2Real adaptation.
|
| 39 |
+
- โฟ **Assistive Technologies:** Wearable assistive systems, navigation aids, and accessible interfaces designed around human capabilities.
|
| 40 |
+
- ๐ง **Brain-Computer Interface & Document Understanding:** Cognitive state sensing, assistive BCI, and intelligent layout/reading assistance.
|
| 41 |
+
|
| 42 |
+
---
|
| 43 |
+
|
| 44 |
+
## ๐ Featured Open-Source Projects on Hugging Face
|
| 45 |
+
|
| 46 |
+
### 1. [DeLiVER & CMNeXt (CVPR 2023)](https://huggingface.co/InSAI-Lab/CMNeXt)
|
| 47 |
+
> **Delivering Arbitrary-Modal Semantic Segmentation**
|
| 48 |
+
|
| 49 |
+
A comprehensive benchmark and cross-modal architecture scaling dynamically across **1 to 81 modalities** (Depth, LiDAR, Events, Multi-Views, RGB) under 4 severe weather conditions and 5 sensor failure corner cases.
|
| 50 |
+
|
| 51 |
+
| Resource | Hugging Face Repository | Description |
|
| 52 |
+
| :--- | :--- | :--- |
|
| 53 |
+
| ๐ฆ **Dataset** | [`InSAI-Lab/DELIVER`](https://huggingface.co/datasets/InSAI-Lab/DELIVER) | Full multimodal dataset package (12.22 GB) |
|
| 54 |
+
| ๐ค **Model Zoo** | [`InSAI-Lab/CMNeXt`](https://huggingface.co/InSAI-Lab/CMNeXt) | 37 trained checkpoints covering DELIVER, KITTI-360, MFNet, NYU Depth V2, UrbanLF, MCubeS, and SegFormer/Swin backbones |
|
| 55 |
+
| ๐ **Paper** | [arXiv:2303.01480](https://arxiv.org/abs/2303.01480) | CVPR 2023 Paper |
|
| 56 |
+
|
| 57 |
+
```bash
|
| 58 |
+
# Quick download via Hugging Face CLI
|
| 59 |
+
hf download InSAI-Lab/DELIVER DELIVER.tar.gz --type dataset --local-dir ./data
|
| 60 |
+
hf download InSAI-Lab/CMNeXt --local-dir ./checkpoints
|
| 61 |
+
```
|
| 62 |
+
|
| 63 |
+
---
|
| 64 |
+
|
| 65 |
+
### 2. [SynPASS & Trans4PASS / Trans4PASS+ (CVPR 2022)](https://huggingface.co/InSAI-Lab/Trans4PASS)
|
| 66 |
+
> **Transformers for Panoramic Semantic Segmentation & Domain Adaptation**
|
| 67 |
+
|
| 68 |
+
Distortion-aware Vision Transformers tailored for 360ยฐ panoramic cameras and omnidirectional scene understanding, featuring the 9,080-frame SynPASS benchmark.
|
| 69 |
+
|
| 70 |
+
| Resource | Hugging Face Repository | Description |
|
| 71 |
+
| :--- | :--- | :--- |
|
| 72 |
+
| ๐ฆ **Dataset** | [`InSAI-Lab/SynPASS`](https://huggingface.co/datasets/InSAI-Lab/SynPASS) | 9,080 high-res panoramic semantic segmentation benchmark (4.79 GB) |
|
| 73 |
+
| ๐ค **Model Zoo** | [`InSAI-Lab/Trans4PASS`](https://huggingface.co/InSAI-Lab/Trans4PASS) | 40 checkpoints across Cityscapes, Stanford2D3D, Structured3D, and MPA domain adaptation snapshots |
|
| 74 |
+
| ๐ **Papers** | [arXiv:2203.01452](https://arxiv.org/abs/2203.01452) / [arXiv:2207.11860](https://arxiv.org/abs/2207.11860) | CVPR 2022 & arXiv Preprints |
|
| 75 |
+
|
| 76 |
+
```bash
|
| 77 |
+
# Quick download via Hugging Face CLI
|
| 78 |
+
hf download InSAI-Lab/SynPASS SynPASS.tar.gz --type dataset --local-dir ./datasets
|
| 79 |
+
hf download InSAI-Lab/Trans4PASS --local-dir ./workdirs
|
| 80 |
+
```
|
| 81 |
+
|
| 82 |
+
---
|
| 83 |
+
|
| 84 |
+
## ๐ฌ Recent Selected Publications
|
| 85 |
+
- **IEEE T-PAMI 2026:** *OneBEV++: Towards Unifying Birdโs-Eye-View Semantic Mapping with Panoramas*
|
| 86 |
+
- **CVPR 2026:** *More than the Sum: Panorama-Language Models for Adverse Omni-Scenes*
|
| 87 |
+
- **ICML 2026:** *Position: Assistive Agents Need Accessibility Alignment*
|
| 88 |
+
- **BMVC 2026:** *XยฒLocalizer: Cross-grained Alignment for Progressive Cross-view Video Geo-localization*
|
| 89 |
+
- **CVPR 2023:** *Delivering Arbitrary-Modal Semantic Segmentation (DeLiVER & CMNeXt)*
|
| 90 |
+
- **CVPR 2022:** *Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation (Trans4PASS)*
|
| 91 |
+
|
| 92 |
+
---
|
| 93 |
+
|
| 94 |
+
## ๐ค Connect & Collaborate
|
| 95 |
+
- ๐ **Official Website:** [https://insailab.org](https://insailab.org)
|
| 96 |
+
- ๐ป **GitHub Organization:** [https://github.com/InSAI-Lab](https://github.com/InSAI-Lab)
|
| 97 |
+
- ๐ฌ **Recruitment & Inquiries:** [jiamingzhang@hnu.edu.cn](mailto:jiamingzhang@hnu.edu.cn)
|