Add paper link, pipeline tag and improve model card
Browse filesHi, I'm Niels from the Hugging Face community science team. I'm opening this PR to improve the model card for MATT-Diff.
This PR adds:
- The `robotics` pipeline tag to the metadata.
- A link to the [MATT-Diff paper](https://huggingface.co/papers/2511.11931).
- Links to the official [GitHub repository](https://github.com/CINAPSLab/MATT-Diff).
- Detailed usage instructions for downloading and evaluating the pre-trained checkpoints.
- The BibTeX citation for the paper.
README.md
CHANGED
|
@@ -1,4 +1,47 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
---
|
| 4 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: robotics
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
# MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy
|
| 7 |
+
|
| 8 |
+
This repository contains the models presented in the paper [MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy](https://huggingface.co/papers/2511.11931).
|
| 9 |
+
|
| 10 |
+
MATT-Diff is a diffusion-policy-based framework for **active multi-target tracking** in partially observable indoor environments. It learns multi-modal action strategies from three expert planners, using a transformer map encoder and an attention-based target encoder over Gaussian beliefs.
|
| 11 |
+
|
| 12 |
+
- **Paper:** [https://huggingface.co/papers/2511.11931](https://huggingface.co/papers/2511.11931)
|
| 13 |
+
- **Repository:** [https://github.com/CINAPSLab/MATT-Diff](https://github.com/CINAPSLab/MATT-Diff)
|
| 14 |
+
|
| 15 |
+
## Overview
|
| 16 |
+
The policy enables multiple behavior modes for the agent, including exploration, tracking, and target reacquisition, without prior knowledge of the target numbers, states, or dynamics. Trained as a diffusion model, the policy learns to generate multimodal action sequences through a denoising process.
|
| 17 |
+
|
| 18 |
+
## Usage
|
| 19 |
+
|
| 20 |
+
### Download Checkpoints
|
| 21 |
+
You can download the pretrained checkpoints using the Hugging Face CLI:
|
| 22 |
+
|
| 23 |
+
```bash
|
| 24 |
+
huggingface-cli download saidaliu27/MATT-Diff dp/best.pt --local-dir src/run/dp
|
| 25 |
+
huggingface-cli download saidaliu27/MATT-Diff bc/best.pt --local-dir src/run/bc
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
### Evaluate
|
| 29 |
+
After downloading the checkpoints and setting up the environment as described in the [GitHub repository](https://github.com/CINAPSLab/MATT-Diff), you can evaluate MATT-Diff:
|
| 30 |
+
|
| 31 |
+
```bash
|
| 32 |
+
python -u -m evals.eval_dp
|
| 33 |
+
```
|
| 34 |
+
|
| 35 |
+
## Citation
|
| 36 |
+
|
| 37 |
+
```bibtex
|
| 38 |
+
@misc{liu2025mattdiffmultimodalactivetarget,
|
| 39 |
+
title={MATT-Diff: Multimodal Active Target Tracking by Diffusion Policy},
|
| 40 |
+
author={Saida Liu and Nikolay Atanasov and Shumon Koga},
|
| 41 |
+
year={2025},
|
| 42 |
+
eprint={2511.11931},
|
| 43 |
+
archivePrefix={arXiv},
|
| 44 |
+
primaryClass={cs.RO},
|
| 45 |
+
url={https://arxiv.org/abs/2511.11931},
|
| 46 |
+
}
|
| 47 |
+
```
|