Video-Text-to-Text
Transformers
Safetensors
English
qwen2
text-generation
Action
Video
MQA
multimodal
VLM
LLaVAction
MLLMs
Eval Results (legacy)
text-generation-inference
Instructions to use MLAdaptiveIntelligence/LLaVAction-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MLAdaptiveIntelligence/LLaVAction-7B with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("MLAdaptiveIntelligence/LLaVAction-7B") model = AutoModelForCausalLM.from_pretrained("MLAdaptiveIntelligence/LLaVAction-7B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -99,15 +99,15 @@ model-index:
|
|
| 99 |
<h2>LLaVAction: evaluating and training multi-modal large language models for action recognition
|
| 100 |
</h2>
|
| 101 |
|
| 102 |
-
[Shaokai Ye](https://
|
| 103 |
-
[Haozhe Qi](https://
|
| 104 |
|
| 105 |
-
[Alexander Mathis](https://
|
| 106 |
-
[Mackenzie Weygandt Mathis](https://
|
| 107 |
|
| 108 |
<sup>1</sup> EPFL
|
| 109 |
|
| 110 |
-
<sup>*</sup> First authors <sup>†</sup> Senior Authors <sup>‡</sup> Corresponding Author
|
| 111 |
|
| 112 |
\[[arXiv Paper](https://www.arxiv.org/tbd)\] \[[Project Page](https://mmathislab.github.io/llavaction/)\] \[[Github Repo](https://github.com/AdaptiveMotorControlLab/LLaVAction)\]
|
| 113 |
|
|
|
|
| 99 |
<h2>LLaVAction: evaluating and training multi-modal large language models for action recognition
|
| 100 |
</h2>
|
| 101 |
|
| 102 |
+
[Shaokai Ye](https://yeshaokai.github.io/)<sup>1**</sup>
|
| 103 |
+
[Haozhe Qi](https://people.epfl.ch/haozhe.qi)<sup>1**</sup>
|
| 104 |
|
| 105 |
+
[Alexander Mathis](https://mathislab.org/)<sup>1</sup><sup>†</sup>
|
| 106 |
+
[Mackenzie Weygandt Mathis](https://www.mackenziemathislab.org/mackenziemathis)<sup>1</sup><sup>†</sup><sup>‡</sup>
|
| 107 |
|
| 108 |
<sup>1</sup> EPFL
|
| 109 |
|
| 110 |
+
<sup>**</sup> First authors <sup>†</sup> Senior Authors <sup>‡</sup> Corresponding Author
|
| 111 |
|
| 112 |
\[[arXiv Paper](https://www.arxiv.org/tbd)\] \[[Project Page](https://mmathislab.github.io/llavaction/)\] \[[Github Repo](https://github.com/AdaptiveMotorControlLab/LLaVAction)\]
|
| 113 |
|