Video-Text-to-Text
Transformers
Safetensors
English
qwen2
text-generation
Action
Video
MQA
multimodal
VLM
LLaVAction
MLLMs
Eval Results (legacy)
text-generation-inference
Instructions to use MLAdaptiveIntelligence/LLaVAction-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use MLAdaptiveIntelligence/LLaVAction-7B with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("MLAdaptiveIntelligence/LLaVAction-7B") model = AutoModelForCausalLM.from_pretrained("MLAdaptiveIntelligence/LLaVAction-7B", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -108,11 +108,11 @@ This model supports at most 64 frames.
|
|
| 108 |
## Useage
|
| 109 |
|
| 110 |
### Intended use
|
| 111 |
-
The model was trained on EPIC-KITCHENS-100-MQA and LLaVA-Video-178K
|
| 112 |
|
| 113 |
|
| 114 |
### Generation
|
| 115 |
-
We provide the simple generation process for using our model. For more details, you could refer to Github.
|
| 116 |
|
| 117 |
```python
|
| 118 |
!pip install llavaction
|
|
|
|
| 108 |
## Useage
|
| 109 |
|
| 110 |
### Intended use
|
| 111 |
+
The model was trained on EPIC-KITCHENS-100-MQA [dataset release pending] and [LLaVA-Video-178K](https://huggingface.co/datasets/lmms-lab/LLaVA-Video-178K). It has improved capability on understanding human egocentric actions from videos.
|
| 112 |
|
| 113 |
|
| 114 |
### Generation
|
| 115 |
+
We provide the simple generation process for using our model. For more details, you could refer to our [Github](https://github.com/AdaptiveMotorControlLab/LLaVAction).
|
| 116 |
|
| 117 |
```python
|
| 118 |
!pip install llavaction
|