Video-ChatGPT
Collection
"Video-ChatGPT" is a video conversation model capable of generating meaningful conversation about videos. β’ 2 items β’ Updated β’ 3
How to use MBZUAI/Video-ChatGPT-7B with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "visual-question-answering" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# pip install "transformers<5.0.0"
from transformers import pipeline
pipe = pipeline("visual-question-answering", model="MBZUAI/Video-ChatGPT-7B") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("MBZUAI/Video-ChatGPT-7B", device_map="auto")# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("MBZUAI/Video-ChatGPT-7B", device_map="auto")Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation.
# Use a pipeline as a high-level helper # Warning: Pipeline type "visual-question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("visual-question-answering", model="MBZUAI/Video-ChatGPT-7B")