Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

yuta24
/
ui-test-vision-2b-alpha

Image-Text-to-Text
PEFT
Safetensors
MLX
ios
ui-testing
screenshot
lora
clef
alpha
Model card Files Files and versions
xet
Community

Instructions to use yuta24/ui-test-vision-2b-alpha with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • PEFT

    How to use yuta24/ui-test-vision-2b-alpha with PEFT:

    Task type is invalid.
  • MLX

    How to use yuta24/ui-test-vision-2b-alpha with MLX:

    # Make sure mlx-vlm is installed
    # pip install --upgrade mlx-vlm
    
    from mlx_vlm import load, generate
    from mlx_vlm.prompt_utils import apply_chat_template
    from mlx_vlm.utils import load_config
    
    # Load the model
    model, processor = load("yuta24/ui-test-vision-2b-alpha")
    config = load_config("yuta24/ui-test-vision-2b-alpha")
    
    # Prepare input
    image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
    prompt = "Describe this image."
    
    # Apply chat template
    formatted_prompt = apply_chat_template(
        processor, config, prompt, num_images=1
    )
    
    # Generate output
    output = generate(model, processor, formatted_prompt, image)
    print(output)
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps Settings
  • LM Studio
  • Atomic Chat
ui-test-vision-2b-alpha / code /glint
66 kB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
yuta24's picture
yuta24
v0.1.0-alpha: PyTorch LoRA + heads, code, model card
e379257 verified 19 days ago
  • __init__.py
    33 Bytes
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • box.py
    13.9 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • data.py
    4.92 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • glint_model.py
    2.58 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • joint_schema_model.py
    24.1 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • losses.py
    2.55 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • model.py
    5.19 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • schema.py
    7.73 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago
  • schema_compact.py
    5.03 kB
    v0.1.0-alpha: PyTorch LoRA + heads, code, model card 19 days ago