Instructions to use HopeTD/consulting with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use HopeTD/consulting with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("ByteDance/Hyper-SD", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("HopeTD/consulting") prompt = "Hopedesigns" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Download vqa.yaml from HopeTD/consulting: direct link, hf CLI and curl.
- Browser
- Download file 663 Bytes
-
https://huggingface.co/HopeTD/consulting/resolve/main/vqa.yaml
- Command line
-
hf download hf://HopeTD/consulting/vqa.yaml
-
curl -L -o vqa.yaml https://huggingface.co/HopeTD/consulting/resolve/main/vqa.yaml
663 Bytes
| vqa_root: '/export/share/datasets/vision/VQA/Images/mscoco/' #followed by train2014/ | |
| vg_root: '/export/share/datasets/vision/visual-genome/' #followed by image/ | |
| train_files: ['vqa_train','vqa_val','vg_qa'] | |
| ann_root: 'annotation' | |
| # set pretrained as a file path or an url | |
| pretrained: 'https://storage.googleapis.com/sfr-vision-language-research/BLIP/models/model_base_vqa_capfilt_large.pth' | |
| # size of vit model; base or large | |
| vit: 'base' | |
| batch_size_train: 16 | |
| batch_size_test: 32 | |
| vit_grad_ckpt: False | |
| vit_ckpt_layer: 0 | |
| init_lr: 2e-5 | |
| image_size: 480 | |
| k_test: 128 | |
| inference: 'rank' | |
| # optimizer | |
| weight_decay: 0.05 | |
| min_lr: 0 | |
| max_epoch: 10 |