Instructions to use hamayawayuri/Models_uid with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hamayawayuri/Models_uid with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="hamayawayuri/Models_uid") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("hamayawayuri/Models_uid") model = AutoModelForMultimodalLM.from_pretrained("hamayawayuri/Models_uid", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use hamayawayuri/Models_uid with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "hamayawayuri/Models_uid" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamayawayuri/Models_uid", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/hamayawayuri/Models_uid
- SGLang
How to use hamayawayuri/Models_uid with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "hamayawayuri/Models_uid" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamayawayuri/Models_uid", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "hamayawayuri/Models_uid" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "hamayawayuri/Models_uid", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use hamayawayuri/Models_uid with Docker Model Runner:
docker model run hf.co/hamayawayuri/Models_uid
|
Download README.md from hamayawayuri/Models_uid: direct link, hf CLI and curl.
- Browser
- Download file 2.47 kB
-
https://huggingface.co/hamayawayuri/Models_uid/resolve/main/README.md
- Command line
-
hf download hf://hamayawayuri/Models_uid/README.md
-
curl -L -o README.md https://huggingface.co/hamayawayuri/Models_uid/resolve/main/README.md
2.47 kB
| library_name: transformers | |
| license: apache-2.0 | |
| license_link: https://huggingface.co/Qwen/Qwen3.6-27B/blob/main/LICENSE | |
| pipeline_tag: image-text-to-text | |
| base_model: | |
| - Qwen/Qwen3.6-27B | |
| tags: | |
| - abliterated | |
| - uncensored | |
| # huihui-ai/Huihui-Qwen3.6-27B-abliterated | |
| This is an uncensored version of [Qwen/Qwen3.6-27B](https://huggingface.co/Qwen/Qwen3.6-27B) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). | |
| This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. | |
| ## ollama | |
| Please use the latest version of [ollama](https://github.com/ollama/ollama/releases/tag) | |
| You can use [huihui_ai/qwen3.6-abliterated:27b](https://ollama.com/huihui_ai/qwen3.6-abliterated:27b) directly, | |
| ``` | |
| ollama run huihui_ai/qwen3.6-abliterated:27b | |
| ``` | |
| ### Usage Warnings | |
| - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs. | |
| - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security. | |
| - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences. | |
| - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications. | |
| - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content. | |
| - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use. | |
| ### Donation | |
| ##### Your donation helps us continue our further development and improvement, a cup of coffee can do it. | |
| - bitcoin: | |
| ``` | |
| bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge | |
| ``` | |
| - Support our work on [Ko-fi](https://ko-fi.com/huihuiai)! | |