Instructions to use zh1124/typst-autocomplete-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use zh1124/typst-autocomplete-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-7B") model = PeftModel.from_pretrained(base_model, "zh1124/typst-autocomplete-lora") - Notebooks
- Google Colab
- Kaggle
File size: 703 Bytes
e73fb06 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | name: Main Config
version: 1.0.0
schema: v1
models:
- name: Qwen Typst Autocomplete 7B
provider: ollama
model: qwen2.5-coder-typst:7b
roles:
- autocomplete
defaultCompletionOptions:
temperature: 0
maxTokens: 96
keepAlive: 1800
stop:
- "<|fim_prefix|>"
- "<|fim_suffix|>"
- "<|fim_middle|>"
- "<|endoftext|>"
- "<|fim_pad|>"
autocompleteOptions:
template: "<|fim_prefix|>{{{prefix}}}<|fim_suffix|>{{{suffix}}}<|fim_middle|>"
maxPromptTokens: 2048
debounceDelay: 300
maxSuffixPercentage: 0.2
prefixPercentage: 0.6
onlyMyCode: false
useCache: true
useImports: true
|