Instructions to use aoxo/kevin-token-compressor with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use aoxo/kevin-token-compressor with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Meta-Llama-3.1-8B-bnb-4bit") model = PeftModel.from_pretrained(base_model, "aoxo/kevin-token-compressor") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signature3159d9f -
Update README.md
Verified signature3ef59be -
Update README.md
Verified signature7b3a880 -
Upload thumbnail.jpg
Verified signatureac1287c -
Update README.md
Verified signaturefd7d9ff -
Update README.md
Verified signatureb6321cd -
Upload stats1.jpg
Verified signature289ccbd -
Delete stats1.jpg
Verified signature850119f -
Update token-compressor.ipynb
Verified signature8dfabd3 -
Update README.md
Verified signature9f9ca6f -
Update README.md
Verified signature93a0f13 -
Update README.md
Verified signatureeedd7b8 -
Update token-compressor.ipynb
Verified signature8bf1880 -
Upload token-compressor.ipynb
Verified signaturefinetuning scriptscf72d0d -
Upload Token Compressor _ huggingface – Weights & Biases.pdf
Verified signaturewandb reportba8cc42 -
Upload 3 files
Verified signaturestatsf2badcd -
Upload 11 files
Verified signature1afabdd -
Delete training_args.bin
Verified signature462b3fa -
Delete tokenizer_config.json
Verified signature3e9ee5e -
Delete tokenizer.json
Verified signature7e55e8a -
Delete special_tokens_map.json
Verified signaturea596e0e -
Delete adapter_model.safetensors
Verified signature2798896 -
Delete adapter_config.json
Verified signaturef073050 -
Delete .gitattributes
Verified signature5dbcc1c -
Delete runs
Verified signaturedelete runs964c5f7 -
Training in progress, epoch 0
Verified signature0665bc9 -
Training in progress, epoch 0
Verified signature58936d7
-
initial commit
Verified signature3908b2d