Transformers
PyTorch
Safetensors
GGUF
Bengali
mistral
text-generation-inference
unsloth
trl
sft
8-bit precision
Instructions to use barunsaha/misti with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use barunsaha/misti with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("barunsaha/misti", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use barunsaha/misti with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf barunsaha/misti:Q4_K_M # Run inference directly in the terminal: llama cli -hf barunsaha/misti:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf barunsaha/misti:Q4_K_M # Run inference directly in the terminal: llama cli -hf barunsaha/misti:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf barunsaha/misti:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf barunsaha/misti:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf barunsaha/misti:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf barunsaha/misti:Q4_K_M
Use Docker
docker model run hf.co/barunsaha/misti:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use barunsaha/misti with Ollama:
ollama run hf.co/barunsaha/misti:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use barunsaha/misti with Docker Model Runner:
docker model run hf.co/barunsaha/misti:Q4_K_M
- Lemonade
How to use barunsaha/misti with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull barunsaha/misti:Q4_K_M
Run and chat with the model
lemonade run user.misti-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Update README.md
Verified signatureUpdate notebook linkdb09395
-
Add inference link
Verified signature9cae745 -
Change language
Verified signaturec7eef2c -
(Trained with Unsloth)
Verified signature6321ebe -
(Trained with Unsloth)
Verified signaturebdfcb99 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterae46b21 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster5c4a058 -
Trained with Unsloth
Verified signatured72716a -
Upload tokenizer
Verified signature5f35c12 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster95e4b8c -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterdd47568
-
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster9115959 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster8769255 -
(Trained with Unsloth)
Verified signaturea7cbb5c -
(Trained with Unsloth)
Verified signature3357be8 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster5008d49 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster7c6bbe5 -
Trained with Unsloth
Verified signature52e9fc4 -
Upload tokenizer
Verified signaturefd3b6eb -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fastera1da43e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterc989641
-
(Trained with Unsloth)
Verified signature99eb807 -
(Trained with Unsloth)
Verified signaturef798170 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster02cd805 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster18c386b -
Trained with Unsloth
Verified signature78e4065 -
Upload tokenizer
Verified signature2cf577e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster8528a5e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster04a5c77 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterf6418cb -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster3b6cca2 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster740493a -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster5a3f7f8 -
Trained with Unsloth
Verified signature640a38a -
Upload tokenizer
Verified signaturee47f819 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster538951d -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster84b212a -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster5c95daf -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fastere24f2e1 -
Trained with Unsloth
Verified signature895be15 -
Upload tokenizer
Verified signature0f6c637 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterfa9c103 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster193db23 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster796c066 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterff2706e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster0c8c699 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster941b02e -
(Trained with Unsloth)
Verified signature6b293de -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster9ce8c04 -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster7cd9803