BanBTP V9 and V10!
Collection
Improved from V7 and V8. • 4 items • Updated
How to use aaro765/BanBTPV9 with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf aaro765/BanBTPV9:F16 # Run inference directly in the terminal: llama cli -hf aaro765/BanBTPV9:F16
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf aaro765/BanBTPV9:F16 # Run inference directly in the terminal: llama cli -hf aaro765/BanBTPV9:F16
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf aaro765/BanBTPV9:F16 # Run inference directly in the terminal: ./llama-cli -hf aaro765/BanBTPV9:F16
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf aaro765/BanBTPV9:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf aaro765/BanBTPV9:F16
docker model run hf.co/aaro765/BanBTPV9:F16
How to use aaro765/BanBTPV9 with Ollama:
ollama run hf.co/aaro765/BanBTPV9:F16
How to use aaro765/BanBTPV9 with Docker Model Runner:
docker model run hf.co/aaro765/BanBTPV9:F16
How to use aaro765/BanBTPV9 with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull aaro765/BanBTPV9:F16
lemonade run user.BanBTPV9-F16
lemonade list
Introducing BanBTPV9, the last version of BanBTP series, designed to be a true chatbot just like our original release but even better!
What does this mean? is BanBTP officially over? No. This just means this is the end for our vanilla GPT2 based BanBTP models. new models will support a custom architecture.
Starting With BanBTP V10 (aka bantp codenamed BannerBTP) all BanBTP models will be labeled under BanBTP 2.0-V{version number}.
There will also be a BanBTP 2.0 comparison too.
16-bit