How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf aaro765/BanBTPV9:F16# Run inference directly in the terminal:
llama cli -hf aaro765/BanBTPV9:F16Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf aaro765/BanBTPV9:F16# Run inference directly in the terminal:
./llama-cli -hf aaro765/BanBTPV9:F16Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf aaro765/BanBTPV9:F16# Run inference directly in the terminal:
./build/bin/llama-cli -hf aaro765/BanBTPV9:F16Use Docker
docker model run hf.co/aaro765/BanBTPV9:F16Quick Links
Introducing BanBTPV9, the last version of BanBTP series, designed to be a true chatbot just like our original release but even better!
What does this mean? is BanBTP officially over? No. This just means this is the end for our vanilla GPT2 based BanBTP models. new models will support a more modern gpt2 with modern tokenizer. we use gpt2 because it is open source.
Starting With BanBTP V10 (aka bantp codenamed BannerBTP) all BanBTP models will be labeled under BanBTP 2.0-V{version number}.
There will also be a BanBTP 2.0 comparison too.
- Downloads last month
- 38
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf aaro765/BanBTPV9:F16# Run inference directly in the terminal: llama cli -hf aaro765/BanBTPV9:F16