Instructions to use xThr45hx/TensorRT-LLM-Windows-RTX40 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use xThr45hx/TensorRT-LLM-Windows-RTX40 with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Add prebuilt INT4 engine (Josiefied-Qwen3-4B, 16k ctx)
Verified signaturef442a98 -
Fix base_model to Josiefied-Qwen3-4B-abliterated-v1 + note uncensored engine
Verified signature4211205 -
Add import library
Verified signaturedfc8aa7 -
Add native Windows TRT-LLM DLL (SM89)
Verified signaturec01268e -
Add source, patches, scripts, build notes, README, LICENSE
Verified signature00db36f -
initial commit
Verified signature67f09e3