Duplicated from mbayser/granite-20b-functioncalling-FP8-KV

vllm-project
/

granite-20b-functioncalling-FP8-KV

compressed-tensors

Model card Files Files and versions

granite-20b-functioncalling-FP8-KV / generation_config.json

hmellor's picture

hmellor HF Staff

mbayser's picture

Duplicate from mbayser/granite-20b-functioncalling-FP8-KV

a37a7ad 2 days ago

Raw History Blame Contribute Delete

132 Bytes

{
  "_from_model_config": true,
  "bos_token_id": 0,
  "eos_token_id": 0,
  "pad_token_id": 0,
  "transformers_version": "4.45.2"
}