VladHong
/

llama-cpp-K2-FAST2

GGUF

llama.cpp

k2-horizon

sliding-window-attention

long-context

fast-inference

Model card Files Files and versions

xet

Community

llama-cpp-K2-FAST2 / examples /model-conversion /scripts /causal /modelcard.template

VladHong

llama.cpp k2-fast2: MBZUAI model/K2Horizon + FAST2 sliding-window override

c59fd93 verified about 1 month ago

Raw History Blame Contribute Delete

185 Bytes

---
base_model:
- {base_model}
---
# {model_name} GGUF

Recommended way to run this model:

```sh
llama-server -hf {namespace}/{model_name}-GGUF
```

Then, access http://localhost:8080

	---
	base_model:
	- {base_model}
	---
	# {model_name} GGUF

	Recommended way to run this model:

	```sh
	llama-server -hf {namespace}/{model_name}-GGUF
	```

	Then, access http://localhost:8080