VladHong
/

llama-cpp-K2-FAST2

GGUF

llama.cpp

k2-horizon

sliding-window-attention

long-context

fast-inference

Model card Files Files and versions

xet

Community

llama-cpp-K2-FAST2 / tools /server /bench /prometheus.yml

VladHong

llama.cpp k2-fast2: MBZUAI model/K2Horizon + FAST2 sliding-window override

c59fd93 verified about 1 month ago

Raw History Blame Contribute Delete

183 Bytes

global:
  scrape_interval:     10s
  external_labels:
    llamacpp: 'server'

scrape_configs:
  - job_name: 'llama.cpp server'
    static_configs:
      - targets: ['localhost:8080']

	global:
	scrape_interval: 10s
	external_labels:
	llamacpp: 'server'

	scrape_configs:
	- job_name: 'llama.cpp server'
	static_configs:
	- targets: ['localhost:8080']