File size: 199 Bytes
06b4b72 | 1 2 3 4 5 6 7 8 9 10 11 12 | attention_config:
backend: VANILLA
parallel_config:
cfg_size: 1
ulysses_size: 1
torch_compile_config:
enable: false
cuda_graph_config:
enable: false
compilation_config:
skip_warmup: true
|