Active filters: kto
mradermacher/Qwen2.5-7B-sft-gen-dpo-10k-KTO-GGUF
8B • Updated • 5
mradermacher/Qwen2.5-7B-sft-dpo-10k-KTO-GGUF
8B • Updated • 67
mradermacher/Qwen2.5-7B-sft-spin-10k-KTO-GGUF
8B • Updated • 33
mradermacher/Qwen2.5-7B-sft-peers-pool-KTO-GGUF
8B • Updated • 99
mradermacher/Qwen2.5-7B-sft-all-pool-KTO-GGUF
8B • Updated • 30
mradermacher/Qwen2.5-7B-sft-SPIN-gpt4o-KTO-GGUF
8B • Updated • 50
mradermacher/Qwen2.5-7B-sft-SPIN-Qwen2.5-72B-Instruct-KTO-GGUF
8B • Updated • 18
willyli/Seed-Coder-8B-Instruct-KTO
Text Generation
• 8B • Updated • 14
Incomple/Llama-3.1-8B-Instruct_kto_sg_values
allura-forge/ms32-kto-adpt-ckpts
allura-forge/ms32-kto-adpt-v2
Updated
IoakeimE/kto_simplification
Updated
allura-forge/ms32-kto-adpt-v3
Text Generation
• 4B • Updated • 5
hardlyworking/4Bkto-Q8_0-GGUF
4B • Updated • 6
tensorblock/willyli_Seed-Coder-8B-Instruct-KTO-GGUF
Burnt-Toast/nemo-kimi-kto
Text Generation
• 0.3B • Updated • 29
Fill-Mask
• Updated • 67.7k
• • 108
mradermacher/Llama-3.1-8B-sft-all-pool-KTO-GGUF
8B • Updated • 119
mradermacher/Llama-3.1-8B-sft-SPIN-gpt4o-KTO-GGUF
8B • Updated • 75
mradermacher/Llama-3.1-8B-sft-spin-10k-KTO-GGUF
8B • Updated • 75
mradermacher/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-KTO-GGUF
8B • Updated • 121
mradermacher/Llama-3.1-8B-sft-peers-pool-KTO-GGUF
8B • Updated • 59
mradermacher/Seed-Coder-8B-Instruct-KTO-GGUF
8B • Updated • 272
mradermacher/Llama-3.1-8B-sft-gen-dpo-10k-KTO-GGUF
8B • Updated • 83
cactopus/Archaeo-32B-KTO_EXL3_4.0bpw_H6
Text Generation
• 9B • Updated • 9
cactopus/Archaeo-32B-KTO_EXL3_6.0bpw_H8
Text Generation
• 13B • Updated • 8
Aaryan-Nakhat/experiment_116_RL_itr_3_on_exp_105_model_v2
Text Generation
• 3B • Updated • 5
Aaryan-Nakhat/experiment_117_RL_itr_4_on_exp_105_model_v2
Text Generation
• 3B • Updated • 6
Aaryan-Nakhat/experiment_119_RL_itr_4_on_exp_105_model_v2
Text Generation
• 3B • Updated • 5