Model-SafeTensors/Meta-Llama-3-70B-FP8-Dynamic
Text Generation • 71B • Updated • 12
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
5,534
Active filters: fp8
Model-SafeTensors/Qwen-Qwen2-72B-FP8-Dynamic
Text Generation • 73B • Updated • 15
RedHatAI/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation • 71B • Updated • 34 • 3
RedHatAI/Mistral-7B-Instruct-v0.3-FP8
Text Generation • 7B • Updated • 643 • 3
RedHatAI/Llama-2-7b-chat-hf-FP8
Text Generation • 7B • Updated • 52
RedHatAI/Phi-3-mini-128k-instruct-FP8
Text Generation • 4B • Updated • 172
RedHatAI/Phi-3-medium-128k-instruct-FP8
Text Generation • 14B • Updated • 54 • 5
FlorianJc/google-gemma-2-9b-it-vllm-fp8
Text Generation • 9B • Updated • 14 • 1
tranhoangnguyen03/Gemma-2-9B-It-SPPO-Iter3_Q8
Text Generation • 9B • Updated • 8
Model-SafeTensors/mistralai-Mixtral-8x7B-v0.1
Text Generation • 47B • Updated • 18
Model-SafeTensors/mistralai-Mixtral-8x22B
Text Generation • 141B • Updated • 11
FlorianJc/Llama3-ChatQA-1.5-8B-v2-vllm-fp8
Text Generation • 8B • Updated • 13
FlorianJc/MegaBeam-Mistral-7B-300k-vllm-fp8
Text Generation • 7B • Updated • 16
RedHatAI/gemma-2-9b-it-FP8
Text Generation • 9B • Updated • 831 • • 5
darthhexx/Phi-3-medium-128k-instruct-fp8
Text Generation • 14B • Updated • 20
muhtasham/TowerInstruct-7B-v0.1-FP8
Text Generation • 7B • Updated • 13
raja-nectar/Lumimaid-70B-fp8
Text Generation • 71B • Updated • 7
raja-nectar/Lumimaid-70B-FP8-OAS
Text Generation • 71B • Updated • 7
Ksgk-fy/maria-v2-fp8-dynamic
Text Generation • 8B • Updated
Ksgk-fy/maria-v2-fp8-static
Text Generation • 8B • Updated • 10
Ksgk-fy/maria_v113-fp8-dynamic
Text Generation • 8B • Updated
Ksgk-fy/maria_v114-fp8-dynamic
Text Generation • 8B • Updated • 9
Ksgk-fy/maria_v115-fp8-dynamic
Text Generation • 8B • Updated • 9
RedHatAI/Qwen2-57B-A14B-Instruct-FP8
Text Generation • 57B • Updated • 177 • 1
nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V
Text Generation • 8B • Updated • 29
RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8
Text Generation • 16B • Updated • 6.57k • 14
RedHatAI/DeepSeek-Coder-V2-Lite-Base-FP8
Text Generation • 16B • Updated • 106
mgoin/Mistral-Nemo-Instruct-2407-FP8-Dynamic
Text Generation • 12B • Updated • 17
mgoin/Mistral-Nemo-Instruct-2407-FP8-KV
Text Generation • 12B • Updated • 26 • 1
RedHatAI/Mistral-Nemo-Instruct-2407-FP8
Text Generation • 12B • Updated • 4.27k • 19