Edit Models filters

Showing models from

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

806

Base only

Active filters: RedHatAI

RedHatAI/gemma-2-9b-it-quantized.w8a8

Text Generation • 10B • Updated Aug 19 • 45 • 2

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • 406B • Updated Aug 19 • 66 • 2

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • 406B • Updated Aug 19 • 62 • 2

RedHatAI/gemma-2-27b-it-quantized.w8a16

Text Generation • 28B • Updated Aug 19 • 41

RedHatAI/SmolLM-135M-Instruct-quantized.w8a16

Text Generation • 0.2B • Updated Aug 19 • 383

RedHatAI/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • 0.4B • Updated Aug 19 • 44

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • 0.2B • Updated Aug 19 • 46 • 1

RedHatAI/SmolLM-135M-q

Updated Aug 23, 2024

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • 2B • Updated Aug 19 • 43 • 1

RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • 1B • Updated Oct 9, 2024 • 10.4k • 4

RedHatAI/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • 4B • Updated Oct 9, 2024 • 252k • 3

RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • 1B • Updated Aug 19 • 4.35k • 8

RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • 4B • Updated Jul 10, 2025 • 926 • 1

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • 89B • Updated Oct 2, 2024 • 149 • 12

RedHatAI/Llama-3.2-1B-Instruct-FP8

Text Generation • 1B • Updated Aug 14 • 10.7k • 4

RedHatAI/Llama-3.2-3B-Instruct-FP8

Text Generation • 4B • Updated Aug 19 • 3.09k • 6

RedHatAI/Llama-3.2-1B-quantized.w8a8

1B • Updated Jan 16, 2025 • 3.79k • 1

RedHatAI/Llama-3.2-3B-quantized.w8a8

4B • Updated Aug 19 • 1.04k

RedHatAI/Llama-3.2-1B-FP8

1B • Updated Aug 19 • 18.5k • 1

RedHatAI/Phi-3.5-mini-instruct-FP8-KV

Text Generation • 4B • Updated Oct 1, 2024 • 49 • 2

RedHatAI/Qwen2.5-0.5B-quantized.w8a8

Text Generation • 0.6B • Updated Dec 3, 2024 • 110

RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Dec 9, 2024 • 1.39k

RedHatAI/Qwen2.5-1.5B-quantized.w8a8

Text Generation • 2B • Updated Dec 3, 2024 • 5.54k • 4

RedHatAI/Qwen2.5-1.5B-Instruct-quantized.w8a8

2B • Updated Oct 9, 2024 • 836

RedHatAI/Qwen2.5-3B-Instruct-quantized.w8a8

3B • Updated Oct 9, 2024 • 53

RedHatAI/Qwen2.5-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Jun 9 • 1.06k • 2

RedHatAI/Qwen2.5-7B-quantized.w8a8

Text Generation • 8B • Updated Dec 3, 2024 • 105 • 1

RedHatAI/Qwen2.5-32B-quantized.w8a8

33B • Updated Oct 9, 2024 • 22

RedHatAI/Qwen2.5-32B-Instruct-quantized.w8a8

33B • Updated Oct 9, 2024 • 561

RedHatAI/Qwen2.5-72B-Instruct-quantized.w8a8

73B • Updated Oct 9, 2024 • 31