Red Hat AI

Enterprise

company

Verified

https://www.redhat.com/en/products/ai

RedHat_AI

RedHatOfficial

Activity Feed

AI & ML interests

OpenSource and AI

Recent Activity

dsikka updated a model 1 day ago

RedHatAI/Ripple-65B-Preview-NVFP4

dsikka published a model 1 day ago

RedHatAI/Ripple-65B-Preview-NVFP4

dsikka updated a collection 2 days ago

Speculator Models

View all activity

Papers

SNLP: Layer-Parallel Inference via Structured Newton Corrections

S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation

View all Papers

RedHatAI 's collections 26

Red Hat AI validated models - August 2026

August 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 33B • Updated Aug 13 • 115k • 60
RedHatAI/gemma-4-31B-it-FP8-dynamic

Image-Text-to-Text • 31B • Updated Aug 13 • 97k • 25
RedHatAI/gemma-4-31B-it-FP8-block

Image-Text-to-Text • 31B • Updated Aug 13 • 412k • 52
RedHatAI/gemma-4-31B-it

Image-Text-to-Text • 31B • Updated Aug 13 • 1.7k

Red Hat AI validated models - May 2026

May 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

Text Generation • 124B • Updated May 27 • 37
RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-FP8

Text Generation • 124B • Updated Apr 28 • 479 • 1
RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated Jun 16 • 617 • 2
RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

Image-Text-to-Text • 404B • Updated Jul 23 • 1.13k • 6

Red Hat AI validated models - February 2026

February 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Phi-4-reasoning-FP8-dynamic

Text Generation • 15B • Updated Apr 28 • 62 • 1
RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 4.08k • 15
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16

Text Generation • 12B • Updated Apr 28 • 402 • 4
RedHatAI/granite-4.0-h-tiny-FP8-dynamic

Text Generation • 7B • Updated Apr 28 • 409 • 3

AMD EPYC-compatible Models

amd/Mixtral-8x7B-Instruct-v0.1-w4a16-llmcompressor

Text Generation • 47B • Updated Aug 17 • 543
amd/Qwen3.6-35B-A3B-w8a8-llmcompressor

Text Generation • 35B • Updated Aug 10 • 450 • 1
amd/gemma-4-26B-A4B-it-w8a8-llmcompressor

Text Generation • 26B • Updated Sep 29 • 773
amd/Llama-3.1-8B-Instruct-w4a16-llmcompressor

Text Generation • 8B • Updated Aug 5 • 344

NVFP4 Models

RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-NVFP4

Text Generation • 14B • Updated Dec 4, 2025 • 71.6k • 11
RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 4.08k • 15
RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 604 • 4
RedHatAI/Qwen3-235B-A22B-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 215 • 3

Red Hat AI validated models - September 2025

September 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • 676B • Updated Apr 28 • 208 • 13
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 5.72k • 16
RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • 1T • Updated Apr 28 • 168 • 12
RedHatAI/gemma-3n-E4B-it-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 175 • 4

Red Hat AI validated models - May 2025

May 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Jun 9 • 4.8k • 32
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 109B • Updated Jun 9 • 16.9k • 13
RedHatAI/Llama-4-Scout-17B-16E-Instruct

Image-Text-to-Text • 109B • Updated Jun 9 • 20k
RedHatAI/Llama-4-Maverick-17B-128E-Instruct

Image-Text-to-Text • 402B • Updated Jun 9 • 53 • 3

Docling Models

ibm-granite/granite-docling-258M

Image-Text-to-Text • 0.3B • Updated Sep 23, 2025 • 126k • 1.29k
docling-project/docling-layout-heron

42.9M • Updated Feb 9 • 2.03M • 71
docling-project/docling-models

Updated Dec 3, 2025 • 1.45M • 234
docling-project/CodeFormulaV2

0.3B • Updated Aug 11, 2025 • 81k • 4

Gemma-3 Quantized

Collection of quantized Gemma 3 models created by Google.

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 29B • Updated Jun 9, 2025 • 12.3k • 13
RedHatAI/gemma-3-12b-it-quantized.w4a16

Image-Text-to-Text • 13B • Updated Jun 9, 2025 • 2.57k • 3
RedHatAI/gemma-3-4b-it-quantized.w4a16

Image-Text-to-Text • 5B • Updated Jun 9, 2025 • 1.53k • 5
RedHatAI/gemma-3-1b-it-quantized.w8a8

Text Generation • 1B • Updated Jun 6, 2025 • 750 • 2

Llama 4 Quantized

Quantized variants of the Llama 4 release by Meta.

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Jun 9 • 4.8k • 32
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 109B • Updated Jun 9 • 16.9k • 13
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated Jun 9 • 196 • 2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 405B • Updated Jun 12, 2025 • 11.2k • 1

Mistral-Small-3.1 (2503) Instruct Quantized

Quantized variants of Mistral Small 3.1 (2503) Instruct.

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • 24B • Updated Jun 30 • 14.8k • 10
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • 24B • Updated Aug 13 • 1.07k • 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 24B • Updated Aug 13 • 5.42k • 11

Llama 3.3 70B Instruct Quantized

Quantized variants of Meta Llama 3.3 multilingual large language model (LLM) is an instruction tuned generative model in 70B (text in/text out).

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Jun 9 • 837 • 14
RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 77k • 21
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 71B • Updated Aug 5 • 2.18k • 4

Granite Quantized

Quantized Granite models from IBM Research.

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • 8B • Updated Jun 9 • 245 • 2
RedHatAI/granite-3.1-2b-base-quantized.w8a8

Text Generation • 3B • Updated Feb 28, 2025 • 39
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • 8B • Updated Aug 5 • 890 • 1
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • 3B • Updated Feb 28, 2025 • 51

diffusiongemma-26B-A4B-it

Quantized verisons of google/diffusiongemma-26B-A4B-it

RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic

Image-Text-to-Text • 26B • Updated Aug 13 • 16.1k • 12
RedHatAI/diffusiongemma-26B-A4B-it-NVFP4

Image-Text-to-Text • 26B • Updated Aug 7 • 11.9k • 20

Red Hat AI validated models - March 2026

March 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 28 • 3.34k • 37
RedHatAI/MiniMax-M2.5

Text Generation • 229B • Updated Apr 28 • 34 • 2
RedHatAI/Ministral-3-3B-Instruct-2512

4B • Updated Apr 28 • 847 • 1
RedHatAI/Devstral-Small-2-24B-Instruct-2512

24B • Updated Apr 28 • 817

Red Hat AI validated models - January 2026

January 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Mistral-Large-3-675B-Instruct-2512

Updated Apr 28 • 1 • 1
RedHatAI/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8

Text Generation • 32B • Updated Apr 28 • 4.34k • 4
RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4

Updated Apr 28 • 12 • 3
RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 662 • 6

Intel Xeon-compatible Models

Additional models validated with Intel® Xeon® can be found on the INTEL catalog located here: https://swcatalog.intel.com/models?tags=Red+Hat

RedHatAI/embeddinggemma-300m

Sentence Similarity • 0.3B • Updated May 5 • 1.08k • 1
RedHatAI/Qwen3-Embedding-8B

Feature Extraction • 8B • Updated May 5 • 136 • 2
RedHatAI/nomic-embed-text-v1.5

Sentence Similarity • 0.1B • Updated May 5 • 187
RedHatAI/granite-embedding-english-r2

Feature Extraction • 0.1B • Updated May 5 • 503

Red Hat AI validated models - October 2025

October 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/gpt-oss-120b

Text Generation • 120B • Updated May 18 • 341 • 6
RedHatAI/gpt-oss-20b

Text Generation • 22B • Updated Jun 16 • 10.7k • 6
RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8

Text Generation • 480B • Updated Apr 28 • 163 • 3
RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 1.57k • 9

Speculator Models

RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3

Text Generation • 1.0B • Updated Apr 8 • 1.99k • 3
RedHatAI/Llama-3.3-70B-Instruct-speculator.eagle3

Text Generation • 2B • Updated Apr 8 • 401 • 2
RedHatAI/Qwen3-8B-speculator.eagle3

Text Generation • 1B • Updated Apr 8 • 41.4k • 29
RedHatAI/Qwen3-14B-speculator.eagle3

Text Generation • 1B • Updated Apr 8 • 601

Embedding Models

Embedding models act as the bridge between raw, unstructured data and the numerical, vector-based format needed for efficient retrieval in GenAI apps.

RedHatAI/embeddinggemma-300m

Sentence Similarity • 0.3B • Updated May 5 • 1.08k • 1
RedHatAI/Qwen3-Embedding-8B

Feature Extraction • 8B • Updated May 5 • 136 • 2
RedHatAI/nomic-embed-text-v1.5

Sentence Similarity • 0.1B • Updated May 5 • 187
RedHatAI/granite-embedding-english-r2

Feature Extraction • 0.1B • Updated May 5 • 503

IBM-Nasa Geospatial Models

IBM and NASA have teamed up to create a family of AI foundation models for Earth called Prithvi.

RedHatAI/Prithvi-EO-2.0-300M-TL-Sen1Floods11

Updated Feb 18 • 8
RedHatAI/Prithvi-EO-2.0-300M-BurnScars

Updated Feb 18 • 28

Whisper Quantized

Collection of quantized whisper models created by OpenAI

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 1.57k • 9
RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22, 2025 • 771 • 5
RedHatAI/whisper-large-v3-turbo-FP8-dynamic

Automatic Speech Recognition • 0.9B • Updated Apr 22, 2025 • 1.33k • 7
RedHatAI/whisper-tiny-FP8-Dynamic

Automatic Speech Recognition • 57.8M • Updated Apr 22, 2025 • 37

Qwen3 Quantized

Collection of quantized Qwen 3 models from Alibaba Cloud.

RedHatAI/Qwen3-4B-quantized.w4a16

Text Generation • 4B • Updated May 13, 2025 • 4.69k • 4
RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • 33B • Updated May 13, 2025 • 932 • 15
RedHatAI/Qwen3-0.6B-FP8-dynamic

Text Generation • 0.8B • Updated May 12, 2025 • 1.27k • 1
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 5.72k • 16

Phi-4 Quantized

Quantized variants of Phi-4 family of small language and multi-modal models by Microsoft.

RedHatAI/phi-4-quantized.w4a16

Text Generation • 15B • Updated Jun 9 • 880 • 6
RedHatAI/phi-4-FP8-dynamic

Text Generation • 15B • Updated Jun 9 • 15.3k • 3
RedHatAI/phi-4-quantized.w8a8

Text Generation • 15B • Updated Jun 9 • 1.3k • 5

Qwen 2.5 Quantized

Quantized variants of Qwen 2.5 Instruct and Qwen VL models

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • 8B • Updated Oct 2, 2025 • 13.7k • 9
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-Text-to-Text • 8B • Updated Apr 3, 2025 • 642 • 8
RedHatAI/Qwen2.5-7B-quantized.w8a8

Text Generation • 8B • Updated Dec 3, 2024 • 105 • 1
RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic

Image-Text-to-Text • 73B • Updated Apr 25, 2025 • 5.54k • 15

vLLM Kernels

Collection of kernels from vLLM built using https://github.com/huggingface/kernel-builder

RedHatAI/quantization

Updated Jul 27, 2025 • 7
RedHatAI/moe

Updated Jul 25, 2025 • 3

Red Hat AI validated models - August 2026

August 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/gemma-4-31B-it-NVFP4

Image-Text-to-Text • 33B • Updated Aug 13 • 115k • 60
RedHatAI/gemma-4-31B-it-FP8-dynamic

Image-Text-to-Text • 31B • Updated Aug 13 • 97k • 25
RedHatAI/gemma-4-31B-it-FP8-block

Image-Text-to-Text • 31B • Updated Aug 13 • 412k • 52
RedHatAI/gemma-4-31B-it

Image-Text-to-Text • 31B • Updated Aug 13 • 1.7k

diffusiongemma-26B-A4B-it

Quantized verisons of google/diffusiongemma-26B-A4B-it

RedHatAI/diffusiongemma-26B-A4B-it-FP8-dynamic

Image-Text-to-Text • 26B • Updated Aug 13 • 16.1k • 12
RedHatAI/diffusiongemma-26B-A4B-it-NVFP4

Image-Text-to-Text • 26B • Updated Aug 7 • 11.9k • 20

Red Hat AI validated models - May 2026

May 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

Text Generation • 124B • Updated May 27 • 37
RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-FP8

Text Generation • 124B • Updated Apr 28 • 479 • 1
RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4

Text Generation • 67B • Updated Jun 16 • 617 • 2
RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic

Image-Text-to-Text • 404B • Updated Jul 23 • 1.13k • 6

Red Hat AI validated models - March 2026

March 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Apr 28 • 3.34k • 37
RedHatAI/MiniMax-M2.5

Text Generation • 229B • Updated Apr 28 • 34 • 2
RedHatAI/Ministral-3-3B-Instruct-2512

4B • Updated Apr 28 • 847 • 1
RedHatAI/Devstral-Small-2-24B-Instruct-2512

24B • Updated Apr 28 • 817

Red Hat AI validated models - February 2026

February 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Phi-4-reasoning-FP8-dynamic

Text Generation • 15B • Updated Apr 28 • 62 • 1
RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 4.08k • 15
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16

Text Generation • 12B • Updated Apr 28 • 402 • 4
RedHatAI/granite-4.0-h-tiny-FP8-dynamic

Text Generation • 7B • Updated Apr 28 • 409 • 3

Red Hat AI validated models - January 2026

January 2026 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Mistral-Large-3-675B-Instruct-2512

Updated Apr 28 • 1 • 1
RedHatAI/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8

Text Generation • 32B • Updated Apr 28 • 4.34k • 4
RedHatAI/Mistral-Large-3-675B-Instruct-2512-NVFP4

Updated Apr 28 • 12 • 3
RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 662 • 6

AMD EPYC-compatible Models

amd/Mixtral-8x7B-Instruct-v0.1-w4a16-llmcompressor

Text Generation • 47B • Updated Aug 17 • 543
amd/Qwen3.6-35B-A3B-w8a8-llmcompressor

Text Generation • 35B • Updated Aug 10 • 450 • 1
amd/gemma-4-26B-A4B-it-w8a8-llmcompressor

Text Generation • 26B • Updated Sep 29 • 773
amd/Llama-3.1-8B-Instruct-w4a16-llmcompressor

Text Generation • 8B • Updated Aug 5 • 344

Intel Xeon-compatible Models

Additional models validated with Intel® Xeon® can be found on the INTEL catalog located here: https://swcatalog.intel.com/models?tags=Red+Hat

RedHatAI/embeddinggemma-300m

Sentence Similarity • 0.3B • Updated May 5 • 1.08k • 1
RedHatAI/Qwen3-Embedding-8B

Feature Extraction • 8B • Updated May 5 • 136 • 2
RedHatAI/nomic-embed-text-v1.5

Sentence Similarity • 0.1B • Updated May 5 • 187
RedHatAI/granite-embedding-english-r2

Feature Extraction • 0.1B • Updated May 5 • 503

NVFP4 Models

RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-NVFP4

Text Generation • 14B • Updated Dec 4, 2025 • 71.6k • 11
RedHatAI/Qwen3-VL-235B-A22B-Instruct-NVFP4

Text Generation • 133B • Updated Apr 28 • 4.08k • 15
RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 604 • 4
RedHatAI/Qwen3-235B-A22B-NVFP4

Text Generation • 136B • Updated Dec 4, 2025 • 215 • 3

Red Hat AI validated models - October 2025

October 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/gpt-oss-120b

Text Generation • 120B • Updated May 18 • 341 • 6
RedHatAI/gpt-oss-20b

Text Generation • 22B • Updated Jun 16 • 10.7k • 6
RedHatAI/Qwen3-Coder-480B-A35B-Instruct-FP8

Text Generation • 480B • Updated Apr 28 • 163 • 3
RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 1.57k • 9

Red Hat AI validated models - September 2025

September 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • 676B • Updated Apr 28 • 208 • 13
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 5.72k • 16
RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • 1T • Updated Apr 28 • 168 • 12
RedHatAI/gemma-3n-E4B-it-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 175 • 4

Speculator Models

RedHatAI/Llama-3.1-8B-Instruct-speculator.eagle3

Text Generation • 1.0B • Updated Apr 8 • 1.99k • 3
RedHatAI/Llama-3.3-70B-Instruct-speculator.eagle3

Text Generation • 2B • Updated Apr 8 • 401 • 2
RedHatAI/Qwen3-8B-speculator.eagle3

Text Generation • 1B • Updated Apr 8 • 41.4k • 29
RedHatAI/Qwen3-14B-speculator.eagle3

Text Generation • 1B • Updated Apr 8 • 601

Red Hat AI validated models - May 2025

May 2025 Collection of third-party generative AI models validated by Red Hat AI for use across the Red Hat AI Product Portfolio.

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Jun 9 • 4.8k • 32
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 109B • Updated Jun 9 • 16.9k • 13
RedHatAI/Llama-4-Scout-17B-16E-Instruct

Image-Text-to-Text • 109B • Updated Jun 9 • 20k
RedHatAI/Llama-4-Maverick-17B-128E-Instruct

Image-Text-to-Text • 402B • Updated Jun 9 • 53 • 3

Embedding Models

Embedding models act as the bridge between raw, unstructured data and the numerical, vector-based format needed for efficient retrieval in GenAI apps.

RedHatAI/embeddinggemma-300m

Sentence Similarity • 0.3B • Updated May 5 • 1.08k • 1
RedHatAI/Qwen3-Embedding-8B

Feature Extraction • 8B • Updated May 5 • 136 • 2
RedHatAI/nomic-embed-text-v1.5

Sentence Similarity • 0.1B • Updated May 5 • 187
RedHatAI/granite-embedding-english-r2

Feature Extraction • 0.1B • Updated May 5 • 503

Docling Models

ibm-granite/granite-docling-258M

Image-Text-to-Text • 0.3B • Updated Sep 23, 2025 • 126k • 1.29k
docling-project/docling-layout-heron

42.9M • Updated Feb 9 • 2.03M • 71
docling-project/docling-models

Updated Dec 3, 2025 • 1.45M • 234
docling-project/CodeFormulaV2

0.3B • Updated Aug 11, 2025 • 81k • 4

IBM-Nasa Geospatial Models

IBM and NASA have teamed up to create a family of AI foundation models for Earth called Prithvi.

RedHatAI/Prithvi-EO-2.0-300M-TL-Sen1Floods11

Updated Feb 18 • 8
RedHatAI/Prithvi-EO-2.0-300M-BurnScars

Updated Feb 18 • 28

Gemma-3 Quantized

Collection of quantized Gemma 3 models created by Google.

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 29B • Updated Jun 9, 2025 • 12.3k • 13
RedHatAI/gemma-3-12b-it-quantized.w4a16

Image-Text-to-Text • 13B • Updated Jun 9, 2025 • 2.57k • 3
RedHatAI/gemma-3-4b-it-quantized.w4a16

Image-Text-to-Text • 5B • Updated Jun 9, 2025 • 1.53k • 5
RedHatAI/gemma-3-1b-it-quantized.w8a8

Text Generation • 1B • Updated Jun 6, 2025 • 750 • 2

Whisper Quantized

Collection of quantized whisper models created by OpenAI

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.9B • Updated Apr 28 • 1.57k • 9
RedHatAI/whisper-large-v3-turbo-quantized.w8a8

Automatic Speech Recognition • 0.9B • Updated Apr 22, 2025 • 771 • 5
RedHatAI/whisper-large-v3-turbo-FP8-dynamic

Automatic Speech Recognition • 0.9B • Updated Apr 22, 2025 • 1.33k • 7
RedHatAI/whisper-tiny-FP8-Dynamic

Automatic Speech Recognition • 57.8M • Updated Apr 22, 2025 • 37

Llama 4 Quantized

Quantized variants of the Llama 4 release by Meta.

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • 109B • Updated Jun 9 • 4.8k • 32
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 109B • Updated Jun 9 • 16.9k • 13
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated Jun 9 • 196 • 2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16

Image-Text-to-Text • 405B • Updated Jun 12, 2025 • 11.2k • 1

Qwen3 Quantized

Collection of quantized Qwen 3 models from Alibaba Cloud.

RedHatAI/Qwen3-4B-quantized.w4a16

Text Generation • 4B • Updated May 13, 2025 • 4.69k • 4
RedHatAI/Qwen3-32B-FP8-dynamic

Text Generation • 33B • Updated May 13, 2025 • 932 • 15
RedHatAI/Qwen3-0.6B-FP8-dynamic

Text Generation • 0.8B • Updated May 12, 2025 • 1.27k • 1
RedHatAI/Qwen3-8B-FP8-dynamic

Text Generation • 8B • Updated Apr 28 • 5.72k • 16

Mistral-Small-3.1 (2503) Instruct Quantized

Quantized variants of Mistral Small 3.1 (2503) Instruct.

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • 24B • Updated Jun 30 • 14.8k • 10
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • 24B • Updated Aug 13 • 1.07k • 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 24B • Updated Aug 13 • 5.42k • 11

Phi-4 Quantized

Quantized variants of Phi-4 family of small language and multi-modal models by Microsoft.

RedHatAI/phi-4-quantized.w4a16

Text Generation • 15B • Updated Jun 9 • 880 • 6
RedHatAI/phi-4-FP8-dynamic

Text Generation • 15B • Updated Jun 9 • 15.3k • 3
RedHatAI/phi-4-quantized.w8a8

Text Generation • 15B • Updated Jun 9 • 1.3k • 5

Llama 3.3 70B Instruct Quantized

Quantized variants of Meta Llama 3.3 multilingual large language model (LLM) is an instruction tuned generative model in 70B (text in/text out).

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Jun 9 • 837 • 14
RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Jun 9 • 77k • 21
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 71B • Updated Aug 5 • 2.18k • 4

Qwen 2.5 Quantized

Quantized variants of Qwen 2.5 Instruct and Qwen VL models

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • 8B • Updated Oct 2, 2025 • 13.7k • 9
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-Text-to-Text • 8B • Updated Apr 3, 2025 • 642 • 8
RedHatAI/Qwen2.5-7B-quantized.w8a8

Text Generation • 8B • Updated Dec 3, 2024 • 105 • 1
RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic

Image-Text-to-Text • 73B • Updated Apr 25, 2025 • 5.54k • 15

Granite Quantized

Quantized Granite models from IBM Research.

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • 8B • Updated Jun 9 • 245 • 2
RedHatAI/granite-3.1-2b-base-quantized.w8a8

Text Generation • 3B • Updated Feb 28, 2025 • 39
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • 8B • Updated Aug 5 • 890 • 1
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • 3B • Updated Feb 28, 2025 • 51

vLLM Kernels

Collection of kernels from vLLM built using https://github.com/huggingface/kernel-builder

RedHatAI/quantization

Updated Jul 27, 2025 • 7
RedHatAI/moe

Updated Jul 25, 2025 • 3

AI & ML interests

Recent Activity

Papers

Team members 53

RedHatAI 's collections 26