Edit Models filters

Showing models from

Inference Optimization

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

497

Base only

Active filters: inference-optimization

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3

0.9B • Updated Mar 15 • 30

inference-optimization/Mistral3_speculator_dummy

2B • Updated Mar 17 • 24

inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0

2B • Updated Mar 17 • 32

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 17

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated May 20 • 16

inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic

15B • Updated Mar 17 • 17

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated May 20 • 26

inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8

5B • Updated Mar 18 • 10

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1

2B • Updated Mar 19 • 27

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0

0.5B • Updated Mar 23 • 30

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt5

0.5B • Updated Mar 23 • 34

inference-optimization/Qwen3-30B-from-Qwen3-235B_resps-speculators.eagle3-ckpt4

0.5B • Updated Mar 23 • 28

inference-optimization/llama3_8b_sharegpt_5k

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt0-speculator.eagle3

0.9B • Updated Mar 25 • 29

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt1-speculator.eagle3

0.9B • Updated Mar 25 • 28

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt3-speculator.eagle3

0.9B • Updated Mar 25 • 25

inference-optimization/gpt-oss-120b-from-self-ckpt0-speculator.eagle3

0.9B • Updated Mar 25 • 27

inference-optimization/gpt-oss-120b-from-self-ckpt4-speculator.eagle3

0.9B • Updated Mar 25 • 28

inference-optimization/gpt-oss-120b-from-self-ckpt5-speculator.eagle3

0.9B • Updated Mar 25 • 28

inference-optimization/Qwen3-Next-80B-A3B-Instruct-GSM8K-MTP-finetuned

81B • Updated Mar 25 • 25

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt3-speculator.eagle3

0.9B • Updated Mar 31 • 29

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt4-speculator.eagle3

0.9B • Updated Apr 1 • 26 • 1

inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3

0.9B • Updated Apr 1 • 27

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

1B • Updated Apr 7 • 580

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

3B • Updated Apr 7 • 17

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

2B • Updated Apr 20 • 9

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq

5B • Updated Apr 22 • 11

inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod

5B • Updated Apr 22 • 9

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod

2B • Updated Apr 22 • 12

inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq

2B • Updated Apr 22 • 9