NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model 5 minutes ago

nm-testing/fp8_weight_only_tensor-e2e

nm-autobot updated a model 7 minutes ago

nm-testing/fp8_weight_only_channel-e2e

nm-autobot updated a model 8 minutes ago

nm-testing/fp8_static_per_tensor-e2e

View all activity

nm-testing 's models 566

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 6

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 10

nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama

1B • Updated Oct 9, 2024 • 8.33k

nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym

1B • Updated Oct 9, 2024 • 87

nm-testing/OLMoE-1B-7B-0924-Instruct-FP8

7B • Updated Oct 9, 2024 • 340

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8

16B • Updated Oct 9, 2024 • 8

nm-testing/tinyllama-w8a8-compressed

1B • Updated Oct 9, 2024 • 1.15k

nm-testing/tinyllama-w4a16-compressed

1B • Updated Oct 9, 2024 • 1.6k

nm-testing/tinyllama-fp8-dynamic-compressed

1B • Updated Oct 9, 2024 • 740

nm-testing/SmolLM-360M-Instruct-quantized.w4a16

0.4B • Updated Oct 9, 2024 • 2

nm-testing/SmolLM-135M-Instruct-quantized.w4a16

Text Generation • 0.2B • Updated Oct 9, 2024 • 11

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized

47B • Updated Oct 9, 2024 • 3

nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed

8B • Updated Oct 9, 2024 • 3

nm-testing/Phi-3-mini-128k-instruct-FP8

4B • Updated Oct 9, 2024 • 1.49k

nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized

47B • Updated Oct 9, 2024 • 5

nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

47B • Updated Oct 9, 2024 • 6

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized

47B • Updated Oct 9, 2024 • 92

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2-asym

Text Generation • 1B • Updated Oct 9, 2024 • 107

nm-testing/Qwen2-1.5B-Instruct-FP8W8

Text Generation • 2B • Updated Oct 9, 2024 • 6.38k

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-ACTORDER-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 12

nm-testing/Meta-llama3-8b-Instruct-quant-FP8

Text Generation • 8B • Updated Oct 9, 2024 • 3

nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8

Text Generation • 8B • Updated Oct 9, 2024 • 7

nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test

Text Generation • 8B • Updated Oct 9, 2024 • 40.6k

nm-testing/nonuniform

Text Generation • 8B • Updated Oct 9, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 4

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 30 • 2

nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V

Text Generation • 8B • Updated Oct 9, 2024 • 7

nm-testing/Qwen2-0.5B-Instruct

Text Generation • 0.6B • Updated Oct 9, 2024 • 11

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 19

nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos

Text Generation • 8B • Updated Oct 9, 2024 • 7