baseten/mixtral_i32000_o1024_bs6_A100_tp2-tllm_0.9.0.dev2024040200
Updated • 95
Inference Provider
VERIFIED
5,113,249 monthly requests
AI & ML interests
None defined yet.
baseten/mixtral_i8000_o8000_bs24_A100_tp2-tllm_0.9.0.dev2024040200
Updated • 3
baseten/mixtral_i32000_o1024_bs4_tp1_A100_int8_weights_only-tllm_0.9.0.dev2024040200
Updated • 98
baseten/mixtral_i8000_o8000_bs8_tp1_A100_int8_weights_only-tllm_0.9.0.dev2024040200
Updated • 6
baseten/mixtral_i8192_o1024_bs48_tp2_int8_weights_only-tllm_0.9.0.dev2024042000
Updated • 5
baseten/mixtral_i8192_o1024_bs48_tp2_int8_weights_only-tllm_0.9.0.dev2024022000
Updated • 6
baseten/mistral-7b-v0.1_i2048_o2048_bs4_fp16_tp1
Updated • 3
baseten/latent-health-mistral-7b-v0.1_i2048_o2048_bs4_fp16_tp1
Updated • 6
baseten/mixtral_i8000_o8000_bs8_tp1_H100_int8_weights_only-tllm_0.9.0.dev2024040200
Updated • 3
baseten/mixtral_i32000_o1024_bs4_tp1_H100_int8_weights_only-tllm_0.9.0.dev2024040200
Updated • 96
baseten/mixtral_i8000_o8000_bs24_H100_tp2-tllm_0.9.0.dev2024040200
Updated • 5
baseten/mixtral_i32000_o1024_bs6_H100_tp2-tllm_0.9.0.dev2024040200
Updated • 91
baseten/jackfram-llama68-H100-for-testing
Updated • 7
baseten/bloo-560m0-h100-basic-for-testing
Updated • 3
baseten/bloom-560m-a100-for-testing
Updated • 3
baseten/whisper-large-v3-TRT-L4-bs8-beam-5-int8-quantized
Updated
baseten/whisper-large-v3-TRT-L4-bs4-beam-5-int8-quantized
Updated
baseten/whisper-large-v3-TRT-H100-mig-bs8-beam-5
Updated
baseten/whisper-large-v3-TRT-L4-bs4-beam-5
Updated
baseten/whisper-large-v3-TRT-H100-bs8-beam-5
Updated
baseten/whisper-large-v3-TRT-H100-mig-bs4-beam-5
Updated
baseten/whisper-large-v3-TRT-H100-bs4-beam-5
Updated
baseten/whisper-large-v3-TRT-A100-bs8-beam-5
Updated
baseten/whisper-large-v3-TRT-A100-bs4-beam-5
Updated
baseten/sdxl-1.0-trt-8.6.1-1216x1152-h100
Updated
baseten/whisper-large-v3-TRT-L4-bs8-beam-5
Updated
baseten/vicuna_sd_20240404
Updated • 5
baseten/upstage-SOLAR-10.7B-v1.0_i2048_o512_bs48_fp16_tp2-tllm_0.9.0.dev2024022000
Updated • 8
baseten/upstage-SOLAR-10.7B-v1.0_i2048_o512_bs32_fp16_tp2-tllm_0.9.0.dev2024022000
Updated • 5
baseten/upstage-SOLAR-10.7B-v1.0_i2048_o512_bs32_fp8_tp2-tllm_0.9.0.dev2024022000
Updated • 7