baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs32_bw5_int4
Updated
Inference Provider
VERIFIED
5,196,349 monthly requests
AI & ML interests
None defined yet.
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs16_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs16_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_A10G_i224_o512_bs16_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs16_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs16_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs8_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs8_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs8_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_A10G_i224_o512_bs8_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs8_bw5_int4
Updated
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs64_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs64_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A10G_i224_o512_bs32_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs64_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs32_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs32_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs32_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs32_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A10G_i224_o512_bs16_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs16_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs16_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs16_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs16_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_MIG_3g.40gb_i224_o512_bs8_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A10G_i224_o512_bs8_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs8_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_A100-SXM4-80GB_i224_o512_bs8_bw5_int8
Updated
baseten/whisper_trt_large-v3_NVIDIA_H100_80GB_HBM3_i224_o512_bs8_bw5_int8
Updated
baseten/llama3-70b-instruct_fp8_tp2_i7068_o1024_bs40_mnt_10000_mp_fmha_moae-tllm_0.11.0.dev2024061800
Updated • 6