baseten/whisper_trt_large_v3_NVIDIA_H100_80GB_HBM3_0_12_0_dev2024071600
Updated
Inference Provider
VERIFIED
5,196,349 monthly requests
AI & ML interests
None defined yet.
baseten/whisper_trt_large_v3_NVIDIA_H100_80GB_HBM3_0_12_0_dev2024080600
Updated
baseten/whisper_trt_large_v2_NVIDIA_H100_80GB_HBM3_MIG_3g_40gb_0_12_0_dev2024071600
Updated
baseten/whisper_trt_medium_NVIDIA_H100_80GB_HBM3_MIG_3g_40gb_0_12_0_dev2024071600
Updated
baseten/whisper_trt_medium_en_NVIDIA_H100_80GB_HBM3_MIG_3g_40gb_0_12_0_dev2024071600
Updated
baseten/whisper_trt_large_v3_NVIDIA_H100_80GB_HBM3_MIG_3g_40gb_0_12_0_dev2024071600
Updated
baseten/whisper-small-weights-only-int8-optimimum-quanto
Updated
baseten/whisper-large-v2-weights-only-int8-optimum-quanto
Updated
baseten/llama-70b_fp8_tp2_i1024_o100_bs32-tllm_0.13.0.dev2024081300
Updated • 3
baseten/llama-70b_fp8_tp1_i1024_o100_bs16-tllm_0.13.0.dev2024081300
Updated • 7
baseten/llama-70b_fp8_tp1_i1024_o100_bs16-tllm_0.12.0.dev2024072301
Updated
baseten/llama3.1-70b-instruct_fp8_tp2_i3100_seq3300_bs64_kv-2ga0125d
Updated • 7
baseten/btest-Meta-Llama-3-8B-Instruct-A100-5fa9436e-TP2
Updated • 3
baseten/btest-Meta-Llama-3-8B-Instruct-A100-5fa9436e-TP1
Updated • 3
baseten/btest-Mistral-7B-Instruct-v0.2-A100-5fa9436e-TP2
Updated • 2
baseten/btest-Mistral-7B-Instruct-v0.2-A100-5fa9436e-TP1
Updated • 2
baseten/llama-70b_fp8_tp4_i1024_o100_bs32-tllm_0.12.0.dev2024072301
Updated • 6
baseten/llama-70b_fp8_tp2_i1024_o100_bs32-tllm_0.12.0.dev2024072301
Updated • 7
baseten/llama3.1-70b-instruct_fp8_tp4_i3000_o100_bs40_kvc-2ga0125d
Updated • 7
baseten/Meta-Llama-3-70B-H100-2ga0125d-TP4-FP8
Updated • 6
baseten/Llama-Guard-3-8b_i8190_o2_bs20_fp16_tp1-tllm_0.12.0.dev2024072301
Updated • 7
baseten/Meta-Llama-3.1-70B-H100-2ga0125d-TP4-FP8-64k-32TPB
Updated • 6
baseten/Meta-Llama-3.1-70B-H100-2ga0125d-TP4-FP8-7168-32TPB
Updated • 6
baseten/Meta-Llama-3.1-70B-H100-2ga0125d-TP4-FP8-7168
Updated • 7
baseten/Meta-Llama-3.1-70B-H100-2ga0125d-TP4-FP8
Updated • 6
baseten/btest-Meta-Llama-3.1-8B-A100-5fa9436e-TP1
Updated • 6
baseten/btest-bloom-560m-A100-5fa9436e-TP2
Updated • 3
baseten/btest-bloom-560m-A100-5fa9436e-TP1
Updated • 3
baseten/whisper-tllm-large-v3-int8-0.12.0.dev2024071600
Updated
baseten/btest-Mistral-7B-Instruct-v0.2-A100-2a115dae-TP2
Updated • 2