Model_Zoo / Dockerfile.simple

Commit History

  1. Switch to Qwen2.5-72B-Instruct with 4xL4 GPU tensor parallelism and NF4 quantization

    Prashanth Ramakrishna
    82e4ccc