Hugging Face's logo

aws-neuron
/
optimum-neuron-cache

Model card Files
xet
 Community
713
optimum-neuron-cache / inference-cache-config /mistral.json

Commit History

  1. Add more batch_size for mistral on smaller instances

    dacorvo HF Staff
    Verified signature
    545cd4d

  2. Update Mistral cached configurations

    dacorvo HF Staff
    Verified signature
    ee458f5

  1. Add Mistral-v2

    dacorvo HF Staff
    Verified signature
    20e585f

  1. Remove variants from main mistral config

    dacorvo HF Staff
    Verified signature
    ef07aca

  1. Added teknium/OpenHermes-2.5-Mistral-7B

    dacorvo HF Staff
    Verified signature
    1518247

  1. Create mistral.json

    philschmid
    Verified signature
    b5d0afd