Hugging Face's logo

aws-neuron
/
optimum-neuron-cache

Model card Files
xet
 Community
715
optimum-neuron-cache / inference-cache-config

Commit History

  1. Added teknium/OpenHermes-2.5-Mistral-7B

    dacorvo HF Staff
    Verified signature
    1518247

  2. Added Llama-70b batch_size 4 to inference cache

    dacorvo HF Staff
    Verified signature
    593822e

  1. Create mistral.json

    philschmid
    Verified signature
    b5d0afd

  2. Create gpt2.json

    philschmid
    Verified signature
    3bdb891

  3. Create inference-cache-config/llama.json

    philschmid
    Verified signature
    1960ccb