Hugging Face's logo

aws-neuron
/
optimum-neuron-cache

Model card Files
xet
 Community
711
optimum-neuron-cache / inference-cache-config

Commit History

  1. Add DeepSeek distilled versions of LLama 8B

    dacorvo HF Staff
    Verified signature
    509e6bf

  2. Add DeepSeek distilled model

    dacorvo HF Staff
    Verified signature
    4d1e615

  1. Update inference-cache-config/qwen2.5-large.json

    dacorvo HF Staff
    Verified signature
    84982b8

  2. Add DeepSeek distilled models

    dacorvo HF Staff
    Verified signature
    f4f3dcd

  1. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    01e1fe9

  2. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    7191bac

  1. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    6b536dc

  1. Add configuration for granite models

    dacorvo HF Staff
    Verified signature
    687da09

  1. Rename inference-cache-config/qwen-2.5-large.json to inference-cache-config/qwen2.5-large.json

    dacorvo HF Staff
    Verified signature
    2aa52ac

  2. Create qwen-2.5-large.json

    dacorvo HF Staff
    Verified signature
    a8df9db

  3. Rename inference-cache-config/qwen2.5 to inference-cache-config/qwen2.5.json

    dacorvo HF Staff
    Verified signature
    b9f1fde

  4. Add qwen2.5 config for models up to 14B params

    dacorvo HF Staff
    Verified signature
    4e25bb0

  1. Remove obsolete mistral variants

    dacorvo HF Staff
    Verified signature
    e60c569

  2. Remove obsolete llama variants

    dacorvo HF Staff
    Verified signature
    eee32f0

  1. Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    563ba38

  2. Update inference-cache-config/Llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    7b0370b

  3. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    8ea3b57

  1. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    d05f579

  2. Rename inference-cache-config/Llama3.1-70B.json to inference-cache-config/Llama3.1-70b.json

    dacorvo HF Staff
    Verified signature
    a92cfe3

  3. Update inference-cache-config/mixtral.json

    dacorvo HF Staff
    Verified signature
    7342c16

  4. Rename inference-cache-config/Llama-3.1-70B.json to inference-cache-config/Llama3.1-70B.json

    dacorvo HF Staff
    Verified signature
    b41e94c

  5. Create Llama-3.1-70B.json

    dacorvo HF Staff
    Verified signature
    b1279f9

  6. Delete inference-cache-config/llama3-8b.json

    dacorvo HF Staff
    Verified signature
    5b0b2de

  7. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    0548cd2

  8. Delete inference-cache-config/llama2-7b-13b.json

    dacorvo HF Staff
    Verified signature
    219c5fd

  9. Update inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    afb9fe6

  10. Rename inference-cache-config/llama-3.1-8B.json to inference-cache-config/llama.json

    dacorvo HF Staff
    Verified signature
    14844a0

  11. Update inference-cache-config/mistral.json

    dacorvo HF Staff
    Verified signature
    6c4c814

  12. Create llama-3.1-8B.json

    dacorvo HF Staff
    Verified signature
    320841a

  13. Update inference-cache-config/llama3-8b.json

    dacorvo HF Staff
    Verified signature
    de9e259

  14. Update inference-cache-config/llama3-70b.json

    dacorvo HF Staff
    Verified signature
    5694f75

  1. Update inference-cache-config/stable-diffusion.json

    Jingya HF Staff
    Verified signature
    5272eb2

  1. Temporarily remove SD 1.5 from Runway⁠

    Jingya HF Staff
    Verified signature
    a74d412

  1. Update inference-cache-config/llama-variants.json

    dacorvo HF Staff
    Verified signature
    e7179a3

  2. Rename inference-cache-config/llama2.json to inference-cache-config/llama2-7b-13b.json

    dacorvo HF Staff
    Verified signature
    be28bda

  3. Create llama2-70b.json

    dacorvo HF Staff
    Verified signature
    6fe6ee4

  4. Rename inference-cache-config/llama3.json to inference-cache-config/llama3-8b.json

    dacorvo HF Staff
    Verified signature
    06bc70d

  5. Create llama3-70b.json

    dacorvo HF Staff
    Verified signature
    2695ea9

  1. Create mixtral.json

    dacorvo HF Staff
    Verified signature
    57652e6

  1. Add more batch_size for mistral on smaller instances

    dacorvo HF Staff
    Verified signature
    545cd4d

  2. Update Mistral cached configurations

    dacorvo HF Staff
    Verified signature
    ee458f5

  1. Use princeton-nlp/Sheared-LLaMA-1.3B as a test model

    dacorvo HF Staff
    Verified signature
    695b341

  1. Remove llama2 7B config for 24 cores

    dacorvo HF Staff
    Verified signature
    17e7257

  1. Update inference-cache-config/llama3.json⁠

    dacorvo HF Staff
    Verified signature
    5d8c4f2

  1. Update inference-cache-config/llama3.json

    dacorvo HF Staff
    Verified signature
    f5aae68

  1. Create llama3.json

    dacorvo HF Staff
    Verified signature
    f93cadb

  2. Rename inference-cache-config/llama.json to inference-cache-config/llama2.json

    dacorvo HF Staff
    Verified signature
    f06a55a

  1. Add more gpt2 configurations

    dacorvo HF Staff
    Verified signature
    3fbf810

  2. Add more llama config

    dacorvo HF Staff
    Verified signature
    2d87237

  3. Add Mistral-v2

    dacorvo HF Staff
    Verified signature
    20e585f