How to use pharaouk/mistral_coder_1 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("pharaouk/mistral_coder_1", device_map="auto")
Mistral Coder 1
Humaneval {'pass@1': 0.3896341463414634, 'pass@10': 0.39634146341463417}
Avg 0.7115
