Commit History
-
[Community Submission] Model: Qwen/Qwen2.5-Coder-32B-Instruct, Username: ylfeng (#87) Running
Verified signature- [Community Submission] Model: Qwen/Qwen2.5-Coder-32B-Instruct, Username: ylfeng (4c2f3bd76b2c57476ebe560aa3082f920727d6cc) - [Community Submission] Model: Qwen/Qwen2.5-Coder-32B-Instruct, Username: ylfeng (66e0f7bcae96061909e100addda08c94fc581183) - update table (7489843c9bb5f5be50a1e2b987dee9ff3d5abd28) Co-authored-by: Feng YunLong <ylfeng@users.noreply.huggingface.co>985e474 -
[Community Submission] Model: Qwen/Qwen2.5-Coder-32B, Username: ylfeng (#88)
Verified signature- [Community Submission] Model: Qwen/Qwen2.5-Coder-32B, Username: ylfeng (8a9eaff0f71942a7b497ee4b1f85253e68dd83ad) - [Community Submission] Model: Qwen/Qwen2.5-Coder-32B, Username: ylfeng (4d739238e469404817f5b203af2de9f1db1f9608) - update table (54c205d76157fe8d9e9e42b6a807b6316103b613) - update table (9d006b31a18ef9c5807593ef2c3a9d2e302f9170) Co-authored-by: Feng YunLong <ylfeng@users.noreply.huggingface.co>7912326
-
[Community Submission] Model: Artigenz/Artigenz-Coder-DS-6.7B, Username: nikita1503 (#66)
Verified signature- Community Submission] Model: Artigenz/Artigenz-Coder-DS-6.7B, Username: nikita1503 (5ff4bccf918c944c2cb1b477486152403e8a1786) - Community Submission] Model: Artigenz/Artigenz-Coder-DS-6.7B, Username: nikita1503 (1958d0892761d12b1af6791cee854265e133911b) - add model (8f1a897d625bbc338df90b3dd8b939b4974a8e74) - add model (3580ac58ebcfaa93399b3f4c65c956b86dd3b900) - fix scores (b146c32d4c2bc258efc5c2f8835e78903258da51) - fix conflict (b76bf4b5ec08f2d4bed2d2b816a20524ae7e0a43) - small fixes (734a997743d956d72a03bbbbdf890cd13322708e) Co-authored-by: Nikita Agarwal <nikita1503@users.noreply.huggingface.co>705601b -
[Community Submission] Model: NTQAI/Nxcode-CQ-7B-orpo, Username: nhanv (#68)
Verified signature- [Community Submission] Model: NTQAI/Nxcode-CQ-7B-orpo, Username: nhanv (c4ce767dcb81d4835f2cda420b46cca41f9858d6) - add model (aecc852b886b96ec56066b058f11a0c7a39f0327)a3c5876
-
add codeqwen
d242132
-
add codegemma
c99e6b7
-
[Community Submission] Model: m-a-p/OpenCodeInterpreter-DS-6.7B, Username: Anitaliu98 (#61)
Verified signature- Add results of OpenCodeInterpreter-DS-6.7B (e95e12e199d4dd11589e9c1019adde306c024a23) - Add results of OpenCodeInterpreter-DS-6.7B (1f4667e875fd17d7e830d954324530eacd65d606) - rebase and add OpenCodeInterpreter-DS-6.7B (fbb96f14a4bba760ea332e12211fafa08af4942c) - rebase and add OpenCodeInterpreter-DS-6.7B (45a006eceba88c00a220557f973534cf8fbfae61) - fix conflict (46d2b98ff793d3bd49c1705b59dbd157e00fcd8a) - Merge commit 'refs/pr/61' of https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard into pr/61 (b5a63bc1b21dbe057f91ba72710b6ab93ce2b395) Co-authored-by: leo-c <leo-c@users.noreply.huggingface.co>b2c4485 -
[Community Submission] Model: m-a-p/OpenCodeInterpreter-DS-33B, Username: Anitaliu98 (#60)
Verified signature- Add results for m-a-p/OpenCodeInterpreter-DS-33B (40e95c69421154a516b1ab92c458648adef7d0c1) - add opencodeinterpreter-33B (dc35e9b352bc5b791f089fda34bc7d1e94dd74b8) Co-authored-by: leo-c <leo-c@users.noreply.huggingface.co>cb2e5cf
-
Add StarCoder2 models (#59)
Verified signature- add models (b18b44c79fe1fb9472ec0eeb34291bff90c12895)0131ab9 -
fix label stablecode (#58)
Verified signature- fix label stablecode (ce81028193772c974e1d2b5a5c051d6479dd072e) - Update src/build.py (67b00b1fa941875f81d2415ab93ae737c0d6496d) - Update src/utils.py (cadeeba54d086edb886cf9567dfa4ade9e257a69) - Update src/utils.py (fe7ef307f07aef3226ea3a66a225e6c769f5b6ae) - Update data/code_eval_board.csv (8568a5884ab51ab09aa70da7d65ed08ce2b498f8) - Update data/raw_scores.csv (9bca29bb2a9e7562b52e8cb64fcf5c523e4f7a38)48c5fca -
[Community Submission] Model: stabilityai/stable-code-3b, Username: nikhilpinnaparaju (#57)
Verified signature- stabilityai_stable-code-3b/ model evals (233ce7e9ff9d42a0046ce11867aa5ddb75987a59) - add stablecode3b (a1008972c673fbbfb706c1dd16af7f4a774c5a8d)fd73f25
-
fix links
c946bf3 -
fix codellama 70b score (#54)
Verified signature- Update data/code_eval_board.csv (711662c34b5e8f3fb649319d4c9f20a7a3d553fa) - Update data/raw_scores.csv (cf0b3552112ca1a092a75157b9dea5bc285fed7f) - update table (3819949615c2f347c503fbb810f61cf5f360450f)aaaa8f8 -
Add Codellama-70B models (#53)
Verified signature- add codellama (0f08706258d701d8252a37c1d1e48e185132272d) - update warning (9849c2aa36daf2dc1805aa13a1ae49a3877d1e35)9f345b9 -
[Community Submission] Model: codefuse-ai/CodeFuse-DeepSeek-33B, Username: codefuse-admin (#51)
Verified signature- add json file (ae72fb2d7b79a4a862d123adea14928f173e17f5) - add codefuse to the leaderboard (fb3a36264b1aac2c2a41f77cfdff8cee872ddaeb) - Fix: use humaneval-{lang}-reworded.jsonl files for MultiPL-E instead of humaneval-{lang}-keep.jsonl files (e54d5a19705fce2c83d3a5fd1763885f0c8b5e99) - add codefuse and rename Models Model (b9e9b1e57e890c725edf40e5872ab4c652521eb8)c47d747
-
[Community Submission] Model: deepseek-ai/deepseek-coder-33b-instruct, Username: zqh11 (#42)
- add results (4cdb7c69642ec62ab6bcb51b2bccdbd7081cfdb1) - add results (318a86c867973d1b586134186f5408d82ba71df3) - add deepseek (2adaac0daa8350f638f89f2b3ba4d6eeae19c85f) - Merge commit 'refs/pr/42' of https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard into pr/42 (5b35e2eb47510f5b57b0f587d080d3ac4abb14cb) Co-authored-by: zhuqihao <zqh11@users.noreply.huggingface.co>5b90223 -
[Community Submission] Model: deepseek-ai/deepseek-coder-6.7b-instruct, Username: zqh11 (#43)
- add result (434130833708c344ccb92a2d56ced98d83e21997) - add deepseek 7b instruct (23c066610075078a7ee2f0ecfb0e56604eb49c90) Co-authored-by: zhuqihao <zqh11@users.noreply.huggingface.co>118d3e1
-
[Community Submission] Model: deepseek-ai/deepseek-coder-33b-base, Username: zqh11 (#31)
- add files (94f0638415ee7284b0a4af129d72141474250fa5) - Merge branch 'main' of https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard into pr/31 (4f27f295f1a9780f868bfe3047611fe2fcb4aa02) - add 33b deepseekcoder (3ef6f827290d45d3acdefa05e9f75fb1e8611106) Co-authored-by: zhuqihao <zqh11@users.noreply.huggingface.co>08e5a25 -
[Community Submission] Model: deepseek-ai/deepseek-coder-6.7b-base, Username: zqh11 (#32)
- add files (44f574976415881e434bda97489b684bf896356d) - change name (60a6811ebbdea326232117137d2d147ff8df79d1) - add deepseekcoder 7b (3e099f4e90bd79905130085a2eaf9d8516337792) - fix conflicts (83eb3f68c7e7132fe5ba113a5d96f6e45c6afec8) - fix conflicts (6b848b9d8b9d781558dae0030dc33f7931977eba) Co-authored-by: zhuqihao <zqh11@users.noreply.huggingface.co>e3e355a -
[Community Submission] Model: deepseek-ai/deepseek-coder-1.3b-base, Username: zqh11 (#33)
- add files (ec5443222731501685b24e92f0e593669d11cf14) - add deepseekcoder 1b (2548166a3ff267e52914340a45cfc90e26d5fcea) Co-authored-by: zhuqihao <zqh11@users.noreply.huggingface.co>6b3d762
-
[Community Submission] Model: WisdomShell/CodeShell, Username: ruixie (#16)
- [Community Submission] Model: WisdomShell/CodeShell, Username: ruixie (6b64b337b218740745b7430ca10ee656006222b6) - update (b2c5d158f3b034b325614adfad607b5d7c9d93c4) - update (a171962630967c9e1ffaf493cccc6d0c2619d0a0) - add codeshell submission (b6620ed972acaf877d31190c05c4b16ade781582) Co-authored-by: ruixie <ruixie@users.noreply.huggingface.co>6df95f1
-
add phi-1
e056b5e -
add languages for refact model
93e0250 -
add refact ai model
f55aa6a
-
add languages count for falcon
4075ec4 -
add falcon
d775509
-
fill readme with new models
886a109 -
add phind and wizardcoder models
4afa91d
-
add codellama models
13ff3a0
-
add decicoder
4a498d2
-
fix bug missing langs and use instruct values of humaneval
bd5abdb -
add octocoder and octogeex
2f02c91
-
use unknown for missing language
4d7067e -
add stablecode
b9d3833
-
remove newhope, model withdrawn by authors due to data leakage
f7e1e97 -
remove newhope, model withdrawn by authors due to data leakage
fd33e40 -
add newhope
553c92c
-
update data
356f605 -
move data
4f3ca33