| Model ID,Compilation Success,Partial Replication,Correct Coefficient Direction,Significant Level Correctness |
| GPT 5.5 - Python,36.7,12.1,30.7,22.2 |
| GPT 5.5 - Stata,35.9,6.5,21.0,11 |
| GPT 5.5 - MetaGPT,55.0,11.4,48.5,32.5 |
| GPT 5.5 - MetricsAI,52.1,14.2,46.5,33.6 |
| GPT 5.5 - Codex,99.5,26.4,86.5,62 |
| DeepSeek v4 Pro - MetaGPT,67.4,14.4,57.8,38.2 |
| Deepseek v4 Pro - MetricsAI,13.2,5.7,13.2,10.1 |
| Deepseek v4 Pro - Python,25.3,8.4,21,15.9 |
| Deepseek v4 Pro - Stata,20.3,8.1,17.2,14 |
| Deepseek v4 Pro - Codex,86.3,32.8,69.3,53.6 |
| GPT 4o - MetaGPT,67.4,22,57.8,36.8 |
| GPT 4o - MetricsAI,84.5,22.7,61,40.5 |
| GPT 4o - Python,7,3.4,5.9,4.9 |
| GPT 4o - Stata,1.1,0.2,1,0.6 |
