SQL-Generation / test_pretrained.ipynb

Commit History

  1. Updated compare_result function to allow passing the cursor, also re-ran test_pretrained and test_rag with updated loss function

    23a14a5

  1. Fix bug on function evaluation

    cd9fee3

  1. Modify path to relative path

    5af7feb
  2. Add relative path functionality for colab

    aa43cb9
  3. colab support part two

    c397e97
  4. Add support for colab

    bfad6ce
  5. Add a source folder

    c1d6d12

  1. ran full testing with updated prompt, improves team and other_stats performance, slight drop on game performance

    32c1934
  2. trying to prompt engineer fixes for other_stats table

    7f1de95
  3. Adding completed pre-training testing runs to python notebook

    a30f35d
  4. Created evaluation loop for running on full dataframes

    9f2b199
  5. Updated evaluation function to give tolerance for slight floating point differences

    50a9093

  1. fixed issue with inconsistent formatting in training data

    7dc8863
  2. updating prompt to include team name and abbreviations

    f2c9e91
  3. Small tweaks to evaluation function

    506f5a9
  4. updating test pretrained script to evaluate model outputs

    ce9fc6c
  5. Renamed demo script and added initial pre-trained test python notebook

    4be750a