Commit History

  1. using litellm - for now shuffle disabled

    4bb354c

  1. now using 4.1mini with temperature 1

    70f896f

  1. removed parameters from eval script

    2ddfbfe
  2. modified prompts for ask question and build personas - fixed temperature to 0 and model to 4.1 nano for testing

    a7fab3f

  1. fix on answers

    28d7d9e
  2. added function to save also users

    f217abb

  1. added variability in synth answers

    379848c
  2. modify n of fleet in test script

    d0d9c87
  3. complete eval flow ready

    5b9f598
  4. using direct embedding comparison

    598da24
  5. added pairwise approach

    516410c
  6. added eval script and data

    1a9b41f