Commit History

  1. refactor: remove duplicate regex

    Ilia Tambovtsev
    9541a9b

  1. ci: update default params

    Ilia Tambovtsev
    1a673ed

  1. feat: add option to copy collection contents to another collection

    Ilia Tambovtsev
    c1f9144
  2. fix: reimplement async things to be compatible with gradio

    Ilia Tambovtsev
    159a530

  1. fix: make async query storage call and use super()

    Ilia Tambovtsev
    683b3ae
  2. style: indent prompts

    Ilia Tambovtsev
    487514f

  1. feat: add more corner cases to regex

    Ilia Tambovtsev
    7a0766b
  2. feat: configure logging all params, move preprocessing to be a feature of a storage

    Ilia Tambovtsev
    dfee524
  3. feat: fix async eval to be really async

    Ilia Tambovtsev
    24e252a
  4. feat: configure cli and implement saving eval results to gsheets

    Ilia Tambovtsev
    364b978

  1. feat: configure benchmarking and add scorer pick to cli

    Ilia Tambovtsev
    3d1392a
  2. feat: implement testing preprocessing with gsheets

    Ilia Tambovtsev
    8c92162
  3. feat: add async support in evaluation. partially add uploading results to gsheets

    Ilia Tambovtsev
    16fd4fe

  1. feat: implement prompt preprocessing with regex

    Ilia Tambovtsev
    c7e0ef5
  2. feat: implement retrieval with llm reranking

    Ilia Tambovtsev
    e37d064

  1. refactor: delete unused file

    Ilia Tambovtsev
    d4b4f3a

  1. feat: TODO configure rag

    Ilia Tambovtsev
    9a9e3f7

  1. feat: add async pipelines

    Ilia Tambovtsev
    c413127

  1. feat: setup metrics. add llm relevance

    Ilia Tambovtsev
    934d3e0

  1. feat: implement model evaluation

    Ilia Tambovtsev
    1603571

  1. refactor: move ModelConfigs up

    Ilia Tambovtsev
    e00e21a

  1. feat: add scorers which are not weighted

    Ilia Tambovtsev
    d8b3813

  1. feat: add Scorers: exp, step, linear

    Ilia Tambovtsev
    0693054

  1. feat: implement scoring model. Add notebook with testing

    Ilia Tambovtsev
    07b053e

  1. feat: start working on scores

    Ilia Tambovtsev
    c459d77
  2. feat: simplify ui

    Ilia Tambovtsev
    0ed2f77

  1. feat: add gradio web app

    Ilia Tambovtsev
    43554ac
  2. feat: implement presentation search by queries

    Ilia Tambovtsev
    f7f521b

  1. feat: implement vector search with ChromaDB

    Ilia Tambovtsev
    4780497