med-bot / docs /project.md
chintu4's picture
Enhance project documentation with inference details
b66f013 unverified
|
Raw History Blame Contribute Delete
598 Bytes
This repo has :
- a rag project where openscience dataset is used for evaluation purpose.
- a vector_db is chucked and stored in google drive.
- a during infureces it uses the vector_db get all relvent chucks.
During inference :
- user query is sent to vector_db using cosine similarity search
- cosine similaritly search formula =( A.B) / (||A|| ||B||)
- In words Cosine similarity is the cosine of the angle between the vectors; that is, it is the dot product of the vectors divided by the product of their lengths.
- It is sent to llm for beautify things alot.
- It is much reliable process.