rr19tech commited on
Commit
8f660dd
·
verified ·
1 Parent(s): ff57a0a

Updated the AI section

Browse files
Files changed (1) hide show
  1. index.html +8 -1
index.html CHANGED
@@ -176,7 +176,14 @@
176
  -->
177
  <div id="AI-Studies" class="tab-content">
178
  <h4>AI Studies</h4>
179
- <p>AI experimental articles Coming soon..</p>
 
 
 
 
 
 
 
180
  </div>
181
  <!--
182
  <div id="Devotional" class="tab-content">
 
176
  -->
177
  <div id="AI-Studies" class="tab-content">
178
  <h4>AI Studies</h4>
179
+ <p>
180
+ AI experimental articles
181
+ To run AI models locally, we need a runtime engine (inference), decent machine, preferably with few gpu's to support and reasonable performance.
182
+ We used the following, Ollama, llama.cpp, mlx_lm etc to run few models like llama, gemma, phi to obtain decent performance.
183
+ We used openlit, pheonix as llm observability tools to evaluate the model performances.
184
+ We used nomic-embed, all-minilm like embedding models with chroma_db like vector database to test the RAG concepts
185
+ Detailed experiments and some interesting observations will be published soon ..
186
+ </p>
187
  </div>
188
  <!--
189
  <div id="Devotional" class="tab-content">