Spaces:
Running
Running
Updated the AI section
Browse files- index.html +8 -1
index.html
CHANGED
|
@@ -176,7 +176,14 @@
|
|
| 176 |
-->
|
| 177 |
<div id="AI-Studies" class="tab-content">
|
| 178 |
<h4>AI Studies</h4>
|
| 179 |
-
<p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 180 |
</div>
|
| 181 |
<!--
|
| 182 |
<div id="Devotional" class="tab-content">
|
|
|
|
| 176 |
-->
|
| 177 |
<div id="AI-Studies" class="tab-content">
|
| 178 |
<h4>AI Studies</h4>
|
| 179 |
+
<p>
|
| 180 |
+
AI experimental articles
|
| 181 |
+
To run AI models locally, we need a runtime engine (inference), decent machine, preferably with few gpu's to support and reasonable performance.
|
| 182 |
+
We used the following, Ollama, llama.cpp, mlx_lm etc to run few models like llama, gemma, phi to obtain decent performance.
|
| 183 |
+
We used openlit, pheonix as llm observability tools to evaluate the model performances.
|
| 184 |
+
We used nomic-embed, all-minilm like embedding models with chroma_db like vector database to test the RAG concepts
|
| 185 |
+
Detailed experiments and some interesting observations will be published soon ..
|
| 186 |
+
</p>
|
| 187 |
</div>
|
| 188 |
<!--
|
| 189 |
<div id="Devotional" class="tab-content">
|