Spaces:
Sleeping
Sleeping
Commit History
-
better management on system prompt
5f6306a -
add accelerate
5ed3cb3 -
usue chat pipeline instead of model and tokenizer individually
ac8e9cc -
bugfix to padding-related issues
f248fec -
add attention mask
b6b3940 -
Clean model description
4731160 -
pin torch to 2.4.0
4c6b4c5 -
add sentencepiece tokenzier
4afc958 -
update requirements
51e3e3c -
enable zerogpu with decorator
c5b2897 -
Apply ZeroGPU
d181b45 -
add apt.txt
5dd835a -
adjust requirements
e85692d -
adjust requirements.txt
931fd49 -
specify gpu build for llama cpp python
49a4dad -
Update README.md
Verified signatured6f7cc4 -
fix readme
c62b652 -
switch to gradio version for stability reason
a703203
-
add taiwan tinyllama
794ee70 -
Improve responsiveness by asynchronously retrieving web search context
- Run web search lookup in a background thread to decouple it from prompt construction. - Add a 2-second timeout using thread.join(timeout=2) to prevent delaying response generation. - Fallback to using only the system prompt and user query if web search results aren't retrieved in time. - Update sidebar UI to show the fetched context or a "No context found" message. - Retain current streaming and chat history functionalities for model inference.acda3f1 -
update requirements
\12731c2 -
specify wheel of llama cpp python
f200cb7 -
openblas build of llam acpp filed
66a3cb6 -
specify to build llama cpp with openblas
e883a1b -
add llama 3.2 taiwan 3b
b1544e2 -
add minicpm3 4b
f5c0811 -
increase xt length to max
629495e -
remove all moe
fafc8cb -
remove qwen 1.5 moe
6735035 -
adjust title style
e9559bd -
use another version of qwen 1.5 moe
96e60d6 -
add Qwen1.5-MoE
e17afaf -
Qwen2.5-MOE-6x1.5B
5eca666 -
remove under 3b models
617be26 -
Add model caching
d33dfcd -
UI/UX Improvement
eb215ff -
reset timeout timer once a new token is generated
35943b1
-
open web search settgins to user
c9fd924 -
add 2 more models
f7a541f -
apply new settings on duckduck search
d9421eb -
tune llama paramters
20484f3 -
increase max_chars_per_result to 600
1155897 -
increase max results to 6 for better web search
0c2fe1d -
increase ctx lenght to 2k
9ba47d1 -
increase timeout to 5min
71d28c5 -
Code simplification
248f5a7 -
Enable speculattive decoding
a7fdfe6 -
fix role disorder error in history
06a162a -
Add internet search feature
4e60755 -
fix reasonning model's thought process display
9d3ca6c