Spaces:

Phoenixak99
/

RAG-System-Demo

Running

App Files Files Community

RAG-System-Demo

24.2 MB

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

Phoenixak99's picture

Cap llama.cpp prompt threads (n_threads_batch) at the container's cores

25470c5 verified 1 day ago

sample_corpus
v2: cited answers with hybrid retrieval + cross-encoder rerank, Qwen3-1.7B on CPU, retrieval trace 1 day ago
src
Cap llama.cpp prompt threads (n_threads_batch) at the container's cores 1 day ago
wheels
Install llama.cpp from a prebuilt glibc wheel (compiling on the builder timed out) 1 day ago
.gitattributes

1.55 kB
Top 3 passages to the LLM: faster answers, citations 100% in eval 1 day ago
Dockerfile

1.42 kB
Install the llama.cpp wheel over HTTPS (builder checkout gave the LFS pointer) 1 day ago
README.md

1.24 kB
Docker SDK: compile llama.cpp for x86-64 + AVX2, bake models into the image 1 day ago
app.py

8.27 kB
v2: cited answers with hybrid retrieval + cross-encoder rerank, Qwen3-1.7B on CPU, retrieval trace 1 day ago
requirements.txt

223 Bytes
Docker SDK: compile llama.cpp for x86-64 + AVX2, bake models into the image 1 day ago
style.css

4.1 kB
v2: cited answers with hybrid retrieval + cross-encoder rerank, Qwen3-1.7B on CPU, retrieval trace 1 day ago