Forge / src /inferenceClient.js

Commit History

switch default to llama-3.1-8b-instant
68d7f83

ausername-12345 commited on

switch to gemma2-9b-it; shorten system prompt to reduce token usage
b2bcacd

ausername-12345 commited on

remove function calling (unsupported by API proxy), use plain chat only
a281e3b

ausername-12345 commited on

switch default to llama-3.3-70b-versatile for better function calling support
d4d67c9

ausername-12345 commited on

default to llama-3.1-8b-instant; trim system prompt and tool descriptions to reduce token overhead
15036d1

ausername-12345 commited on

add built-in read_file/write_file/list_files tools; re-add tool_choice to API calls
c782f16

ausername-12345 commited on

use INFERENCE_API_URL as-is, no endpoint construction
3edcc9b

ausername-12345 commited on

fix endpoint construction when INFERENCE_API_URL already includes /gen/chat/completions
b6479e4

ausername-12345 commited on

add 503 fallback: retry without tools then fall back to Gen endpoint
56dbcd5

ausername-12345 commited on

fix default model to 'lightning' for InferencePort API compatibility
3ee7765

ausername-12345 commited on

add model dropdown and fix stuck thinking indicator
c3e18bc

ausername-12345 commited on

Initial commit - Forge: self-improving AI assistant with filesystem access for self-editing
4381a41

ausername-12345 commited on