feat: Add scripts for launching models with vLLM, including dynamic GPU allocation and logging functionality for better monitoring and management of model processes.
refactor: Simplify model configuration by replacing dynamic GPU mapping with a static dictionary, and enhance bot response function to include a seed value for reproducibility in responses.
chore: Update GPU mapping for model launches by commenting out unused configurations and adjust GPU memory utilization to 0.3. Add additional dependencies to requirements.txt for enhanced functionality.
refactor: Update model GPU mapping to a list format for improved readability and adjust GPU memory utilization settings for better performance during model launches.
feat: Enable sharing option in demo launch for enhanced accessibility and collaboration.
elfsong
c5f04c0
refactor: Update model selection and local endpoint configuration for chatbot UI, adding support for multiple local endpoints and improving clarity in input handling.
elfsong
f0643ac
refactor: Simplify chatbot configuration by removing redundant parameters and consolidating feedback logging functionality.
elfsong
a236245
refactor: Clean up feedback logging code by removing unnecessary comments and ensuring consistent formatting.
elfsong
ff147bb
refactor: Change feedback logging from CSV to JSONL format for improved data handling and consistency.
elfsong
ce45729
feat: Enhance feedback logging by switching from CSV to JSONL format and adding support for user message liking in chatbot UI.
elfsong
57cac61
feat: Implement feedback saving functionality with CSV logging and automatic syncing for user interactions in chatbots.
elfsong
ab76d2a
refactor: Update bot_response function to restore input box availability and clear content for improved user interaction.
elfsong
6cd0f07
refactor: Enhance bot_response function by improving error handling, refining message construction, and ensuring consistent UI updates during streaming.
elfsong
417d37b
refactor: Improve message handling in bot_response function by streamlining history updates and enhancing user interaction during streaming.
elfsong
45e2ada
feat: Add support for local model endpoints and enhance bot_response function to handle local vs. remote inference clients.
elfsong
1f1385b
refactor: Update UI labels and text for improved clarity and consistency across chatbot models
elfsong
810081f
refactor: Enhance chatbot UI by updating comments, fixing clear logic, and ensuring message handling is consistent across models.
elfsong
fac1a49
refactor: Simplify bot_response function by improving message handling and UI updates for user interactions.
elfsong
2b717f1
Update
elfsong
c5dc144
feat: Refactor chatbot functionality to support multiple models and improve user interaction with a new input system.
elfsong
41ad8f7
chore: Remove `google/gemma-7b-it` from the list of available models.