โœจ About the SimpleChat Model Series

The SimpleChat series represents our new exploration into Non-Chain-of-Thought (Non-CoT) models. Its main features are:

  • Distinct Chat Style:

    • Designed to be concise, rational, and empathetic.
    • Specifically built for casual, everyday conversations.
  • Enhanced Creativity:

    • Boosts the creativity of its generated content and its capacity for emotional understanding.
    • This is achieved by distilling knowledge from advanced models, including K2.
  • Efficient Reasoning within a Non-CoT Framework:

    • Delivers the faster response times of a Non-CoT model while preserving strong reasoning skills.
    • It retains this ability because it was trained on CoT models before being transitioned to a Non-CoT framework, allowing it to think through complex problems.
  • Known Trade-off:

    • Compared to models that specialize in Chain-of-Thought, it may not perform as strongly on mathematical tasks.

OpenBuddy - Open Multilingual Chatbot

GitHub and Usage Guide: https://github.com/OpenBuddy/OpenBuddy

Website and Demo: https://openbuddy.ai

Evaluation result of this model: Evaluation.txt

Demo

Model Info

Context Length: 40K Tokens

License: Apache 2.0

Prompt Format

This model supports a Qwen3-like prompt format, with following system prompt recommended:

You(assistant) are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human(user).

Raw prompt template:

<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{history_input}<|im_end|>
<|im_start|>assistant
{history_output}<|im_end|>
<|im_start|>user
{current_input}<|im_end|>
<|im_start|>assistant

(There should be a \n at the end of prompt.)

You may want to use vllm to deploy an OpenAI-like API service. For more information, please refer to the vllm documentation.

Disclaimer

All OpenBuddy models have inherent limitations and may potentially produce outputs that are erroneous, harmful, offensive, or otherwise undesirable. Users should not use these models in critical or high-stakes situations that may lead to personal injury, property damage, or significant losses. Examples of such scenarios include, but are not limited to, the medical field, controlling software and hardware systems that may cause harm, and making important financial or legal decisions.

OpenBuddy is provided "as-is" without any warranty of any kind, either express or implied, including, but not limited to, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement. In no event shall the authors, contributors, or copyright holders be liable for any claim, damages, or other liabilities, whether in an action of contract, tort, or otherwise, arising from, out of, or in connection with the software or the use or other dealings in the software.

By using OpenBuddy, you agree to these terms and conditions, and acknowledge that you understand the potential risks associated with its use. You also agree to indemnify and hold harmless the authors, contributors, and copyright holders from any claims, damages, or liabilities arising from your use of OpenBuddy.

ๅ…่ดฃๅฃฐๆ˜Ž

ๆ‰€ๆœ‰OpenBuddyๆจกๅž‹ๅ‡ๅญ˜ๅœจๅ›บๆœ‰็š„ๅฑ€้™ๆ€ง๏ผŒๅฏ่ƒฝไบง็”Ÿ้”™่ฏฏ็š„ใ€ๆœ‰ๅฎณ็š„ใ€ๅ†’็Šฏๆ€ง็š„ๆˆ–ๅ…ถไป–ไธ่‰ฏ็š„่พ“ๅ‡บใ€‚็”จๆˆทๅœจๅ…ณ้”ฎๆˆ–้ซ˜้ฃŽ้™ฉๅœบๆ™ฏไธญๅบ”่ฐจๆ…Ž่กŒไบ‹๏ผŒไธ่ฆไฝฟ็”จ่ฟ™ไบ›ๆจกๅž‹๏ผŒไปฅๅ…ๅฏผ่‡ดไบบ่บซไผคๅฎณใ€่ดขไบงๆŸๅคฑๆˆ–้‡ๅคงๆŸๅคฑใ€‚ๆญค็ฑปๅœบๆ™ฏ็š„ไพ‹ๅญๅŒ…ๆ‹ฌไฝ†ไธ้™ไบŽๅŒป็–—้ข†ๅŸŸใ€ๅฏ่ƒฝๅฏผ่‡ดไผคๅฎณ็š„่ฝฏ็กฌไปถ็ณป็ปŸ็š„ๆŽงๅˆถไปฅๅŠ่ฟ›่กŒ้‡่ฆ็š„่ดขๅŠกๆˆ–ๆณ•ๅพ‹ๅ†ณ็ญ–ใ€‚

OpenBuddyๆŒ‰โ€œๅŽŸๆ ทโ€ๆไพ›๏ผŒไธ้™„ๅธฆไปปไฝ•็ง็ฑป็š„ๆ˜Ž็คบๆˆ–ๆš—็คบ็š„ไฟ่ฏ๏ผŒๅŒ…ๆ‹ฌไฝ†ไธ้™ไบŽ้€‚้”€ๆ€งใ€็‰นๅฎš็›ฎ็š„็š„้€‚็”จๆ€งๅ’Œ้žไพตๆƒ็š„ๆš—็คบไฟ่ฏใ€‚ๅœจไปปไฝ•ๆƒ…ๅ†ตไธ‹๏ผŒไฝœ่€…ใ€่ดก็Œฎ่€…ๆˆ–็‰ˆๆƒๆ‰€ๆœ‰่€…ๅ‡ไธๅฏนๅ› ่ฝฏไปถๆˆ–ไฝฟ็”จๆˆ–ๅ…ถไป–่ฝฏไปถไบคๆ˜“่€Œไบง็”Ÿ็š„ไปปไฝ•็ดข่ต”ใ€ๆŸๅฎณ่ต”ๅฟๆˆ–ๅ…ถไป–่ดฃไปป๏ผˆๆ— ่ฎบๆ˜ฏๅˆๅŒใ€ไพตๆƒ่ฟ˜ๆ˜ฏๅ…ถไป–ๅŽŸๅ› ๏ผ‰ๆ‰ฟๆ‹…่ดฃไปปใ€‚

ไฝฟ็”จOpenBuddyๅณ่กจ็คบๆ‚จๅŒๆ„่ฟ™ไบ›ๆกๆฌพๅ’Œๆกไปถ๏ผŒๅนถๆ‰ฟ่ฎคๆ‚จไบ†่งฃๅ…ถไฝฟ็”จๅฏ่ƒฝๅธฆๆฅ็š„ๆฝœๅœจ้ฃŽ้™ฉใ€‚ๆ‚จ่ฟ˜ๅŒๆ„่ต”ๅฟๅนถไฝฟไฝœ่€…ใ€่ดก็Œฎ่€…ๅ’Œ็‰ˆๆƒๆ‰€ๆœ‰่€…ๅ…ๅ—ๅ› ๆ‚จไฝฟ็”จOpenBuddy่€Œไบง็”Ÿ็š„ไปปไฝ•็ดข่ต”ใ€ๆŸๅฎณ่ต”ๅฟๆˆ–่ดฃไปป็š„ๅฝฑๅ“ใ€‚

Downloads last month
218
GGUF
Model size
31B params
Architecture
qwen3moe
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for gabriellarson/SimpleChat-30BA3B-V2-GGUF