Text Generation
Transformers
Safetensors
GGUF
stablelm
HelpingAI
Emotionally Intelligent
EQ
flash
conversational
Instructions to use OEvortex/HelpingAI-flash with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OEvortex/HelpingAI-flash with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="OEvortex/HelpingAI-flash") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI-flash") model = AutoModelForCausalLM.from_pretrained("OEvortex/HelpingAI-flash", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use OEvortex/HelpingAI-flash with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf OEvortex/HelpingAI-flash:Q4_K_M # Run inference directly in the terminal: llama cli -hf OEvortex/HelpingAI-flash:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf OEvortex/HelpingAI-flash:Q4_K_M # Run inference directly in the terminal: llama cli -hf OEvortex/HelpingAI-flash:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf OEvortex/HelpingAI-flash:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf OEvortex/HelpingAI-flash:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf OEvortex/HelpingAI-flash:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf OEvortex/HelpingAI-flash:Q4_K_M
Use Docker
docker model run hf.co/OEvortex/HelpingAI-flash:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use OEvortex/HelpingAI-flash with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "OEvortex/HelpingAI-flash" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/HelpingAI-flash", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/OEvortex/HelpingAI-flash:Q4_K_M
- SGLang
How to use OEvortex/HelpingAI-flash with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "OEvortex/HelpingAI-flash" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/HelpingAI-flash", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "OEvortex/HelpingAI-flash" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OEvortex/HelpingAI-flash", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use OEvortex/HelpingAI-flash with Ollama:
ollama run hf.co/OEvortex/HelpingAI-flash:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use OEvortex/HelpingAI-flash with Docker Model Runner:
docker model run hf.co/OEvortex/HelpingAI-flash:Q4_K_M
- Lemonade
How to use OEvortex/HelpingAI-flash with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull OEvortex/HelpingAI-flash:Q4_K_M
Run and chat with the model
lemonade run user.HelpingAI-flash-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,7 @@ HelpingAI-flash builds upon the HelpingAI series and incorporates:
|
|
| 35 |
- Integration of knowledge from psychological resources on emotional intelligence
|
| 36 |
|
| 37 |
## Emotional Quotient (EQ)
|
| 38 |
-
HelpingAI-flash boasts an impressive Emotional Quotient (EQ) score of
|
| 39 |
|
| 40 |

|
| 41 |
|
|
@@ -91,7 +91,7 @@ from webscout.Local.samplers import SamplerSettings
|
|
| 91 |
|
| 92 |
# 1. Download the model
|
| 93 |
repo_id = "OEvortex/HelpingAI-flash"
|
| 94 |
-
filename = "helpingai-flash-
|
| 95 |
model_path = download_model(repo_id, filename, token='') # Replace with your Hugging Face token if needed
|
| 96 |
|
| 97 |
# 2. Load the model
|
|
@@ -115,21 +115,21 @@ thread.interact(header="π HelpingAI-flash: Emotionally Intelligent Conversati
|
|
| 115 |
```
|
| 116 |
|
| 117 |
## Example Dialogue
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 118 |
> I'm feeling a bit overwhelmed with work and could use some encouragement.
|
| 119 |
|
| 120 |
-
|
| 121 |
|
| 122 |
> I just had a really great day and wanted to share my happiness.
|
| 123 |
|
| 124 |
-
|
| 125 |
|
| 126 |
-
> Iβm
|
| 127 |
|
| 128 |
-
|
| 129 |
-
1. **Prepare in Advance:** Plan and prepare for the event as much as possible. This can help you feel more confident and in control.
|
| 130 |
-
2. **Practice Deep Breathing:** Deep breathing exercises can help calm your mind and body. Try taking slow, deep breaths to center yourself.
|
| 131 |
-
3. **Focus on the Positive:** Remind yourself of the positive aspects of the event and what youβre looking forward to.
|
| 132 |
-
4. **Stay Present:** Try to stay in the present moment and avoid overthinking or dwelling on potential outcomes.
|
| 133 |
-
5. **Talk to Someone:** Sharing your feelings with a friend or family member can provide support and reassurance.
|
| 134 |
|
| 135 |
-
|
|
|
|
| 35 |
- Integration of knowledge from psychological resources on emotional intelligence
|
| 36 |
|
| 37 |
## Emotional Quotient (EQ)
|
| 38 |
+
HelpingAI-flash boasts an impressive Emotional Quotient (EQ) score of , highlighting its superior capability to understand and respond to human emotions in a caring and supportive manner.
|
| 39 |
|
| 40 |

|
| 41 |
|
|
|
|
| 91 |
|
| 92 |
# 1. Download the model
|
| 93 |
repo_id = "OEvortex/HelpingAI-flash"
|
| 94 |
+
filename = "helpingai-flash-q4_k_m.gguf"
|
| 95 |
model_path = download_model(repo_id, filename, token='') # Replace with your Hugging Face token if needed
|
| 96 |
|
| 97 |
# 2. Load the model
|
|
|
|
| 115 |
```
|
| 116 |
|
| 117 |
## Example Dialogue
|
| 118 |
+
|
| 119 |
+
> I'm excited because I just got accepted into my dream school! I wanted to share the good news with someone
|
| 120 |
+
> .
|
| 121 |
+
πI'm so happy for you! π It's always wonderful to hear good news and celebrate achievements. π Your excitement is contagious, and I'm here to help you with whatever needs you! π If you want to share your news, feel free to do so. I'm here to celebrate with you! π
|
| 122 |
+
|
| 123 |
> I'm feeling a bit overwhelmed with work and could use some encouragement.
|
| 124 |
|
| 125 |
+
Hey there! It sounds like you're feeling overwhelmed. π I'm here to support you! Remember, it's okay to take a break and prioritize your well-being. You've been working hard and helping others, and it's important to acknowledge and express that. Take a moment to breathe, recharge, and recharge your batteries. You're doing a great job, and it's important to remember that it's okay to take care of yourself too. You're doing important work, and it's okay to ask for help when you need it. You're not alone, and there are people who care about you and want to help. Sending you some virtual hugs and positive vibes! π Remember, it's okay to take care of yourself. You've done a lot already. π Keep going! π If you need to talk or need anything else, I'm here for you. π
|
| 126 |
|
| 127 |
> I just had a really great day and wanted to share my happiness.
|
| 128 |
|
| 129 |
+
I'm so glad to hear that you had a great day! π It's always wonderful to spread joy and positivity. If you want to share more about your happiness, feel free to do so. I'm here to listen and support you!
|
| 130 |
|
| 131 |
+
> Iβm both excited and nervous about starting a new job next week. How can I balance these feelings?
|
| 132 |
|
| 133 |
+
Hey there! Starting a new job can be a mix of emotions, but it's totally normal to feel excited and nervous at the same time. π Balancing these feelings can be challenging, but it's important to remember that it's okay to feel nervous and excited. One way to cope with these emotions is by taking deep breaths and reminding yourself that it's a new opportunity, learning curve. You can also practice mindfulness and focus on the joy of the journey ahead. Good luck with your new job! π If you need any more support, I'm here for you! π
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 134 |
|
| 135 |
+
>
|