Text Generation
Transformers
TensorBoard
Safetensors
English
llama
instruction
proseflow
unsloth
smollm
writing-assistant
conversational
text-generation-inference
Instructions to use LSXPrime/ProseFlow-v1-360M-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LSXPrime/ProseFlow-v1-360M-Instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="LSXPrime/ProseFlow-v1-360M-Instruct") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("LSXPrime/ProseFlow-v1-360M-Instruct") model = AutoModelForCausalLM.from_pretrained("LSXPrime/ProseFlow-v1-360M-Instruct", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use LSXPrime/ProseFlow-v1-360M-Instruct with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "LSXPrime/ProseFlow-v1-360M-Instruct" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LSXPrime/ProseFlow-v1-360M-Instruct", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/LSXPrime/ProseFlow-v1-360M-Instruct
- SGLang
How to use LSXPrime/ProseFlow-v1-360M-Instruct with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "LSXPrime/ProseFlow-v1-360M-Instruct" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LSXPrime/ProseFlow-v1-360M-Instruct", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "LSXPrime/ProseFlow-v1-360M-Instruct" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LSXPrime/ProseFlow-v1-360M-Instruct", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Studio
How to use LSXPrime/ProseFlow-v1-360M-Instruct with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for LSXPrime/ProseFlow-v1-360M-Instruct to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for LSXPrime/ProseFlow-v1-360M-Instruct to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for LSXPrime/ProseFlow-v1-360M-Instruct to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="LSXPrime/ProseFlow-v1-360M-Instruct", max_seq_length=2048, ) - Docker Model Runner
How to use LSXPrime/ProseFlow-v1-360M-Instruct with Docker Model Runner:
docker model run hf.co/LSXPrime/ProseFlow-v1-360M-Instruct
| base_model: HuggingFaceTB/SmolLM-360M-Instruct | |
| language: | |
| - en | |
| library_name: transformers | |
| license: apache-2.0 | |
| datasets: | |
| - LSXPrime/ProseFlow-Actions-v1 | |
| tags: | |
| - text-generation | |
| - instruction | |
| - proseflow | |
| - unsloth | |
| - smollm | |
| - writing-assistant | |
| # ProseFlow-v1-360M-Instruct | |
| **ProseFlow-v1-360M-Instruct** is a lightweight, experimental instruction-tuned model created for the [ProseFlow desktop application](https://github.com/LSXPrime/ProseFlow). This model is a fine-tune of HuggingFace's [**SmolLM-360M-Instruct**](https://huggingface.co/HuggingFaceTB/SmolLM-360M-Instruct) and was created to explore the capabilities of smaller language models on a diverse set of text-processing tasks. | |
| The model was fine-tuned on the [**ProseFlow-Actions-v1**](https://huggingface.co/datasets/LSXPrime/ProseFlow-Actions-v1) dataset. | |
| **Note:** This model is provided for research and experimental purposes and low-resource devices. For the best user experience in the ProseFlow application, the larger and more capable [`ProseFlow-v1-1.5B-Instruct`](https://huggingface.co/LSXPrime/ProseFlow-v1-1.5B-Instruct) model is strongly recommended. | |
| ## Model Description | |
| ProseFlow is a universal AI text processor that allows users to create and execute custom AI "Actions" on text in any application. This model was an experiment to see if a ~360M parameter model could reliably perform the wide range of tasks defined in the training dataset. | |
| ### Performance and Capabilities | |
| Evaluations show that while this model is extremely fast and has very low resource requirements, its capabilities are limited. | |
| #### Strengths: | |
| * **Extremely Lightweight:** Can run on devices with very limited RAM and computational power. | |
| * **Strict Formatting Adherence (sometimes):** In some cases where it understands the task, it can follow rigid formatting instructions (like creating a bulleted list) more strictly than its larger counterpart. | |
| * **Simple Data Extraction:** It shows some capability in basic data extraction and formatting tasks, such as creating Markdown tables or extracting contact information. | |
| #### Weaknesses & Limitations: | |
| * **Poor Reasoning:** The model struggles significantly with tasks that require logical reasoning, inference, or multi-step problem-solving. It often fails on word problems and logical puzzles. | |
| * **Limited Creativity:** It is not effective at creative writing tasks like continuing a story or generating novel content. Its outputs are often repetitive or nonsensical. | |
| * **Instructional Failures:** The model frequently violates the "no extra text" rule by adding conversational chatter. In many cases, it fails the task entirely and repeats the input verbatim. | |
| * **Hallucination:** On some tasks (e.g., `To Paragraph`), the model hallucinates content completely unrelated to the input. | |
| * **Unreliable for Complex Tasks:** It is not suitable for complex tasks like code refactoring, bug finding, or drafting professional business correspondence. | |
| ### Intended Use | |
| This model is intended for **experimental use** and for users on **extremely resource-constrained systems** who are willing to accept a significant trade-off in performance and reliability. It may be suitable for a very limited subset of simple, repetitive text-formatting tasks. | |
| It is designed to be used within the **ProseFlow desktop application**, but it is **not the recommended model for general use**. | |
| ## How to Use in ProseFlow | |
| 1. [Download and install the ProseFlow application](https://github.com/LSXPrime/ProseFlow/releases). | |
| 2. Navigate to the **Providers -> Local Provider** tab. | |
| 3. Click "Manage Models..." and download `ProseFlow-v1-360M-Instruct` from the "Available for Download" list. | |
| 4. Once downloaded, select it from the "My Models" list. | |
| 5. Set your "Primary Service Type" in ProseFlow to **Local**. | |
| 6. Be aware of the limitations described above when executing actions. | |
| ## Training Details | |
| * **Base Model:** [HuggingFaceTB/SmolLM-360M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-360M-Instruct) | |
| * **Dataset:** [LSXPrime/ProseFlow-Actions-v1](https://huggingface.co/datasets/LSXPrime/ProseFlow-Actions-v1) | |
| * **Fine-tuning Library:** [Unsloth](https://github.com/unslothai/unsloth) | |
| * **Fine-tuning Method:** Supervised fine-tuning on a dataset of structured instruction-input-output triplets. | |
| ## License | |
| This model is licensed under the [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0). |