Text Generation
MLX
Safetensors
English
qwen3
4-bit precision
college-essays
personal-statement
creative-writing
human-style
common-app
admissions
conversational
Instructions to use alphanozcan/essAi-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use alphanozcan/essAi-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("alphanozcan/essAi-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use alphanozcan/essAi-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "alphanozcan/essAi-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "alphanozcan/essAi-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use alphanozcan/essAi-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "alphanozcan/essAi-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "alphanozcan/essAi-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "alphanozcan/essAi-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use alphanozcan/essAi-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "alphanozcan/essAi-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default alphanozcan/essAi-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use alphanozcan/essAi-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "alphanozcan/essAi-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "alphanozcan/essAi-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
essAi (MLX 4-bit)
A 4-bit quantized MLX build of alphanozcan/essAi — a Qwen3-4B fine-tune that writes authentic college application essays (Common App personal statement style) in a natural human voice. A 9B MLX build (Qwen3.5-9B) is available at alphanozcan/essAi-9b-mlx.
Training
Two-stage fine-tune of Qwen/Qwen3-4B:
- SFT — ~19.7k human-written essays: 270 real admissions essays from publicly published example collections (JHU "Essays That Worked", College Essay Guy, AP Study Notes) and ~19.4k human essays from the open persuade corpus. LoRA r=16 on all linear layers, lr 2e-4, 1 epoch, fp16.
- DPO — for each gold prompt, the real human essay is chosen and the SFT model's own generation is rejected (HumanLLMs method, arXiv 2501.05032), plus GradGPT quality pairs. beta=0.1, lr 5e-5.
Usage (Apple Silicon)
pip install mlx-lm
mlx_lm generate --model alphanozcan/essAi-mlx --max-tokens 900 --prompt "Write a ~650-word Common App style personal statement essay about learning from failure."
Python:
from mlx_lm import generate, load
from mlx_lm.sample_utils import make_sampler
model, tok = load("alphanozcan/essAi-mlx")
system = "You write authentic college application essays in a natural human voice, with specific personal detail, varied sentence rhythm, and honest reflection."
user = "Write a ~650-word Common App style personal statement essay about learning from failure."
prompt = tok.apply_chat_template(
[{"role": "system", "content": system}, {"role": "user", "content": user}],
tokenize=False, add_generation_prompt=True, enable_thinking=False,
)
text = generate(model, tok, prompt=prompt, max_tokens=900,
sampler=make_sampler(temp=0.75, top_p=0.95))
print(text)
Runs at ~48 tok/s with ~2.4 GB peak memory on Apple Silicon.
Notes
- 4B parameters, 1 training epoch — quality reflects that; longer training and a larger base would improve coherence.
- Style metrics (human reference vs model output): burstiness CV 0.544 → 0.465, mean sentence length 18.8 → 17.0.
- AI-detector behavior is not guaranteed; the model is trained on human essays for a more natural writing style, but detectors are trained classifiers and results vary.
- Downloads last month
- 53
Model size
4B params
Tensor type
U32
·
F16 ·
Hardware compatibility
Log In to add your hardware
4-bit