Instructions to use maxhirez/mdnaPlus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use maxhirez/mdnaPlus with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("maxhirez/mdnaPlus") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use maxhirez/mdnaPlus with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "maxhirez/mdnaPlus"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "maxhirez/mdnaPlus" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use maxhirez/mdnaPlus with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "maxhirez/mdnaPlus"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "maxhirez/mdnaPlus" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- MLX LM
How to use maxhirez/mdnaPlus with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "maxhirez/mdnaPlus"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "maxhirez/mdnaPlus" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "maxhirez/mdnaPlus", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use maxhirez/mdnaPlus with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "maxhirez/mdnaPlus"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default maxhirez/mdnaPlus
Run Hermes
hermes
Improve language tag
Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.
Hi! First, I’m so flattered that you took the time to look at this model!
Before I merge, I’d like to understand where you got the figure of 13 explicit languages. The README for this fine-tune only lists en as far as I can see. The adaptors were only trained on submissions to SEC EDGAR, which are in English only-so if anything I’d expect the tuning to degrade any other languages in the base model. It’s really intended as an English-only model since the use case (if there even is a use case) would also be centered around SEC-EDGAR. I wouldn’t want to mislead anyone into thinking there was fine tuning around for instance Portuguese, French or Hindi or that it was capable of generating regulation-appropriate inference for any other languages.
Were you looking at the Qwen/Qwen2.5-7B-Instruct or Qwen2.5-7B cards, perhaps?
Thanks!
Indeed, my loop looks at all models base on the Qwen-2.5 family model (where it's mentioned in the READMEs of the original models or on their blog https://qwenlm.github.io/blog/qwen2.5/ that they support 29 languages).
The fact that you have finetuned on a single language has probably effectively altered the capabilities of the other languages. Merge or close the PR, whichever suits you best
Very good! Again, thanks for looking at the model and have a great week!