Instructions to use mlx-community/Qwen2-Math-72B-Instruct-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Qwen2-Math-72B-Instruct-bf16 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("mlx-community/Qwen2-Math-72B-Instruct-bf16") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use mlx-community/Qwen2-Math-72B-Instruct-bf16 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "mlx-community/Qwen2-Math-72B-Instruct-bf16"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "mlx-community/Qwen2-Math-72B-Instruct-bf16" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "mlx-community/Qwen2-Math-72B-Instruct-bf16", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Commit History
-
2338714d62982c0dd49553b389c7335a78dde65eba0377608792457aa1d07839
Verified signaturea6c60f2 -
70353c9d854152aad7cff22c86867fed82e6bc7c35b5cdb2d3bc9a69686577d5
Verified signature43e1553 -
634fb3cfc3acbead362e24c0464a8d826882fe7c4e415caa847cd12c4e56730f
Verified signaturea6f2e74 -
b4ac065a374c44398f355fd86dc6522528d6c242d085f3b17e4f1bed9bafea4f
Verified signature9a01e57 -
187873c409241ec4cc9845f44f38ef15c3c5f2a1cc2bc115895e608380eb39f3
Verified signature947f350 -
b012bee3a302d11eb5e2c9119bbc0999aabf20040918c4a11bad8e2737e014cf
Verified signatureec4f9b5 -
e22f3cbb8b15a4e10dfd7f4b50a3744943fbfeb1d4d7863445811f5641815e88
Verified signature4655d7d -
83e0c47f9a418ce40327df08cd46e59f78be6e7f5930c4318aee0fcc248d9c68
Verified signatureb80cbb5 -
321198a21e7833d75b81423052ac6ba2e8bc262ea3c344a4dc53804f00ffcc64
Verified signature74d4ef0 -
316f2166ceeb0546db295a9f64e3cd2497052a11c7aebec86a6532d8701f9bc2
Verified signature1c62a54 -
93cb80d2eabb18f3bce7b8fcd675e1e9fbf850dcb9a94e0717f633edb250d96f
Verified signature8dfce73 -
cb82bdaab4c4e11f2e3d25ee41a2bdd7564a649f736fad4a92f7ff0195aee784
Verified signature900587d -
214fa5e47b8ac09b9f5981e6b0ed004fff070dd9b341751b9261db046294fb23
Verified signatureee8f36f -
b514a219a0e55db14e44c2c224ae6a30d19b2ffa90e13038e0cacf94598b1e17
Verified signaturee6389d3 -
cb37906af83561fb87acf71552d2916d720416b565d80fe0d25862a0e9c7f147
Verified signaturefc395fb -
e12d7869549ad1fe8c0538f679e6f6a03149390ab1417e4b8ac1ec960664c75d
Verified signature8dfeb3c -
2c20d2f0a7576244c86da3b5b2ef306f72aa90989f1ebb87c422448afeb27e72
Verified signaturea0a10b7 -
3ab16caf4b886572e7a2ff08c6b3fe734d6dda4df8a1acd8cccbd8e4e1147e16
Verified signature2dd8cf8 -
1e39525f0ba6b44119b477471c2dd261279654a815d7903546306cf6770d1e4f
Verified signature8d07c98 -
4290a783f4fd619954dd69e2c09946290a963a0f62673cf8bfcc3e7ec0b1a8b4
Verified signature2b2c09a -
dd037cff1cba466f0b7dd32c22451a9b837c30da474f5078686c8d10604b5e59
Verified signature036a399 -
c2fbe2a3471944d1dfdaf5454c6534a9fab452a5fe86685ed5f39bb870d1d7f4
Verified signature2f3d287 -
9e0e54e49a7e7006eeeb65120cfcf5d0e3c6a713ac2ee2b260fc24e154f277cf
Verified signaturebde24bf -
99127673e188e50e7be083c557e558deef21927f3cb71631b4f2de499441f76f
Verified signaturef24eebd -
84ab543f4845fdaa7b82382711760062dfcab5b0ff6dddd63e5191c586bbc24d
Verified signature9613717 -
4e888c52b978d4fd488c5f07afb90a4c1e99b35cbd80aabecc93557fe402edd2
Verified signature8cb0ad9 -
74de202e71f71406af7907d780687b1825b67d448dc18b50f8bb4a628358b0dc
Verified signature5167f40 -
12e092bd8f49fc38e8d189dd8d21bd9eca2ca74d52fc0bfe11adfa5abf171b5b
Verified signaturea2d641f -
f9b9cf17687e4b0215a5f3406280deb961c64a05586ba057925b0bf5e12e12d1
Verified signature2ad59dc -
initial commit
Verified signature1ff0544