Instructions to use kevinpro/MetaMathOctopus-13B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use kevinpro/MetaMathOctopus-13B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="kevinpro/MetaMathOctopus-13B")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("kevinpro/MetaMathOctopus-13B")
model = AutoModelForCausalLM.from_pretrained("kevinpro/MetaMathOctopus-13B", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use kevinpro/MetaMathOctopus-13B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "kevinpro/MetaMathOctopus-13B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kevinpro/MetaMathOctopus-13B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/kevinpro/MetaMathOctopus-13B

SGLang

How to use kevinpro/MetaMathOctopus-13B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "kevinpro/MetaMathOctopus-13B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kevinpro/MetaMathOctopus-13B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "kevinpro/MetaMathOctopus-13B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kevinpro/MetaMathOctopus-13B",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use kevinpro/MetaMathOctopus-13B with Docker Model Runner:
```
docker model run hf.co/kevinpro/MetaMathOctopus-13B
```

MetaMathOctopus-13B / README.md

kevinpro

Update README.md

ebf20c6 verified over 2 years ago

preview code

Raw

History Blame Contribute Delete

3.6 kB

	---
	license: apache-2.0
	metrics:
	- accuracy
	pipeline_tag: text-generation
	tags:
	- multilingual
	---
	## MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization

	🔥Our paper

	https://arxiv.org/abs/2401.06838

	🔥Github Project

	https://github.com/NJUNLP/MAPO

	🔥Open Multilingual Reasoning Leaderboard

	https://huggingface.co/spaces/kevinpro/Open-Multilingual-Reasoning-Leaderboard



	## Benchmarks
	\| System \| [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \| [MGSM](https://huggingface.co/datasets/juletxara/mgsm) \| [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \|
	\| ------ \| :-------------------------------------------------------------: \| :------------------------------------------------------: \| :-------------------------------------------------------------: \|
	\| GPT-3.5-Turbo \| 46.6 \| 42.2 \| 49.4 \|
	\| [MAmmoTH 7B](https://huggingface.co/TIGER-Lab/MAmmoTH-7B) \| 26.3 \| 21.3 \| 24.2 \|
	\| [WizardMath 7B](https://huggingface.co/WizardLM/WizardMath-7B-V1.1) \| 32.5 \| 23.0 \| 28.7 \|
	\| [MetaMath 7B](https://huggingface.co/meta-math/MetaMath-7B-V1.0) \| 46.2 \| 37.0 \| 43.2 \|
	\| [QAlign 7B](https://huggingface.co/Wenhao97/QAlign-MetaMathQA-7B) \| 57.2 \| 49.6 \| - \|
	\| [MathOctopus 7B](https://huggingface.co/Mathoctopus/Parallel_7B) \| 41.2 \| 39.5 \| 37.1 \|
	\| [+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-7B) \| 57.4 \| 41.6 \| 50.4 \|
	\| [MetaMathOctopus 7B](https://huggingface.co/kevinpro/MetaMathOctopus-7B) \| 53.0 \| 45.5 \| 39.2 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-7B) \| 64.7 \| 51.6 \| 52.9 \|
	\| [MistralMathOctopus 7B](https://huggingface.co/kevinpro/MistralMathOctopus-7B) \| 59.0 \| 58.0 \| 56.8 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MistralMathOctopus-MAPO-DPO-7B) \| 74.6 \| 67.3 \| 70.0 \|

	\| System \| [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \| [MGSM](https://huggingface.co/datasets/juletxara/mgsm) \| [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \|
	\| ------ \| :-------------------------------------------------------------: \| :------------------------------------------------------: \| :-------------------------------------------------------------: \|
	\| GPT-3.5-Turbo \| 46.6 \| 42.2 \| 49.4 \|
	\| [MAmmoTH 13B](https://huggingface.co/TIGER-Lab/MAmmoTH-13B) \| 38.6 \| 28.9 \| 29.5 \|
	\| [WizardMath 13B](https://huggingface.co/WizardLM/WizardMath-13B-V1.1) \| 35.7 \| 28.3 \| 29.0 \|
	\| [MetaMath 13B](https://huggingface.co/meta-math/MetaMath-13B-V1.0) \| 46.2 \| 43.9 \| 43.3 \|
	\| [QAlign 13B](https://huggingface.co/Wenhao97/QAlign-MetaMathQA-13B) \| 62.6 \| 57.1 \| - \|
	\| [MathOctopus 13B](https://huggingface.co/Mathoctopus/Parallel_13B) \| 51.8 \| 46.0 \| 40.3 \|
	\| [+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-13B) \| 60.1 \| 48.5 \| 53.8 \|
	\| [MetaMathOctopus 13B](https://huggingface.co/kevinpro/MetaMathOctopus-13B) \| 56.3 \| 51.4 \| 49.5 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-13B) \| 67.0 \| 58.0 \| 59.8 \|



	## Citation
	If you find this model helpful, feel free to cite our paper:
	```
	@misc{she2024mapo,
	title={MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization},
	author={Shuaijie She and Wei Zou and Shujian Huang and Wenhao Zhu and Xiang Liu and Xiang Geng and Jiajun Chen},
	year={2024},
	eprint={2401.06838},
	archivePrefix={arXiv},
	primaryClass={cs.CL}
	}
	```

	---
	license: apache-2.0
	metrics:
	- accuracy
	pipeline_tag: text-generation
	tags:
	- multilingual
	---
	## MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization

	🔥Our paper

	https://arxiv.org/abs/2401.06838

	🔥Github Project

	https://github.com/NJUNLP/MAPO

	🔥Open Multilingual Reasoning Leaderboard

	https://huggingface.co/spaces/kevinpro/Open-Multilingual-Reasoning-Leaderboard



	## Benchmarks
	\| System \| [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \| [MGSM](https://huggingface.co/datasets/juletxara/mgsm) \| [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \|
	\| ------ \| :-------------------------------------------------------------: \| :------------------------------------------------------: \| :-------------------------------------------------------------: \|
	\| GPT-3.5-Turbo \| 46.6 \| 42.2 \| 49.4 \|
	\| [MAmmoTH 7B](https://huggingface.co/TIGER-Lab/MAmmoTH-7B) \| 26.3 \| 21.3 \| 24.2 \|
	\| [WizardMath 7B](https://huggingface.co/WizardLM/WizardMath-7B-V1.1) \| 32.5 \| 23.0 \| 28.7 \|
	\| [MetaMath 7B](https://huggingface.co/meta-math/MetaMath-7B-V1.0) \| 46.2 \| 37.0 \| 43.2 \|
	\| [QAlign 7B](https://huggingface.co/Wenhao97/QAlign-MetaMathQA-7B) \| 57.2 \| 49.6 \| - \|
	\| [MathOctopus 7B](https://huggingface.co/Mathoctopus/Parallel_7B) \| 41.2 \| 39.5 \| 37.1 \|
	\| [+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-7B) \| 57.4 \| 41.6 \| 50.4 \|
	\| [MetaMathOctopus 7B](https://huggingface.co/kevinpro/MetaMathOctopus-7B) \| 53.0 \| 45.5 \| 39.2 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-7B) \| 64.7 \| 51.6 \| 52.9 \|
	\| [MistralMathOctopus 7B](https://huggingface.co/kevinpro/MistralMathOctopus-7B) \| 59.0 \| 58.0 \| 56.8 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MistralMathOctopus-MAPO-DPO-7B) \| 74.6 \| 67.3 \| 70.0 \|

	\| System \| [MSVAMP](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \| [MGSM](https://huggingface.co/datasets/juletxara/mgsm) \| [MNumGLUESub](https://huggingface.co/datasets/Mathoctopus/MSVAMP) \|
	\| ------ \| :-------------------------------------------------------------: \| :------------------------------------------------------: \| :-------------------------------------------------------------: \|
	\| GPT-3.5-Turbo \| 46.6 \| 42.2 \| 49.4 \|
	\| [MAmmoTH 13B](https://huggingface.co/TIGER-Lab/MAmmoTH-13B) \| 38.6 \| 28.9 \| 29.5 \|
	\| [WizardMath 13B](https://huggingface.co/WizardLM/WizardMath-13B-V1.1) \| 35.7 \| 28.3 \| 29.0 \|
	\| [MetaMath 13B](https://huggingface.co/meta-math/MetaMath-13B-V1.0) \| 46.2 \| 43.9 \| 43.3 \|
	\| [QAlign 13B](https://huggingface.co/Wenhao97/QAlign-MetaMathQA-13B) \| 62.6 \| 57.1 \| - \|
	\| [MathOctopus 13B](https://huggingface.co/Mathoctopus/Parallel_13B) \| 51.8 \| 46.0 \| 40.3 \|
	\| [+ MAPO-DPO(ours)🔥](https://huggingface.co/kevinpro/MathOctopus-MAPO-DPO-13B) \| 60.1 \| 48.5 \| 53.8 \|
	\| [MetaMathOctopus 13B](https://huggingface.co/kevinpro/MetaMathOctopus-13B) \| 56.3 \| 51.4 \| 49.5 \|
	\| [+ MAPO-DPO(ours) 👑](https://huggingface.co/kevinpro/MetaMathOctopus-MAPO-DPO-13B) \| 67.0 \| 58.0 \| 59.8 \|



	## Citation
	If you find this model helpful, feel free to cite our paper:
	```
	@misc{she2024mapo,
	title={MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization},
	author={Shuaijie She and Wei Zou and Shujian Huang and Wenhao Zhu and Xiang Liu and Xiang Geng and Jiajun Chen},
	year={2024},
	eprint={2401.06838},
	archivePrefix={arXiv},
	primaryClass={cs.CL}
	}
	```