|
Download README.md from AIRAVAT-AI-ML/erawan-1: direct link, hf CLI and curl.
- Browser
- Download file 2.39 kB
-
https://huggingface.co/AIRAVAT-AI-ML/erawan-1/resolve/main/README.md
- Command line
-
hf download hf://AIRAVAT-AI-ML/erawan-1/README.md
-
curl -L -o README.md https://huggingface.co/AIRAVAT-AI-ML/erawan-1/resolve/main/README.md
2.39 kB
| license: apache-2.0 | |
| base_model: Qwen/Qwen3-1.7B | |
| tags: | |
| - qwen3 | |
| - lora | |
| - reasoning | |
| - agentic | |
| - tool-use | |
| - function-calling | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
|  | |
| # Erawan 1 | |
| Erawan 1 is a 1.7B-parameter language model fine-tuned for reasoning and long-horizon agentic tasks, developed by Airavat AI Micro Lab. Built on Qwen3-1.7B, fine-tuned with QLoRA and merged into a standalone full-precision checkpoint. | |
| ## Model Details | |
| - Developed by: Airavat AI Micro Lab | |
| - Base model: Qwen3-1.7B (1,755,440,128 parameters) | |
| - Architecture: Qwen3 decoder-only transformer, 28 layers, grouped-query attention | |
| - Fine-tuning method: QLoRA (4-bit base, LoRA r=32) via Unsloth, merged into fp16 weights | |
| - Training steps: 260 cumulative fine-tune steps | |
| - Context length: 4096 tokens | |
| - License: Apache 2.0 | |
| ## Benchmark Results (Erawan 1 vs base Qwen3-1.7B) | |
| | Task | Benchmark | Base | Erawan 1 | | |
| |---|---|---|---| | |
| | Reasoning / Maths | GSM8K (n=10) | 1/10 | 3/10 | | |
| | Coding / Logic | HumanEval (n=6) | 4/6 | 4/6 | | |
| | Tool-use | Glaive function-calling (n=6) | 6/6 | 6/6 | | |
| ## HumanEval vs Public Small Models | |
| | Model | Params | HumanEval | | |
| |---|---|---| | |
| | Llama-3.2-1B-Instruct | 1B | 33.5% | | |
| | SmolLM2-1.7B-Instruct | 1.7B | 28.1% | | |
| | Qwen2.5-1.5B-Instruct | 1.5B | 30.5% | | |
| | Qwen3-1.7B (base) | 1.7B | 67% | | |
| | Erawan 1 | 1.7B | 67% | | |
| ## Training Data | |
| - unsloth/OpenMathReasoning-mini (~600 rows) | |
| - NousResearch/hermes-function-calling-v1 (~900 rows) | |
| - mlabonne/FineTome-100k (~200 rows) | |
| - Custom identity examples | |
| ## Intended Use | |
| Agentic tool-calling workflows, step-by-step reasoning, and research on small efficient reasoning models. Not intended for medical, legal, or financial decision-making, or any use requiring guaranteed factual accuracy. | |
| ## How to Use | |
| from transformers import AutoModelForCausalLM, AutoTokenizer | |
| model = AutoModelForCausalLM.from_pretrained('airavat-ai/erawan-1') | |
| tokenizer = AutoTokenizer.from_pretrained('airavat-ai/erawan-1') | |
| messages = [{'role': 'user', 'content': 'Who are you?'}] | |
| inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors='pt') | |
| outputs = model.generate(inputs, max_new_tokens=200) | |
| print(tokenizer.decode(outputs[0], skip_special_tokens=True)) | |
| ## Credits | |
| Base model: Qwen3-1.7B by the Qwen Team, Alibaba Cloud. Fine-tuning tooling: Unsloth. License: Apache 2.0. |