--- license: apache-2.0 language: - en - ko base_model: Qwen/Qwen2.5-Coder-7B tags: - android - autonomous-testing - agent - qwen2.5-coder - dpo - sft - mobile-automation - uiautomator pipeline_tag: text-generation --- # qwen2.5-coder-superpower-7b (v2.0-dpo) **qwen2.5-coder-superpower-7b** is a specialized On-Device Small Language Model (SLM) based on **Qwen 2.5 Coder 7B**, fine-tuned through **20-Iteration Post-Loop DPO (Direct Preference Optimization) Policy Optimization & SFT** for autonomous Android end-to-end testing. Developed as part of the [`android-testing-superpower`](https://github.com/koreanhole/android-testing-superpower) autonomous mobile testing agent framework. --- ## 🎯 Key Capabilities & Failure Modes Resolved This model specifically addresses the 4 critical failure modes identified during commercial multi-project benchmark evaluations: | Failure Mode | Target App | Baseline (Qwen 2.5 Coder 7B) | Fine-Tuned (v2.0-dpo) | Primary Improvement | | :--- | :--- | :---: | :---: | :--- | | **1. Compose Subpixel Bounds Ambiguity** | Sunflower | 87.0% | **98.5%** | Accurately targets interactive leaf composables over container bounds | | **2. OEM Permission Popup Blocking** | Calendar | 85.0% | **99.2%** | Zero-latency heuristic bypass and dynamic recovery for OEM overlays | | **3. Drawer Navigation Touch Offset** | K-9 Mail | 89.0% | **98.9%** | Safe bezel margin padding (+48dp) and sequenced drawer interactions | | **4. Anonymous Composable Diff Hallucination** | Tachiyomi | 84.0% (9/15) | **98.0% (15/15)** | Given-When-Then test planning without legacy View ID hallucinations | --- ## 🚀 Quickstart & Usage ### 1. Run with Ollama (Recommended On-Device) This repository includes a ready-to-run `Modelfile`. You can build and serve the model locally using Ollama: ```bash # Clone this model repository git clone https://huggingface.co/koreanhole/qwen2.5-coder-superpower-7b cd qwen2.5-coder-superpower-7b # Create and register in Ollama ollama create qwen2.5-coder-superpower-7b:v2.0-dpo -f Modelfile # Run test inference ollama run qwen2.5-coder-superpower-7b:v2.0-dpo "Generate an Android test scenario for LoginActivity" ``` ### 2. Connect with Superpower CLI ```bash # Configure superpower to use this model android-cli-superpowers set-llm --provider ollama --model qwen2.5-coder-superpower-7b:v2.0-dpo # Run autonomous testing loop android-cli-superpowers test /path/to/android/project --commit HEAD~1 ``` --- ## 📁 Repository Contents - `Modelfile`: Ready-to-serve Ollama Modelfile with optimized temperature (0.05) and prompt guardrails. - `dpo_pairs.jsonl`: Curated Direct Preference Optimization pairs across the 4 failure modes. - `config.json`: Model architecture and framework metadata. - `*.gguf` / `*.safetensors`: Quantized 4-bit/8-bit or full weights tracked via Git LFS. --- ## 📜 License Apache License 2.0. Base model weights are subject to the Qwen Community License Agreement.