metadata
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
library_name: peft
pipeline_tag: text-generation
license: apache-2.0
datasets:
- nvidia/OpenCodeInstruct
tags:
- qwen3-coder
- coding
- software-engineering
- lora
- moe
- tiny-pickle
Tiny Pickle v3 Coder — LoRA
Tiny Pickle v3 Coder is a coding-focused LoRA adaptation of
Qwen/Qwen3-Coder-30B-A3B-Instruct.
It was trained for ten hours on examples from OpenCodeInstruct for which the recorded average test score was perfect and every recorded test passed.
Training
- Optimizer steps: 9,920
- Approximate packed sequences: 39,680
- Training context: 4,096 tokens
- LoRA rank: 64
- Learning rate: 2e-5
- Hardware: one NVIDIA H200
- Training duration: ten hours
Intended use
Code generation, debugging, implementation planning, code review, algorithmic problem solving and test generation.
Limitations
This is an experimental specialization. It has not yet been demonstrated to outperform the unmodified base model on independent benchmarks. Generated code may be incorrect, insecure or incomplete and must be reviewed and tested.