runtime error
Exit code: 1. Reason: 0%| | 0.00/988M [00:00<?, ?B/s][A model.safetensors: 7%|▋ | 67.1M/988M [00:01<00:17, 52.0MB/s][A model.safetensors: 25%|██▌ | 250M/988M [00:02<00:06, 111MB/s] [A model.safetensors: 100%|██████████| 988M/988M [00:03<00:00, 300MB/s] generation_config.json: 0%| | 0.00/242 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 242/242 [00:00<00:00, 1.55MB/s] Loading LoRA adapters into a single model... adapter_config.json: 0%| | 0.00/1.01k [00:00<?, ?B/s][A adapter_config.json: 100%|██████████| 1.01k/1.01k [00:00<00:00, 6.06MB/s] adapter_model.safetensors: 0%| | 0.00/8.68M [00:00<?, ?B/s][A adapter_model.safetensors: 100%|██████████| 8.68M/8.68M [00:00<00:00, 17.7MB/s] Traceback (most recent call last): File "/app/app.py", line 31, in <module> model = PeftModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 568, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1430, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 383, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.9, base_model.model.model.layers.10, base_model.model.model.layers.11, base_model.model.model.layers.12, base_model.model.model.layers.13, base_model.model.model.layers.14, base_model.model.model.layers.15, base_model.model.model.layers.16, base_model.model.model.layers.17, base_model.model.model.layers.18, base_model.model.model.layers.19, base_model.model.model.layers.20, base_model.model.model.layers.21, base_model.model.model.layers.22, base_model.model.model.layers.23, base_model.model.model.norm, base_model.model.model.rotary_emb.
Container logs:
Fetching error logs...