job-manager / docs /B2_PLAN.md
codemaivanngu's picture
Mirror of GitHub branch eval-core at f20458a38e06550639cf2011634cb9c48551bf66
36bacba
|
Raw History Blame Contribute Delete
748 Bytes

B2 - dong not khoang trong do min engine (chua lam o B1)

B1 da mịn o muc BOOKKEEPING: 1 job = 1 cell, co ckpt_sha + cells[]. Khoang trong con lai: gen.sh van dua CA plan.json cho eval_queue.py, nen mot job cell van khoi dong engine cho ca moc (dung ket qua, nhung lang phi khi nhieu may cung chay).

Cach dong: sinh plan thu gon chi chua cell cua job. Truoc khi lam, can BIET schema that cua plan.json (khong doan). Mot lenh lay du lieu do:

python3 -c "import json;d=json.load(open(<case>/eval/<run>-step120/plan.json));print(list(d));print(json.dumps(d,indent=2)[:800])"

Sau khi co schema: ec ghi them plan.cell.json canh plan goc (khong sua plan goc), va gen.sh goi plan thu gon. Khong dong den scripts/evaluation/eval_queue.py.