Linslab commited on
Commit
458748e
·
verified ·
1 Parent(s): e25638c

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/build_bank.py +25 -0
  2. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/check_synthetic.py +26 -0
  3. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/controller.py +52 -0
  4. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/cue_localization.py +12 -0
  5. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/demo_manifest.json +2168 -0
  6. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/environment.lock +249 -0
  7. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/features.py +12 -0
  8. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/findings.md +13 -0
  9. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/freeze_manifest.json +160 -0
  10. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/handoff.md +9 -0
  11. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/model_tool_manifest.yaml +87 -0
  12. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/policy_runner.py +25 -0
  13. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/pose_math.py +8 -0
  14. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/skills.md +7 -0
  15. agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/worker_api.py +81 -0
  16. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/build_bank.cpython-310.pyc +0 -0
  17. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/controller.cpython-310.pyc +0 -0
  18. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/synthetic_checks.cpython-310.pyc +0 -0
  19. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/bank_provenance.json +26 -0
  20. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/build_bank.py +24 -0
  21. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/controller.py +97 -0
  22. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/demo_manifest.json +2168 -0
  23. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/environment.lock +249 -0
  24. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/findings.md +24 -0
  25. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/freeze_manifest.json +149 -0
  26. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/handoff.md +11 -0
  27. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/model_tool_manifest.yaml +40 -0
  28. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/policy_runner.py +25 -0
  29. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/skills.md +9 -0
  30. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/synthetic_check_results.json +20 -0
  31. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/synthetic_checks.py +31 -0
  32. agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/worker_api.py +81 -0
  33. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_00.h5 +3 -0
  34. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_01.h5 +3 -0
  35. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_02.h5 +3 -0
  36. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_05.h5 +3 -0
  37. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_07.h5 +3 -0
  38. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_10.h5 +3 -0
  39. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_11.h5 +3 -0
  40. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_12.h5 +3 -0
  41. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_13.h5 +3 -0
  42. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_14.h5 +3 -0
  43. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_15.h5 +3 -0
  44. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_16.h5 +3 -0
  45. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_17.h5 +3 -0
  46. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_18.h5 +3 -0
  47. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/reference_bank.npz +3 -0
  48. agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/servo_bank.npz +3 -0
  49. agent_d20_e20/frozen_20261102/tasks/DualArmJumpRope-v1/frozen/controller.py +88 -0
  50. agent_d20_e20/frozen_20261102/tasks/DualArmJumpRope-v1/frozen/demo_analysis.md +64 -0
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/build_bank.py ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Offline compilation of only the 20 manifest-authorized demonstrations."""
2
+ import importlib.util,json
3
+ from pathlib import Path
4
+ import numpy as np
5
+ from features import CAMERAS,image_feature
6
+ spec=importlib.util.spec_from_file_location('worker_api','/worker_api.py')
7
+ mod=importlib.util.module_from_spec(spec);spec.loader.exec_module(mod)
8
+ api=mod.API();manifest=json.load(open('/demo_manifest.json'))
9
+ assert len(manifest['episodes'])==20
10
+ q=[];v=[];a=[];images=[];ph=[];ids=[];times=[]
11
+ for d,ep in enumerate(manifest['episodes']):
12
+ n=ep['length']
13
+ fields=[f'actions/mobile_panda-{r}' for r in range(2)]+[f'obs/agent/mobile_panda-{r}/{k}' for r in range(2) for k in ('qpos','qvel')]
14
+ data=api.read_demo(ep['demo_id'],0,n,fields)
15
+ q.append(np.concatenate([data[f'obs/agent/mobile_panda-{r}/qpos'] for r in range(2)],1))
16
+ v.append(np.concatenate([data[f'obs/agent/mobile_panda-{r}/qvel'] for r in range(2)],1))
17
+ a.append(np.concatenate([data[f'actions/mobile_panda-{r}'] for r in range(2)],1))
18
+ im=[]
19
+ for start in range(0,n,32):
20
+ batch=api.read_demo(ep['demo_id'],start,min(n,start+32),[f'obs/sensor_data/{c}/rgb' for c in CAMERAS])
21
+ im.extend(np.stack([image_feature(batch[f'obs/sensor_data/{c}/rgb'][i]) for c in CAMERAS]) for i in range(min(32,n-start)))
22
+ images.extend(im);ph.extend(np.arange(n)/n);ids.extend([d]*n);times.extend(range(n))
23
+ q=np.concatenate(q);v=np.concatenate(v);a=np.concatenate(a)
24
+ np.savez_compressed(Path(__file__).with_name('demo_bank.npz'),q=q,v=v,a=a,images=np.asarray(images,dtype=np.float16),phase=np.array(ph,dtype=np.float32),demo_id=np.array(ids),frame=np.array(times),qscale=np.maximum(q.std(0),.08),vscale=np.maximum(v.std(0),.2))
25
+ print('compiled',len(a),'observation/action pairs from',len(manifest['episodes']),'demonstrations')
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/check_synthetic.py ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Interface tests only. Fabricated observations/bank; no task rollout."""
2
+ import importlib.util
3
+ from pathlib import Path
4
+ import numpy as np
5
+ s=importlib.util.spec_from_file_location('controller',Path(__file__).with_name('controller.py'));c=importlib.util.module_from_spec(s);s.loader.exec_module(c)
6
+ # Load artifact only to check dimensions and finiteness, not evaluate a policy.
7
+ b=c._load(); assert b['a'].shape==(7176,20); assert b['q'].shape==(7176,24)
8
+ assert np.isfinite(b['a']).all(); assert set(b['demo_id'])==set(range(20))
9
+ q=np.zeros(24,np.float32);q[[10,11,22,23]]=.04
10
+ obs={'step_id':1,'instruction':'synthetic interface test','rgb':{k:np.zeros((240,320,3),np.uint8) for k in c._features.CAMERAS},'proprioception':{}}
11
+ for r in range(2):
12
+ obs['proprioception'][f'agent/mobile_panda-{r}/qpos']=q[r*12:(r+1)*12].copy()
13
+ obs['proprioception'][f'agent/mobile_panda-{r}/qvel']=np.zeros(12)
14
+ a=np.zeros((2,20),np.float32);a[0,3]=.1;a[1,3]=-.1
15
+ c._bank={'q':np.stack([q,q]),'v':np.zeros((2,24)), 'a':a,'qscale':np.ones(24),'vscale':np.ones(24),'phase':np.zeros(2),'images':np.stack([np.zeros((2,1728)),np.ones((2,1728))])}
16
+ c.reset_episode();out=c.act(obs);assert out.shape==(20,) and out.dtype==np.float32 and out[3]>.0
17
+ # RGB alone changes action choice for a fabricated identical-proprio pair.
18
+ obs['rgb']={k:np.full((1,240,320,3),255,np.uint8) for k in c._features.CAMERAS}
19
+ c.reset_episode();out=c.act(obs);assert out[3]<0
20
+ # Proprioceptive mismatch produces measured-base hold.
21
+ obs['proprioception']['agent/mobile_panda-0/qpos'][0]=100
22
+ c.reset_episode();out=c.act(obs);assert out[0]==100 and out[3]==0
23
+ obs['step_id']=400;assert c.act(obs) is None
24
+ obs['step_id']=1;obs['proprioception']['agent/mobile_panda-0/qpos'][0]=np.nan;assert c.act(obs) is None
25
+ c.reset_episode();assert c._phase==0 and c._bad==0
26
+ print('PASS: artifact shape, finite labels, 20 IDs; synthetic RGB response, proprio hold, batch RGB, horizon, malformed inputs, reset. No environment calls.')
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/controller.py ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """D20 pose-reference controller. Analytic kinematics, no simulator or learned model."""
2
+ from pathlib import Path
3
+ import numpy as np
4
+ from scipy.spatial.transform import Rotation
5
+ import importlib.util
6
+ spec=importlib.util.spec_from_file_location('_pose_math',Path(__file__).with_name('pose_math.py'))
7
+ pm=importlib.util.module_from_spec(spec);spec.loader.exec_module(pm)
8
+ spec=importlib.util.spec_from_file_location('_features',Path(__file__).with_name('features.py'))
9
+ f=importlib.util.module_from_spec(spec);spec.loader.exec_module(f)
10
+ spec=importlib.util.spec_from_file_location('_cue',Path(__file__).with_name('cue_localization.py'))
11
+ cl=importlib.util.module_from_spec(spec);spec.loader.exec_module(cl)
12
+ _bank=None
13
+ _phase=0.
14
+ _ref=None
15
+ _bad=0
16
+
17
+ def reset_episode():
18
+ global _phase,_ref,_bad
19
+ _phase=0.;_ref=None;_bad=0
20
+
21
+ def act(obs):
22
+ global _bank,_phase,_ref,_bad
23
+ step=int(obs['step_id'])
24
+ if step>=400:return None
25
+ if _bank is None:
26
+ with np.load(Path(__file__).with_name('demo_bank.npz')) as z:_bank={k:z[k] for k in z.files}
27
+ b=_bank
28
+ q=np.concatenate([np.asarray(obs['proprioception'][f'agent/mobile_panda-{r}/qpos']).reshape(-1) for r in range(2)])
29
+ if _ref is None:
30
+ visual=np.stack([f.image_feature(obs['rgb'][c]) for c in f.CAMERAS]);ids=np.where(b['frame']==0)[0]
31
+ cost=np.mean((b['images'][ids].astype(float)-visual)**2,axis=(1,2))
32
+ cue=cl.cue(obs['rgb']['top_camera'])
33
+ if cue is not None:
34
+ cost=np.sum((np.load(Path(__file__).with_name('cue_reference.npy'))-cue)**2,axis=1)
35
+ _ref=int(b['demo_id'][ids[np.argmin(cost)]])
36
+ ids=np.where(b['demo_id']==_ref)[0];t=min(int((step-1)*len(ids)/360),len(ids)-2);j=ids[t];jn=ids[t+1]
37
+ _phase=min(step/360.,.999)
38
+ a=b['a'][j].astype(float).copy()
39
+ for r in range(2):
40
+ actual=pm.fk(q[r*12+3:r*12+10]);target=pm.fk(b['q'][jn,r*12+3:r*12+10])
41
+ heading=Rotation.from_euler('z',q[r*12+2]).as_matrix()
42
+ delta=heading@(target[:3,3]-actual[:3,3])/.1
43
+ rot=Rotation.from_matrix(heading@target[:3,:3]@actual[:3,:3].T@heading.T).as_euler('xyz')/-.5
44
+ if r==0:
45
+ a[r*10+3:r*10+6]=np.clip(delta,-1.,1.)
46
+ a[r*10+6:r*10+9]=np.clip(rot,-.35,.35)
47
+ else:
48
+ current_ref=pm.fk(b['q'][j,r*12+3:r*12+10])
49
+ correction=heading@(current_ref[:3,3]-actual[:3,3])/.1
50
+ a[r*10+3:r*10+6]+=np.clip(.4*correction,-.12,.12)
51
+ a[r*10+3:r*10+10]=np.clip(a[r*10+3:r*10+10],-1,1)
52
+ return a.astype(np.float32)
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/cue_localization.py ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import cv2,numpy as np
2
+ def cue(image):
3
+ im=cv2.resize(np.asarray(image),(640,480)).astype(float)
4
+ r,g,b=im[:,:,0],im[:,:,1],im[:,:,2]
5
+ mask=(r>1.08*g)&(g>1.15*b)&(r>85)
6
+ mask[:185]=False;mask[270:]=False;mask[:,:120]=False;mask[:,375:]=False
7
+ ys,xs=np.where(mask)
8
+ if len(xs)<50:return None
9
+ # robust line fit in normalized camera coordinates, no world projection.
10
+ line=cv2.fitLine(np.c_[xs,ys].astype(np.float32),cv2.DIST_HUBER,0,0.01,0.01).reshape(-1)
11
+ vx,vy,x,y=line
12
+ return np.array([y+vy/vx*(150-x),y+vy/vx*(350-x)])/480.
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/demo_manifest.json ADDED
@@ -0,0 +1,2168 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "task_id": "DualArmBilliardBridge-v1",
3
+ "status": "released",
4
+ "selection_rule": "prefer existing pinned D20, otherwise numeric trajectory ID sort before reading data",
5
+ "lineage_status": "pinned_comparator",
6
+ "episodes": [
7
+ {
8
+ "demo_id": "demo_00",
9
+ "file": "demo_00.h5",
10
+ "length": 357,
11
+ "fields": [
12
+ {
13
+ "path": "actions/mobile_panda-0",
14
+ "shape": [
15
+ 357,
16
+ 10
17
+ ],
18
+ "dtype": "float32"
19
+ },
20
+ {
21
+ "path": "actions/mobile_panda-1",
22
+ "shape": [
23
+ 357,
24
+ 10
25
+ ],
26
+ "dtype": "float32"
27
+ },
28
+ {
29
+ "path": "obs/agent/mobile_panda-0/qpos",
30
+ "shape": [
31
+ 358,
32
+ 12
33
+ ],
34
+ "dtype": "float32"
35
+ },
36
+ {
37
+ "path": "obs/agent/mobile_panda-0/qvel",
38
+ "shape": [
39
+ 358,
40
+ 12
41
+ ],
42
+ "dtype": "float32"
43
+ },
44
+ {
45
+ "path": "obs/agent/mobile_panda-1/qpos",
46
+ "shape": [
47
+ 358,
48
+ 12
49
+ ],
50
+ "dtype": "float32"
51
+ },
52
+ {
53
+ "path": "obs/agent/mobile_panda-1/qvel",
54
+ "shape": [
55
+ 358,
56
+ 12
57
+ ],
58
+ "dtype": "float32"
59
+ },
60
+ {
61
+ "path": "obs/sensor_data/front_camera/rgb",
62
+ "shape": [
63
+ 358,
64
+ 240,
65
+ 320,
66
+ 3
67
+ ],
68
+ "dtype": "uint8"
69
+ },
70
+ {
71
+ "path": "obs/sensor_data/left_camera/rgb",
72
+ "shape": [
73
+ 358,
74
+ 240,
75
+ 320,
76
+ 3
77
+ ],
78
+ "dtype": "uint8"
79
+ },
80
+ {
81
+ "path": "obs/sensor_data/robot_camera_0/rgb",
82
+ "shape": [
83
+ 358,
84
+ 240,
85
+ 320,
86
+ 3
87
+ ],
88
+ "dtype": "uint8"
89
+ },
90
+ {
91
+ "path": "obs/sensor_data/robot_camera_1/rgb",
92
+ "shape": [
93
+ 358,
94
+ 240,
95
+ 320,
96
+ 3
97
+ ],
98
+ "dtype": "uint8"
99
+ },
100
+ {
101
+ "path": "obs/sensor_data/top_camera/rgb",
102
+ "shape": [
103
+ 358,
104
+ 320,
105
+ 240,
106
+ 3
107
+ ],
108
+ "dtype": "uint8"
109
+ }
110
+ ],
111
+ "trajectory_sha256": "6d7cec23d7adb0341b6896fa0d8e10ab23254bec17d61241657a59db8e0834aa",
112
+ "source_sha256": "62060716e261e7ad2136cd39ede2f875009dc06b804a91bb8dc53727c939bfdd",
113
+ "view_sha256": "087068db798005dcd9b1b1c3b24a932009693f7b7b96b26b26c83d76bc383818"
114
+ },
115
+ {
116
+ "demo_id": "demo_01",
117
+ "file": "demo_01.h5",
118
+ "length": 365,
119
+ "fields": [
120
+ {
121
+ "path": "actions/mobile_panda-0",
122
+ "shape": [
123
+ 365,
124
+ 10
125
+ ],
126
+ "dtype": "float32"
127
+ },
128
+ {
129
+ "path": "actions/mobile_panda-1",
130
+ "shape": [
131
+ 365,
132
+ 10
133
+ ],
134
+ "dtype": "float32"
135
+ },
136
+ {
137
+ "path": "obs/agent/mobile_panda-0/qpos",
138
+ "shape": [
139
+ 366,
140
+ 12
141
+ ],
142
+ "dtype": "float32"
143
+ },
144
+ {
145
+ "path": "obs/agent/mobile_panda-0/qvel",
146
+ "shape": [
147
+ 366,
148
+ 12
149
+ ],
150
+ "dtype": "float32"
151
+ },
152
+ {
153
+ "path": "obs/agent/mobile_panda-1/qpos",
154
+ "shape": [
155
+ 366,
156
+ 12
157
+ ],
158
+ "dtype": "float32"
159
+ },
160
+ {
161
+ "path": "obs/agent/mobile_panda-1/qvel",
162
+ "shape": [
163
+ 366,
164
+ 12
165
+ ],
166
+ "dtype": "float32"
167
+ },
168
+ {
169
+ "path": "obs/sensor_data/front_camera/rgb",
170
+ "shape": [
171
+ 366,
172
+ 240,
173
+ 320,
174
+ 3
175
+ ],
176
+ "dtype": "uint8"
177
+ },
178
+ {
179
+ "path": "obs/sensor_data/left_camera/rgb",
180
+ "shape": [
181
+ 366,
182
+ 240,
183
+ 320,
184
+ 3
185
+ ],
186
+ "dtype": "uint8"
187
+ },
188
+ {
189
+ "path": "obs/sensor_data/robot_camera_0/rgb",
190
+ "shape": [
191
+ 366,
192
+ 240,
193
+ 320,
194
+ 3
195
+ ],
196
+ "dtype": "uint8"
197
+ },
198
+ {
199
+ "path": "obs/sensor_data/robot_camera_1/rgb",
200
+ "shape": [
201
+ 366,
202
+ 240,
203
+ 320,
204
+ 3
205
+ ],
206
+ "dtype": "uint8"
207
+ },
208
+ {
209
+ "path": "obs/sensor_data/top_camera/rgb",
210
+ "shape": [
211
+ 366,
212
+ 320,
213
+ 240,
214
+ 3
215
+ ],
216
+ "dtype": "uint8"
217
+ }
218
+ ],
219
+ "trajectory_sha256": "ee87aef9aefa2dc9212ec91d544e67df9e4f80de7284f422fb5fb83635ffc237",
220
+ "source_sha256": "88b7303317f0a159781cc72085d690a2224ef496e67a5a75537e24f4254fc1fa",
221
+ "view_sha256": "ec25c750ff2f06c6380d697eecda8a6e6f2876290e4afcc639258112816a80e4"
222
+ },
223
+ {
224
+ "demo_id": "demo_02",
225
+ "file": "demo_02.h5",
226
+ "length": 358,
227
+ "fields": [
228
+ {
229
+ "path": "actions/mobile_panda-0",
230
+ "shape": [
231
+ 358,
232
+ 10
233
+ ],
234
+ "dtype": "float32"
235
+ },
236
+ {
237
+ "path": "actions/mobile_panda-1",
238
+ "shape": [
239
+ 358,
240
+ 10
241
+ ],
242
+ "dtype": "float32"
243
+ },
244
+ {
245
+ "path": "obs/agent/mobile_panda-0/qpos",
246
+ "shape": [
247
+ 359,
248
+ 12
249
+ ],
250
+ "dtype": "float32"
251
+ },
252
+ {
253
+ "path": "obs/agent/mobile_panda-0/qvel",
254
+ "shape": [
255
+ 359,
256
+ 12
257
+ ],
258
+ "dtype": "float32"
259
+ },
260
+ {
261
+ "path": "obs/agent/mobile_panda-1/qpos",
262
+ "shape": [
263
+ 359,
264
+ 12
265
+ ],
266
+ "dtype": "float32"
267
+ },
268
+ {
269
+ "path": "obs/agent/mobile_panda-1/qvel",
270
+ "shape": [
271
+ 359,
272
+ 12
273
+ ],
274
+ "dtype": "float32"
275
+ },
276
+ {
277
+ "path": "obs/sensor_data/front_camera/rgb",
278
+ "shape": [
279
+ 359,
280
+ 240,
281
+ 320,
282
+ 3
283
+ ],
284
+ "dtype": "uint8"
285
+ },
286
+ {
287
+ "path": "obs/sensor_data/left_camera/rgb",
288
+ "shape": [
289
+ 359,
290
+ 240,
291
+ 320,
292
+ 3
293
+ ],
294
+ "dtype": "uint8"
295
+ },
296
+ {
297
+ "path": "obs/sensor_data/robot_camera_0/rgb",
298
+ "shape": [
299
+ 359,
300
+ 240,
301
+ 320,
302
+ 3
303
+ ],
304
+ "dtype": "uint8"
305
+ },
306
+ {
307
+ "path": "obs/sensor_data/robot_camera_1/rgb",
308
+ "shape": [
309
+ 359,
310
+ 240,
311
+ 320,
312
+ 3
313
+ ],
314
+ "dtype": "uint8"
315
+ },
316
+ {
317
+ "path": "obs/sensor_data/top_camera/rgb",
318
+ "shape": [
319
+ 359,
320
+ 320,
321
+ 240,
322
+ 3
323
+ ],
324
+ "dtype": "uint8"
325
+ }
326
+ ],
327
+ "trajectory_sha256": "98de4646c1d243f78f02906c7f3f001949360f9025045181b790ad8717403cd4",
328
+ "source_sha256": "103d89cbd18e1f74038ff22a7ce87c03a823844557e40da3a08586bbaff81ab7",
329
+ "view_sha256": "42f827e0eb15d779311f61a6ec10b772cce2905b9193a665bd250793279bc6b5"
330
+ },
331
+ {
332
+ "demo_id": "demo_03",
333
+ "file": "demo_03.h5",
334
+ "length": 357,
335
+ "fields": [
336
+ {
337
+ "path": "actions/mobile_panda-0",
338
+ "shape": [
339
+ 357,
340
+ 10
341
+ ],
342
+ "dtype": "float32"
343
+ },
344
+ {
345
+ "path": "actions/mobile_panda-1",
346
+ "shape": [
347
+ 357,
348
+ 10
349
+ ],
350
+ "dtype": "float32"
351
+ },
352
+ {
353
+ "path": "obs/agent/mobile_panda-0/qpos",
354
+ "shape": [
355
+ 358,
356
+ 12
357
+ ],
358
+ "dtype": "float32"
359
+ },
360
+ {
361
+ "path": "obs/agent/mobile_panda-0/qvel",
362
+ "shape": [
363
+ 358,
364
+ 12
365
+ ],
366
+ "dtype": "float32"
367
+ },
368
+ {
369
+ "path": "obs/agent/mobile_panda-1/qpos",
370
+ "shape": [
371
+ 358,
372
+ 12
373
+ ],
374
+ "dtype": "float32"
375
+ },
376
+ {
377
+ "path": "obs/agent/mobile_panda-1/qvel",
378
+ "shape": [
379
+ 358,
380
+ 12
381
+ ],
382
+ "dtype": "float32"
383
+ },
384
+ {
385
+ "path": "obs/sensor_data/front_camera/rgb",
386
+ "shape": [
387
+ 358,
388
+ 240,
389
+ 320,
390
+ 3
391
+ ],
392
+ "dtype": "uint8"
393
+ },
394
+ {
395
+ "path": "obs/sensor_data/left_camera/rgb",
396
+ "shape": [
397
+ 358,
398
+ 240,
399
+ 320,
400
+ 3
401
+ ],
402
+ "dtype": "uint8"
403
+ },
404
+ {
405
+ "path": "obs/sensor_data/robot_camera_0/rgb",
406
+ "shape": [
407
+ 358,
408
+ 240,
409
+ 320,
410
+ 3
411
+ ],
412
+ "dtype": "uint8"
413
+ },
414
+ {
415
+ "path": "obs/sensor_data/robot_camera_1/rgb",
416
+ "shape": [
417
+ 358,
418
+ 240,
419
+ 320,
420
+ 3
421
+ ],
422
+ "dtype": "uint8"
423
+ },
424
+ {
425
+ "path": "obs/sensor_data/top_camera/rgb",
426
+ "shape": [
427
+ 358,
428
+ 320,
429
+ 240,
430
+ 3
431
+ ],
432
+ "dtype": "uint8"
433
+ }
434
+ ],
435
+ "trajectory_sha256": "bde1883ca6edbbd7b67c687ee360466fa8c94905b43e25550856dbe96cd366f0",
436
+ "source_sha256": "02bdb61c5772483db6f2d00888da662c909b8e392abedb562441747b5816e048",
437
+ "view_sha256": "8932b625c7da5e356057a8c4cd6eab2c044079eda2b9b93ac3c3f1080b3e072e"
438
+ },
439
+ {
440
+ "demo_id": "demo_04",
441
+ "file": "demo_04.h5",
442
+ "length": 358,
443
+ "fields": [
444
+ {
445
+ "path": "actions/mobile_panda-0",
446
+ "shape": [
447
+ 358,
448
+ 10
449
+ ],
450
+ "dtype": "float32"
451
+ },
452
+ {
453
+ "path": "actions/mobile_panda-1",
454
+ "shape": [
455
+ 358,
456
+ 10
457
+ ],
458
+ "dtype": "float32"
459
+ },
460
+ {
461
+ "path": "obs/agent/mobile_panda-0/qpos",
462
+ "shape": [
463
+ 359,
464
+ 12
465
+ ],
466
+ "dtype": "float32"
467
+ },
468
+ {
469
+ "path": "obs/agent/mobile_panda-0/qvel",
470
+ "shape": [
471
+ 359,
472
+ 12
473
+ ],
474
+ "dtype": "float32"
475
+ },
476
+ {
477
+ "path": "obs/agent/mobile_panda-1/qpos",
478
+ "shape": [
479
+ 359,
480
+ 12
481
+ ],
482
+ "dtype": "float32"
483
+ },
484
+ {
485
+ "path": "obs/agent/mobile_panda-1/qvel",
486
+ "shape": [
487
+ 359,
488
+ 12
489
+ ],
490
+ "dtype": "float32"
491
+ },
492
+ {
493
+ "path": "obs/sensor_data/front_camera/rgb",
494
+ "shape": [
495
+ 359,
496
+ 240,
497
+ 320,
498
+ 3
499
+ ],
500
+ "dtype": "uint8"
501
+ },
502
+ {
503
+ "path": "obs/sensor_data/left_camera/rgb",
504
+ "shape": [
505
+ 359,
506
+ 240,
507
+ 320,
508
+ 3
509
+ ],
510
+ "dtype": "uint8"
511
+ },
512
+ {
513
+ "path": "obs/sensor_data/robot_camera_0/rgb",
514
+ "shape": [
515
+ 359,
516
+ 240,
517
+ 320,
518
+ 3
519
+ ],
520
+ "dtype": "uint8"
521
+ },
522
+ {
523
+ "path": "obs/sensor_data/robot_camera_1/rgb",
524
+ "shape": [
525
+ 359,
526
+ 240,
527
+ 320,
528
+ 3
529
+ ],
530
+ "dtype": "uint8"
531
+ },
532
+ {
533
+ "path": "obs/sensor_data/top_camera/rgb",
534
+ "shape": [
535
+ 359,
536
+ 320,
537
+ 240,
538
+ 3
539
+ ],
540
+ "dtype": "uint8"
541
+ }
542
+ ],
543
+ "trajectory_sha256": "6bea003e0a91d9f4f119c01a53ac1b67af4e8142eaa1a49754a7f28aed8f2a4b",
544
+ "source_sha256": "3dd3ecc346ebf83a1578ffc741c7f34700a5c0ed61e16c486495f02d5dafb685",
545
+ "view_sha256": "064f73c4e11ce8f724349c73e93a51cad7e0674e922f47ac7fe7a88965ab62c2"
546
+ },
547
+ {
548
+ "demo_id": "demo_05",
549
+ "file": "demo_05.h5",
550
+ "length": 357,
551
+ "fields": [
552
+ {
553
+ "path": "actions/mobile_panda-0",
554
+ "shape": [
555
+ 357,
556
+ 10
557
+ ],
558
+ "dtype": "float32"
559
+ },
560
+ {
561
+ "path": "actions/mobile_panda-1",
562
+ "shape": [
563
+ 357,
564
+ 10
565
+ ],
566
+ "dtype": "float32"
567
+ },
568
+ {
569
+ "path": "obs/agent/mobile_panda-0/qpos",
570
+ "shape": [
571
+ 358,
572
+ 12
573
+ ],
574
+ "dtype": "float32"
575
+ },
576
+ {
577
+ "path": "obs/agent/mobile_panda-0/qvel",
578
+ "shape": [
579
+ 358,
580
+ 12
581
+ ],
582
+ "dtype": "float32"
583
+ },
584
+ {
585
+ "path": "obs/agent/mobile_panda-1/qpos",
586
+ "shape": [
587
+ 358,
588
+ 12
589
+ ],
590
+ "dtype": "float32"
591
+ },
592
+ {
593
+ "path": "obs/agent/mobile_panda-1/qvel",
594
+ "shape": [
595
+ 358,
596
+ 12
597
+ ],
598
+ "dtype": "float32"
599
+ },
600
+ {
601
+ "path": "obs/sensor_data/front_camera/rgb",
602
+ "shape": [
603
+ 358,
604
+ 240,
605
+ 320,
606
+ 3
607
+ ],
608
+ "dtype": "uint8"
609
+ },
610
+ {
611
+ "path": "obs/sensor_data/left_camera/rgb",
612
+ "shape": [
613
+ 358,
614
+ 240,
615
+ 320,
616
+ 3
617
+ ],
618
+ "dtype": "uint8"
619
+ },
620
+ {
621
+ "path": "obs/sensor_data/robot_camera_0/rgb",
622
+ "shape": [
623
+ 358,
624
+ 240,
625
+ 320,
626
+ 3
627
+ ],
628
+ "dtype": "uint8"
629
+ },
630
+ {
631
+ "path": "obs/sensor_data/robot_camera_1/rgb",
632
+ "shape": [
633
+ 358,
634
+ 240,
635
+ 320,
636
+ 3
637
+ ],
638
+ "dtype": "uint8"
639
+ },
640
+ {
641
+ "path": "obs/sensor_data/top_camera/rgb",
642
+ "shape": [
643
+ 358,
644
+ 320,
645
+ 240,
646
+ 3
647
+ ],
648
+ "dtype": "uint8"
649
+ }
650
+ ],
651
+ "trajectory_sha256": "5e194000ff5dd28a95baab882af4ad43e890ad06a232109b1c1b2c2d019d8f42",
652
+ "source_sha256": "aeb166ba9564ca2dad52c528a21b7a1d30334e13fcbc6a4e03c0bf6299c25be6",
653
+ "view_sha256": "8651ab797a885ebd75fabc470c776d7c59cc5c361c7fd3e5904c21931bb635ac"
654
+ },
655
+ {
656
+ "demo_id": "demo_06",
657
+ "file": "demo_06.h5",
658
+ "length": 365,
659
+ "fields": [
660
+ {
661
+ "path": "actions/mobile_panda-0",
662
+ "shape": [
663
+ 365,
664
+ 10
665
+ ],
666
+ "dtype": "float32"
667
+ },
668
+ {
669
+ "path": "actions/mobile_panda-1",
670
+ "shape": [
671
+ 365,
672
+ 10
673
+ ],
674
+ "dtype": "float32"
675
+ },
676
+ {
677
+ "path": "obs/agent/mobile_panda-0/qpos",
678
+ "shape": [
679
+ 366,
680
+ 12
681
+ ],
682
+ "dtype": "float32"
683
+ },
684
+ {
685
+ "path": "obs/agent/mobile_panda-0/qvel",
686
+ "shape": [
687
+ 366,
688
+ 12
689
+ ],
690
+ "dtype": "float32"
691
+ },
692
+ {
693
+ "path": "obs/agent/mobile_panda-1/qpos",
694
+ "shape": [
695
+ 366,
696
+ 12
697
+ ],
698
+ "dtype": "float32"
699
+ },
700
+ {
701
+ "path": "obs/agent/mobile_panda-1/qvel",
702
+ "shape": [
703
+ 366,
704
+ 12
705
+ ],
706
+ "dtype": "float32"
707
+ },
708
+ {
709
+ "path": "obs/sensor_data/front_camera/rgb",
710
+ "shape": [
711
+ 366,
712
+ 240,
713
+ 320,
714
+ 3
715
+ ],
716
+ "dtype": "uint8"
717
+ },
718
+ {
719
+ "path": "obs/sensor_data/left_camera/rgb",
720
+ "shape": [
721
+ 366,
722
+ 240,
723
+ 320,
724
+ 3
725
+ ],
726
+ "dtype": "uint8"
727
+ },
728
+ {
729
+ "path": "obs/sensor_data/robot_camera_0/rgb",
730
+ "shape": [
731
+ 366,
732
+ 240,
733
+ 320,
734
+ 3
735
+ ],
736
+ "dtype": "uint8"
737
+ },
738
+ {
739
+ "path": "obs/sensor_data/robot_camera_1/rgb",
740
+ "shape": [
741
+ 366,
742
+ 240,
743
+ 320,
744
+ 3
745
+ ],
746
+ "dtype": "uint8"
747
+ },
748
+ {
749
+ "path": "obs/sensor_data/top_camera/rgb",
750
+ "shape": [
751
+ 366,
752
+ 320,
753
+ 240,
754
+ 3
755
+ ],
756
+ "dtype": "uint8"
757
+ }
758
+ ],
759
+ "trajectory_sha256": "4b584799da2383a30a4936205f0cb0954a7ecb74be8ba7d67b605831298516ac",
760
+ "source_sha256": "07092eb7eb50449e2ffa7ac4cef0b695e78f0b4678cbf7ad16a5a89a036b6b52",
761
+ "view_sha256": "487b27d57ebb0039cc89e32960eea33e673eafdcb611a9b19cfdd0f54dcb2ec9"
762
+ },
763
+ {
764
+ "demo_id": "demo_07",
765
+ "file": "demo_07.h5",
766
+ "length": 358,
767
+ "fields": [
768
+ {
769
+ "path": "actions/mobile_panda-0",
770
+ "shape": [
771
+ 358,
772
+ 10
773
+ ],
774
+ "dtype": "float32"
775
+ },
776
+ {
777
+ "path": "actions/mobile_panda-1",
778
+ "shape": [
779
+ 358,
780
+ 10
781
+ ],
782
+ "dtype": "float32"
783
+ },
784
+ {
785
+ "path": "obs/agent/mobile_panda-0/qpos",
786
+ "shape": [
787
+ 359,
788
+ 12
789
+ ],
790
+ "dtype": "float32"
791
+ },
792
+ {
793
+ "path": "obs/agent/mobile_panda-0/qvel",
794
+ "shape": [
795
+ 359,
796
+ 12
797
+ ],
798
+ "dtype": "float32"
799
+ },
800
+ {
801
+ "path": "obs/agent/mobile_panda-1/qpos",
802
+ "shape": [
803
+ 359,
804
+ 12
805
+ ],
806
+ "dtype": "float32"
807
+ },
808
+ {
809
+ "path": "obs/agent/mobile_panda-1/qvel",
810
+ "shape": [
811
+ 359,
812
+ 12
813
+ ],
814
+ "dtype": "float32"
815
+ },
816
+ {
817
+ "path": "obs/sensor_data/front_camera/rgb",
818
+ "shape": [
819
+ 359,
820
+ 240,
821
+ 320,
822
+ 3
823
+ ],
824
+ "dtype": "uint8"
825
+ },
826
+ {
827
+ "path": "obs/sensor_data/left_camera/rgb",
828
+ "shape": [
829
+ 359,
830
+ 240,
831
+ 320,
832
+ 3
833
+ ],
834
+ "dtype": "uint8"
835
+ },
836
+ {
837
+ "path": "obs/sensor_data/robot_camera_0/rgb",
838
+ "shape": [
839
+ 359,
840
+ 240,
841
+ 320,
842
+ 3
843
+ ],
844
+ "dtype": "uint8"
845
+ },
846
+ {
847
+ "path": "obs/sensor_data/robot_camera_1/rgb",
848
+ "shape": [
849
+ 359,
850
+ 240,
851
+ 320,
852
+ 3
853
+ ],
854
+ "dtype": "uint8"
855
+ },
856
+ {
857
+ "path": "obs/sensor_data/top_camera/rgb",
858
+ "shape": [
859
+ 359,
860
+ 320,
861
+ 240,
862
+ 3
863
+ ],
864
+ "dtype": "uint8"
865
+ }
866
+ ],
867
+ "trajectory_sha256": "9131dbd221410b8017c0d519d15470e8e487cd099044a7645faec3c9cec22de9",
868
+ "source_sha256": "8e17085dc6a7ee41d99e8ccf6b7bb543399431b594cf6caf910b6ee6f1addc1c",
869
+ "view_sha256": "49ff958d6d14cb60215426a96d3436ec92f0dd524a3f52dcd33a9dae314b0685"
870
+ },
871
+ {
872
+ "demo_id": "demo_08",
873
+ "file": "demo_08.h5",
874
+ "length": 357,
875
+ "fields": [
876
+ {
877
+ "path": "actions/mobile_panda-0",
878
+ "shape": [
879
+ 357,
880
+ 10
881
+ ],
882
+ "dtype": "float32"
883
+ },
884
+ {
885
+ "path": "actions/mobile_panda-1",
886
+ "shape": [
887
+ 357,
888
+ 10
889
+ ],
890
+ "dtype": "float32"
891
+ },
892
+ {
893
+ "path": "obs/agent/mobile_panda-0/qpos",
894
+ "shape": [
895
+ 358,
896
+ 12
897
+ ],
898
+ "dtype": "float32"
899
+ },
900
+ {
901
+ "path": "obs/agent/mobile_panda-0/qvel",
902
+ "shape": [
903
+ 358,
904
+ 12
905
+ ],
906
+ "dtype": "float32"
907
+ },
908
+ {
909
+ "path": "obs/agent/mobile_panda-1/qpos",
910
+ "shape": [
911
+ 358,
912
+ 12
913
+ ],
914
+ "dtype": "float32"
915
+ },
916
+ {
917
+ "path": "obs/agent/mobile_panda-1/qvel",
918
+ "shape": [
919
+ 358,
920
+ 12
921
+ ],
922
+ "dtype": "float32"
923
+ },
924
+ {
925
+ "path": "obs/sensor_data/front_camera/rgb",
926
+ "shape": [
927
+ 358,
928
+ 240,
929
+ 320,
930
+ 3
931
+ ],
932
+ "dtype": "uint8"
933
+ },
934
+ {
935
+ "path": "obs/sensor_data/left_camera/rgb",
936
+ "shape": [
937
+ 358,
938
+ 240,
939
+ 320,
940
+ 3
941
+ ],
942
+ "dtype": "uint8"
943
+ },
944
+ {
945
+ "path": "obs/sensor_data/robot_camera_0/rgb",
946
+ "shape": [
947
+ 358,
948
+ 240,
949
+ 320,
950
+ 3
951
+ ],
952
+ "dtype": "uint8"
953
+ },
954
+ {
955
+ "path": "obs/sensor_data/robot_camera_1/rgb",
956
+ "shape": [
957
+ 358,
958
+ 240,
959
+ 320,
960
+ 3
961
+ ],
962
+ "dtype": "uint8"
963
+ },
964
+ {
965
+ "path": "obs/sensor_data/top_camera/rgb",
966
+ "shape": [
967
+ 358,
968
+ 320,
969
+ 240,
970
+ 3
971
+ ],
972
+ "dtype": "uint8"
973
+ }
974
+ ],
975
+ "trajectory_sha256": "408ad46eba31be91e25370735290cddb85538c95c3eaad66b88bda3444a23d2e",
976
+ "source_sha256": "7ae0c9ef0db2cebecbae53b97e95eafd6362b21710b27716ee1b73855b16b7e2",
977
+ "view_sha256": "b4df437af648143f9efbe3396a0ee2fe1ac650911f3d2bf1ee906ee554874bb5"
978
+ },
979
+ {
980
+ "demo_id": "demo_09",
981
+ "file": "demo_09.h5",
982
+ "length": 358,
983
+ "fields": [
984
+ {
985
+ "path": "actions/mobile_panda-0",
986
+ "shape": [
987
+ 358,
988
+ 10
989
+ ],
990
+ "dtype": "float32"
991
+ },
992
+ {
993
+ "path": "actions/mobile_panda-1",
994
+ "shape": [
995
+ 358,
996
+ 10
997
+ ],
998
+ "dtype": "float32"
999
+ },
1000
+ {
1001
+ "path": "obs/agent/mobile_panda-0/qpos",
1002
+ "shape": [
1003
+ 359,
1004
+ 12
1005
+ ],
1006
+ "dtype": "float32"
1007
+ },
1008
+ {
1009
+ "path": "obs/agent/mobile_panda-0/qvel",
1010
+ "shape": [
1011
+ 359,
1012
+ 12
1013
+ ],
1014
+ "dtype": "float32"
1015
+ },
1016
+ {
1017
+ "path": "obs/agent/mobile_panda-1/qpos",
1018
+ "shape": [
1019
+ 359,
1020
+ 12
1021
+ ],
1022
+ "dtype": "float32"
1023
+ },
1024
+ {
1025
+ "path": "obs/agent/mobile_panda-1/qvel",
1026
+ "shape": [
1027
+ 359,
1028
+ 12
1029
+ ],
1030
+ "dtype": "float32"
1031
+ },
1032
+ {
1033
+ "path": "obs/sensor_data/front_camera/rgb",
1034
+ "shape": [
1035
+ 359,
1036
+ 240,
1037
+ 320,
1038
+ 3
1039
+ ],
1040
+ "dtype": "uint8"
1041
+ },
1042
+ {
1043
+ "path": "obs/sensor_data/left_camera/rgb",
1044
+ "shape": [
1045
+ 359,
1046
+ 240,
1047
+ 320,
1048
+ 3
1049
+ ],
1050
+ "dtype": "uint8"
1051
+ },
1052
+ {
1053
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1054
+ "shape": [
1055
+ 359,
1056
+ 240,
1057
+ 320,
1058
+ 3
1059
+ ],
1060
+ "dtype": "uint8"
1061
+ },
1062
+ {
1063
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1064
+ "shape": [
1065
+ 359,
1066
+ 240,
1067
+ 320,
1068
+ 3
1069
+ ],
1070
+ "dtype": "uint8"
1071
+ },
1072
+ {
1073
+ "path": "obs/sensor_data/top_camera/rgb",
1074
+ "shape": [
1075
+ 359,
1076
+ 320,
1077
+ 240,
1078
+ 3
1079
+ ],
1080
+ "dtype": "uint8"
1081
+ }
1082
+ ],
1083
+ "trajectory_sha256": "d111daa15102d29750a9e38e3ce1b2fae55a2fe68471e4612ee1fc7e34eb836e",
1084
+ "source_sha256": "5106ef0fa8a0fe87a89abefc52830ea4c8ac8012bb1c9cc215dcc0cbd214fb14",
1085
+ "view_sha256": "01e97092351b67a8f975b726d38526c0f44f82d6e2521c843cfac8b48104a623"
1086
+ },
1087
+ {
1088
+ "demo_id": "demo_10",
1089
+ "file": "demo_10.h5",
1090
+ "length": 352,
1091
+ "fields": [
1092
+ {
1093
+ "path": "actions/mobile_panda-0",
1094
+ "shape": [
1095
+ 352,
1096
+ 10
1097
+ ],
1098
+ "dtype": "float32"
1099
+ },
1100
+ {
1101
+ "path": "actions/mobile_panda-1",
1102
+ "shape": [
1103
+ 352,
1104
+ 10
1105
+ ],
1106
+ "dtype": "float32"
1107
+ },
1108
+ {
1109
+ "path": "obs/agent/mobile_panda-0/qpos",
1110
+ "shape": [
1111
+ 353,
1112
+ 12
1113
+ ],
1114
+ "dtype": "float32"
1115
+ },
1116
+ {
1117
+ "path": "obs/agent/mobile_panda-0/qvel",
1118
+ "shape": [
1119
+ 353,
1120
+ 12
1121
+ ],
1122
+ "dtype": "float32"
1123
+ },
1124
+ {
1125
+ "path": "obs/agent/mobile_panda-1/qpos",
1126
+ "shape": [
1127
+ 353,
1128
+ 12
1129
+ ],
1130
+ "dtype": "float32"
1131
+ },
1132
+ {
1133
+ "path": "obs/agent/mobile_panda-1/qvel",
1134
+ "shape": [
1135
+ 353,
1136
+ 12
1137
+ ],
1138
+ "dtype": "float32"
1139
+ },
1140
+ {
1141
+ "path": "obs/sensor_data/front_camera/rgb",
1142
+ "shape": [
1143
+ 353,
1144
+ 240,
1145
+ 320,
1146
+ 3
1147
+ ],
1148
+ "dtype": "uint8"
1149
+ },
1150
+ {
1151
+ "path": "obs/sensor_data/left_camera/rgb",
1152
+ "shape": [
1153
+ 353,
1154
+ 240,
1155
+ 320,
1156
+ 3
1157
+ ],
1158
+ "dtype": "uint8"
1159
+ },
1160
+ {
1161
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1162
+ "shape": [
1163
+ 353,
1164
+ 240,
1165
+ 320,
1166
+ 3
1167
+ ],
1168
+ "dtype": "uint8"
1169
+ },
1170
+ {
1171
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1172
+ "shape": [
1173
+ 353,
1174
+ 240,
1175
+ 320,
1176
+ 3
1177
+ ],
1178
+ "dtype": "uint8"
1179
+ },
1180
+ {
1181
+ "path": "obs/sensor_data/top_camera/rgb",
1182
+ "shape": [
1183
+ 353,
1184
+ 320,
1185
+ 240,
1186
+ 3
1187
+ ],
1188
+ "dtype": "uint8"
1189
+ }
1190
+ ],
1191
+ "trajectory_sha256": "0e39ab874164bc7de8b2bb5c64cf3e94d51c4305e4749c559e3e13566be25df6",
1192
+ "source_sha256": "58921dc7b3ef5b4c8d914076f7ebe984859e2a78b3135828f4e0860dffec4d19",
1193
+ "view_sha256": "f7675364397903682722daf84d305081def9b850e5ab3d6066dee844b4abd20a"
1194
+ },
1195
+ {
1196
+ "demo_id": "demo_11",
1197
+ "file": "demo_11.h5",
1198
+ "length": 350,
1199
+ "fields": [
1200
+ {
1201
+ "path": "actions/mobile_panda-0",
1202
+ "shape": [
1203
+ 350,
1204
+ 10
1205
+ ],
1206
+ "dtype": "float32"
1207
+ },
1208
+ {
1209
+ "path": "actions/mobile_panda-1",
1210
+ "shape": [
1211
+ 350,
1212
+ 10
1213
+ ],
1214
+ "dtype": "float32"
1215
+ },
1216
+ {
1217
+ "path": "obs/agent/mobile_panda-0/qpos",
1218
+ "shape": [
1219
+ 351,
1220
+ 12
1221
+ ],
1222
+ "dtype": "float32"
1223
+ },
1224
+ {
1225
+ "path": "obs/agent/mobile_panda-0/qvel",
1226
+ "shape": [
1227
+ 351,
1228
+ 12
1229
+ ],
1230
+ "dtype": "float32"
1231
+ },
1232
+ {
1233
+ "path": "obs/agent/mobile_panda-1/qpos",
1234
+ "shape": [
1235
+ 351,
1236
+ 12
1237
+ ],
1238
+ "dtype": "float32"
1239
+ },
1240
+ {
1241
+ "path": "obs/agent/mobile_panda-1/qvel",
1242
+ "shape": [
1243
+ 351,
1244
+ 12
1245
+ ],
1246
+ "dtype": "float32"
1247
+ },
1248
+ {
1249
+ "path": "obs/sensor_data/front_camera/rgb",
1250
+ "shape": [
1251
+ 351,
1252
+ 240,
1253
+ 320,
1254
+ 3
1255
+ ],
1256
+ "dtype": "uint8"
1257
+ },
1258
+ {
1259
+ "path": "obs/sensor_data/left_camera/rgb",
1260
+ "shape": [
1261
+ 351,
1262
+ 240,
1263
+ 320,
1264
+ 3
1265
+ ],
1266
+ "dtype": "uint8"
1267
+ },
1268
+ {
1269
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1270
+ "shape": [
1271
+ 351,
1272
+ 240,
1273
+ 320,
1274
+ 3
1275
+ ],
1276
+ "dtype": "uint8"
1277
+ },
1278
+ {
1279
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1280
+ "shape": [
1281
+ 351,
1282
+ 240,
1283
+ 320,
1284
+ 3
1285
+ ],
1286
+ "dtype": "uint8"
1287
+ },
1288
+ {
1289
+ "path": "obs/sensor_data/top_camera/rgb",
1290
+ "shape": [
1291
+ 351,
1292
+ 320,
1293
+ 240,
1294
+ 3
1295
+ ],
1296
+ "dtype": "uint8"
1297
+ }
1298
+ ],
1299
+ "trajectory_sha256": "e689f5e156bf105c349327e93926ffce85cd74afd9c6846613a5100a878743d7",
1300
+ "source_sha256": "dcd108752c88ea745c93b26af8dc1b7dee7f6103d8054e2d6eea0de8395ce3b4",
1301
+ "view_sha256": "2ed935b7425eeefb46aee78b0760872aa9a28b4e5e9f7a9396f540f79068954b"
1302
+ },
1303
+ {
1304
+ "demo_id": "demo_12",
1305
+ "file": "demo_12.h5",
1306
+ "length": 361,
1307
+ "fields": [
1308
+ {
1309
+ "path": "actions/mobile_panda-0",
1310
+ "shape": [
1311
+ 361,
1312
+ 10
1313
+ ],
1314
+ "dtype": "float32"
1315
+ },
1316
+ {
1317
+ "path": "actions/mobile_panda-1",
1318
+ "shape": [
1319
+ 361,
1320
+ 10
1321
+ ],
1322
+ "dtype": "float32"
1323
+ },
1324
+ {
1325
+ "path": "obs/agent/mobile_panda-0/qpos",
1326
+ "shape": [
1327
+ 362,
1328
+ 12
1329
+ ],
1330
+ "dtype": "float32"
1331
+ },
1332
+ {
1333
+ "path": "obs/agent/mobile_panda-0/qvel",
1334
+ "shape": [
1335
+ 362,
1336
+ 12
1337
+ ],
1338
+ "dtype": "float32"
1339
+ },
1340
+ {
1341
+ "path": "obs/agent/mobile_panda-1/qpos",
1342
+ "shape": [
1343
+ 362,
1344
+ 12
1345
+ ],
1346
+ "dtype": "float32"
1347
+ },
1348
+ {
1349
+ "path": "obs/agent/mobile_panda-1/qvel",
1350
+ "shape": [
1351
+ 362,
1352
+ 12
1353
+ ],
1354
+ "dtype": "float32"
1355
+ },
1356
+ {
1357
+ "path": "obs/sensor_data/front_camera/rgb",
1358
+ "shape": [
1359
+ 362,
1360
+ 240,
1361
+ 320,
1362
+ 3
1363
+ ],
1364
+ "dtype": "uint8"
1365
+ },
1366
+ {
1367
+ "path": "obs/sensor_data/left_camera/rgb",
1368
+ "shape": [
1369
+ 362,
1370
+ 240,
1371
+ 320,
1372
+ 3
1373
+ ],
1374
+ "dtype": "uint8"
1375
+ },
1376
+ {
1377
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1378
+ "shape": [
1379
+ 362,
1380
+ 240,
1381
+ 320,
1382
+ 3
1383
+ ],
1384
+ "dtype": "uint8"
1385
+ },
1386
+ {
1387
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1388
+ "shape": [
1389
+ 362,
1390
+ 240,
1391
+ 320,
1392
+ 3
1393
+ ],
1394
+ "dtype": "uint8"
1395
+ },
1396
+ {
1397
+ "path": "obs/sensor_data/top_camera/rgb",
1398
+ "shape": [
1399
+ 362,
1400
+ 320,
1401
+ 240,
1402
+ 3
1403
+ ],
1404
+ "dtype": "uint8"
1405
+ }
1406
+ ],
1407
+ "trajectory_sha256": "054ceb7c993946efc485b43e6f49d801b8aee149601751c41ce31348da8ce9bc",
1408
+ "source_sha256": "b0ff803a6026ff8de46f519750763c4b285f6d8972d0df04f04898434a1755eb",
1409
+ "view_sha256": "928c7509339c2592546da6d3399e44b467c21e8c6edd3e7c4e3853efbef498a4"
1410
+ },
1411
+ {
1412
+ "demo_id": "demo_13",
1413
+ "file": "demo_13.h5",
1414
+ "length": 370,
1415
+ "fields": [
1416
+ {
1417
+ "path": "actions/mobile_panda-0",
1418
+ "shape": [
1419
+ 370,
1420
+ 10
1421
+ ],
1422
+ "dtype": "float32"
1423
+ },
1424
+ {
1425
+ "path": "actions/mobile_panda-1",
1426
+ "shape": [
1427
+ 370,
1428
+ 10
1429
+ ],
1430
+ "dtype": "float32"
1431
+ },
1432
+ {
1433
+ "path": "obs/agent/mobile_panda-0/qpos",
1434
+ "shape": [
1435
+ 371,
1436
+ 12
1437
+ ],
1438
+ "dtype": "float32"
1439
+ },
1440
+ {
1441
+ "path": "obs/agent/mobile_panda-0/qvel",
1442
+ "shape": [
1443
+ 371,
1444
+ 12
1445
+ ],
1446
+ "dtype": "float32"
1447
+ },
1448
+ {
1449
+ "path": "obs/agent/mobile_panda-1/qpos",
1450
+ "shape": [
1451
+ 371,
1452
+ 12
1453
+ ],
1454
+ "dtype": "float32"
1455
+ },
1456
+ {
1457
+ "path": "obs/agent/mobile_panda-1/qvel",
1458
+ "shape": [
1459
+ 371,
1460
+ 12
1461
+ ],
1462
+ "dtype": "float32"
1463
+ },
1464
+ {
1465
+ "path": "obs/sensor_data/front_camera/rgb",
1466
+ "shape": [
1467
+ 371,
1468
+ 240,
1469
+ 320,
1470
+ 3
1471
+ ],
1472
+ "dtype": "uint8"
1473
+ },
1474
+ {
1475
+ "path": "obs/sensor_data/left_camera/rgb",
1476
+ "shape": [
1477
+ 371,
1478
+ 240,
1479
+ 320,
1480
+ 3
1481
+ ],
1482
+ "dtype": "uint8"
1483
+ },
1484
+ {
1485
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1486
+ "shape": [
1487
+ 371,
1488
+ 240,
1489
+ 320,
1490
+ 3
1491
+ ],
1492
+ "dtype": "uint8"
1493
+ },
1494
+ {
1495
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1496
+ "shape": [
1497
+ 371,
1498
+ 240,
1499
+ 320,
1500
+ 3
1501
+ ],
1502
+ "dtype": "uint8"
1503
+ },
1504
+ {
1505
+ "path": "obs/sensor_data/top_camera/rgb",
1506
+ "shape": [
1507
+ 371,
1508
+ 320,
1509
+ 240,
1510
+ 3
1511
+ ],
1512
+ "dtype": "uint8"
1513
+ }
1514
+ ],
1515
+ "trajectory_sha256": "9c633b8493be3ea3fbf26f2a057301d931fe5ca84504631c1ffeef6c9322ff87",
1516
+ "source_sha256": "5982ddf7083e13cb91e6e5e6b159607a9da097c0170a34f313c4565a3f9ec483",
1517
+ "view_sha256": "cc800091ce1ab6bd2f19cae804b1202a8e38cc6688fab4b2b518f56b375fee26"
1518
+ },
1519
+ {
1520
+ "demo_id": "demo_14",
1521
+ "file": "demo_14.h5",
1522
+ "length": 354,
1523
+ "fields": [
1524
+ {
1525
+ "path": "actions/mobile_panda-0",
1526
+ "shape": [
1527
+ 354,
1528
+ 10
1529
+ ],
1530
+ "dtype": "float32"
1531
+ },
1532
+ {
1533
+ "path": "actions/mobile_panda-1",
1534
+ "shape": [
1535
+ 354,
1536
+ 10
1537
+ ],
1538
+ "dtype": "float32"
1539
+ },
1540
+ {
1541
+ "path": "obs/agent/mobile_panda-0/qpos",
1542
+ "shape": [
1543
+ 355,
1544
+ 12
1545
+ ],
1546
+ "dtype": "float32"
1547
+ },
1548
+ {
1549
+ "path": "obs/agent/mobile_panda-0/qvel",
1550
+ "shape": [
1551
+ 355,
1552
+ 12
1553
+ ],
1554
+ "dtype": "float32"
1555
+ },
1556
+ {
1557
+ "path": "obs/agent/mobile_panda-1/qpos",
1558
+ "shape": [
1559
+ 355,
1560
+ 12
1561
+ ],
1562
+ "dtype": "float32"
1563
+ },
1564
+ {
1565
+ "path": "obs/agent/mobile_panda-1/qvel",
1566
+ "shape": [
1567
+ 355,
1568
+ 12
1569
+ ],
1570
+ "dtype": "float32"
1571
+ },
1572
+ {
1573
+ "path": "obs/sensor_data/front_camera/rgb",
1574
+ "shape": [
1575
+ 355,
1576
+ 240,
1577
+ 320,
1578
+ 3
1579
+ ],
1580
+ "dtype": "uint8"
1581
+ },
1582
+ {
1583
+ "path": "obs/sensor_data/left_camera/rgb",
1584
+ "shape": [
1585
+ 355,
1586
+ 240,
1587
+ 320,
1588
+ 3
1589
+ ],
1590
+ "dtype": "uint8"
1591
+ },
1592
+ {
1593
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1594
+ "shape": [
1595
+ 355,
1596
+ 240,
1597
+ 320,
1598
+ 3
1599
+ ],
1600
+ "dtype": "uint8"
1601
+ },
1602
+ {
1603
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1604
+ "shape": [
1605
+ 355,
1606
+ 240,
1607
+ 320,
1608
+ 3
1609
+ ],
1610
+ "dtype": "uint8"
1611
+ },
1612
+ {
1613
+ "path": "obs/sensor_data/top_camera/rgb",
1614
+ "shape": [
1615
+ 355,
1616
+ 320,
1617
+ 240,
1618
+ 3
1619
+ ],
1620
+ "dtype": "uint8"
1621
+ }
1622
+ ],
1623
+ "trajectory_sha256": "a2b856de96b806c21179cc01dcd128aa9769d90fe7f72a74869ee2c5b63efa09",
1624
+ "source_sha256": "81439ea825487737abe6d9d51cd0ac8b3e13dda9de81568cdc825727e83d868f",
1625
+ "view_sha256": "ee4dd2f611c0deb167fc6c5be7d8d8984324e7de76f040f525ff773549beb3cb"
1626
+ },
1627
+ {
1628
+ "demo_id": "demo_15",
1629
+ "file": "demo_15.h5",
1630
+ "length": 357,
1631
+ "fields": [
1632
+ {
1633
+ "path": "actions/mobile_panda-0",
1634
+ "shape": [
1635
+ 357,
1636
+ 10
1637
+ ],
1638
+ "dtype": "float32"
1639
+ },
1640
+ {
1641
+ "path": "actions/mobile_panda-1",
1642
+ "shape": [
1643
+ 357,
1644
+ 10
1645
+ ],
1646
+ "dtype": "float32"
1647
+ },
1648
+ {
1649
+ "path": "obs/agent/mobile_panda-0/qpos",
1650
+ "shape": [
1651
+ 358,
1652
+ 12
1653
+ ],
1654
+ "dtype": "float32"
1655
+ },
1656
+ {
1657
+ "path": "obs/agent/mobile_panda-0/qvel",
1658
+ "shape": [
1659
+ 358,
1660
+ 12
1661
+ ],
1662
+ "dtype": "float32"
1663
+ },
1664
+ {
1665
+ "path": "obs/agent/mobile_panda-1/qpos",
1666
+ "shape": [
1667
+ 358,
1668
+ 12
1669
+ ],
1670
+ "dtype": "float32"
1671
+ },
1672
+ {
1673
+ "path": "obs/agent/mobile_panda-1/qvel",
1674
+ "shape": [
1675
+ 358,
1676
+ 12
1677
+ ],
1678
+ "dtype": "float32"
1679
+ },
1680
+ {
1681
+ "path": "obs/sensor_data/front_camera/rgb",
1682
+ "shape": [
1683
+ 358,
1684
+ 240,
1685
+ 320,
1686
+ 3
1687
+ ],
1688
+ "dtype": "uint8"
1689
+ },
1690
+ {
1691
+ "path": "obs/sensor_data/left_camera/rgb",
1692
+ "shape": [
1693
+ 358,
1694
+ 240,
1695
+ 320,
1696
+ 3
1697
+ ],
1698
+ "dtype": "uint8"
1699
+ },
1700
+ {
1701
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1702
+ "shape": [
1703
+ 358,
1704
+ 240,
1705
+ 320,
1706
+ 3
1707
+ ],
1708
+ "dtype": "uint8"
1709
+ },
1710
+ {
1711
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1712
+ "shape": [
1713
+ 358,
1714
+ 240,
1715
+ 320,
1716
+ 3
1717
+ ],
1718
+ "dtype": "uint8"
1719
+ },
1720
+ {
1721
+ "path": "obs/sensor_data/top_camera/rgb",
1722
+ "shape": [
1723
+ 358,
1724
+ 320,
1725
+ 240,
1726
+ 3
1727
+ ],
1728
+ "dtype": "uint8"
1729
+ }
1730
+ ],
1731
+ "trajectory_sha256": "8a12e1637f55e77b201038061b0a67cd212401233b41dd98418bcf92154e9afd",
1732
+ "source_sha256": "6ed293410c8f93260e63ab09d69c332372d2b7b3e7dc1e9f81544f9924fc4f6f",
1733
+ "view_sha256": "8179211ab0e8ca1f94d2505b948d00d4eda5991adae74b6af2611b4be7325224"
1734
+ },
1735
+ {
1736
+ "demo_id": "demo_16",
1737
+ "file": "demo_16.h5",
1738
+ "length": 362,
1739
+ "fields": [
1740
+ {
1741
+ "path": "actions/mobile_panda-0",
1742
+ "shape": [
1743
+ 362,
1744
+ 10
1745
+ ],
1746
+ "dtype": "float32"
1747
+ },
1748
+ {
1749
+ "path": "actions/mobile_panda-1",
1750
+ "shape": [
1751
+ 362,
1752
+ 10
1753
+ ],
1754
+ "dtype": "float32"
1755
+ },
1756
+ {
1757
+ "path": "obs/agent/mobile_panda-0/qpos",
1758
+ "shape": [
1759
+ 363,
1760
+ 12
1761
+ ],
1762
+ "dtype": "float32"
1763
+ },
1764
+ {
1765
+ "path": "obs/agent/mobile_panda-0/qvel",
1766
+ "shape": [
1767
+ 363,
1768
+ 12
1769
+ ],
1770
+ "dtype": "float32"
1771
+ },
1772
+ {
1773
+ "path": "obs/agent/mobile_panda-1/qpos",
1774
+ "shape": [
1775
+ 363,
1776
+ 12
1777
+ ],
1778
+ "dtype": "float32"
1779
+ },
1780
+ {
1781
+ "path": "obs/agent/mobile_panda-1/qvel",
1782
+ "shape": [
1783
+ 363,
1784
+ 12
1785
+ ],
1786
+ "dtype": "float32"
1787
+ },
1788
+ {
1789
+ "path": "obs/sensor_data/front_camera/rgb",
1790
+ "shape": [
1791
+ 363,
1792
+ 240,
1793
+ 320,
1794
+ 3
1795
+ ],
1796
+ "dtype": "uint8"
1797
+ },
1798
+ {
1799
+ "path": "obs/sensor_data/left_camera/rgb",
1800
+ "shape": [
1801
+ 363,
1802
+ 240,
1803
+ 320,
1804
+ 3
1805
+ ],
1806
+ "dtype": "uint8"
1807
+ },
1808
+ {
1809
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1810
+ "shape": [
1811
+ 363,
1812
+ 240,
1813
+ 320,
1814
+ 3
1815
+ ],
1816
+ "dtype": "uint8"
1817
+ },
1818
+ {
1819
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1820
+ "shape": [
1821
+ 363,
1822
+ 240,
1823
+ 320,
1824
+ 3
1825
+ ],
1826
+ "dtype": "uint8"
1827
+ },
1828
+ {
1829
+ "path": "obs/sensor_data/top_camera/rgb",
1830
+ "shape": [
1831
+ 363,
1832
+ 320,
1833
+ 240,
1834
+ 3
1835
+ ],
1836
+ "dtype": "uint8"
1837
+ }
1838
+ ],
1839
+ "trajectory_sha256": "fcbf5c92e89d80905728be281b61894f4fbbf8a1582e6be906bd83c2d6bc0635",
1840
+ "source_sha256": "81a33b9eed982e2749fbfaea6082ed50d0c1eaef92cd022e4e5622f4598f2210",
1841
+ "view_sha256": "fc7e2d3590559feafc99a9b5aedfaa16b1623180604ad27858fe92daf8ca5212"
1842
+ },
1843
+ {
1844
+ "demo_id": "demo_17",
1845
+ "file": "demo_17.h5",
1846
+ "length": 359,
1847
+ "fields": [
1848
+ {
1849
+ "path": "actions/mobile_panda-0",
1850
+ "shape": [
1851
+ 359,
1852
+ 10
1853
+ ],
1854
+ "dtype": "float32"
1855
+ },
1856
+ {
1857
+ "path": "actions/mobile_panda-1",
1858
+ "shape": [
1859
+ 359,
1860
+ 10
1861
+ ],
1862
+ "dtype": "float32"
1863
+ },
1864
+ {
1865
+ "path": "obs/agent/mobile_panda-0/qpos",
1866
+ "shape": [
1867
+ 360,
1868
+ 12
1869
+ ],
1870
+ "dtype": "float32"
1871
+ },
1872
+ {
1873
+ "path": "obs/agent/mobile_panda-0/qvel",
1874
+ "shape": [
1875
+ 360,
1876
+ 12
1877
+ ],
1878
+ "dtype": "float32"
1879
+ },
1880
+ {
1881
+ "path": "obs/agent/mobile_panda-1/qpos",
1882
+ "shape": [
1883
+ 360,
1884
+ 12
1885
+ ],
1886
+ "dtype": "float32"
1887
+ },
1888
+ {
1889
+ "path": "obs/agent/mobile_panda-1/qvel",
1890
+ "shape": [
1891
+ 360,
1892
+ 12
1893
+ ],
1894
+ "dtype": "float32"
1895
+ },
1896
+ {
1897
+ "path": "obs/sensor_data/front_camera/rgb",
1898
+ "shape": [
1899
+ 360,
1900
+ 240,
1901
+ 320,
1902
+ 3
1903
+ ],
1904
+ "dtype": "uint8"
1905
+ },
1906
+ {
1907
+ "path": "obs/sensor_data/left_camera/rgb",
1908
+ "shape": [
1909
+ 360,
1910
+ 240,
1911
+ 320,
1912
+ 3
1913
+ ],
1914
+ "dtype": "uint8"
1915
+ },
1916
+ {
1917
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1918
+ "shape": [
1919
+ 360,
1920
+ 240,
1921
+ 320,
1922
+ 3
1923
+ ],
1924
+ "dtype": "uint8"
1925
+ },
1926
+ {
1927
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1928
+ "shape": [
1929
+ 360,
1930
+ 240,
1931
+ 320,
1932
+ 3
1933
+ ],
1934
+ "dtype": "uint8"
1935
+ },
1936
+ {
1937
+ "path": "obs/sensor_data/top_camera/rgb",
1938
+ "shape": [
1939
+ 360,
1940
+ 320,
1941
+ 240,
1942
+ 3
1943
+ ],
1944
+ "dtype": "uint8"
1945
+ }
1946
+ ],
1947
+ "trajectory_sha256": "7c25ed07f251995d6af297577aae813c33c2f825f01c0c600a7aa39963a77310",
1948
+ "source_sha256": "cfc79297dfb41304f74c3b062fd2c997f63d66888c7c0492e79404fd4465014a",
1949
+ "view_sha256": "d24dd9454722d0362ae4ee65696410a49304af58482d6fcbfcb4ac710a4e1ab7"
1950
+ },
1951
+ {
1952
+ "demo_id": "demo_18",
1953
+ "file": "demo_18.h5",
1954
+ "length": 364,
1955
+ "fields": [
1956
+ {
1957
+ "path": "actions/mobile_panda-0",
1958
+ "shape": [
1959
+ 364,
1960
+ 10
1961
+ ],
1962
+ "dtype": "float32"
1963
+ },
1964
+ {
1965
+ "path": "actions/mobile_panda-1",
1966
+ "shape": [
1967
+ 364,
1968
+ 10
1969
+ ],
1970
+ "dtype": "float32"
1971
+ },
1972
+ {
1973
+ "path": "obs/agent/mobile_panda-0/qpos",
1974
+ "shape": [
1975
+ 365,
1976
+ 12
1977
+ ],
1978
+ "dtype": "float32"
1979
+ },
1980
+ {
1981
+ "path": "obs/agent/mobile_panda-0/qvel",
1982
+ "shape": [
1983
+ 365,
1984
+ 12
1985
+ ],
1986
+ "dtype": "float32"
1987
+ },
1988
+ {
1989
+ "path": "obs/agent/mobile_panda-1/qpos",
1990
+ "shape": [
1991
+ 365,
1992
+ 12
1993
+ ],
1994
+ "dtype": "float32"
1995
+ },
1996
+ {
1997
+ "path": "obs/agent/mobile_panda-1/qvel",
1998
+ "shape": [
1999
+ 365,
2000
+ 12
2001
+ ],
2002
+ "dtype": "float32"
2003
+ },
2004
+ {
2005
+ "path": "obs/sensor_data/front_camera/rgb",
2006
+ "shape": [
2007
+ 365,
2008
+ 240,
2009
+ 320,
2010
+ 3
2011
+ ],
2012
+ "dtype": "uint8"
2013
+ },
2014
+ {
2015
+ "path": "obs/sensor_data/left_camera/rgb",
2016
+ "shape": [
2017
+ 365,
2018
+ 240,
2019
+ 320,
2020
+ 3
2021
+ ],
2022
+ "dtype": "uint8"
2023
+ },
2024
+ {
2025
+ "path": "obs/sensor_data/robot_camera_0/rgb",
2026
+ "shape": [
2027
+ 365,
2028
+ 240,
2029
+ 320,
2030
+ 3
2031
+ ],
2032
+ "dtype": "uint8"
2033
+ },
2034
+ {
2035
+ "path": "obs/sensor_data/robot_camera_1/rgb",
2036
+ "shape": [
2037
+ 365,
2038
+ 240,
2039
+ 320,
2040
+ 3
2041
+ ],
2042
+ "dtype": "uint8"
2043
+ },
2044
+ {
2045
+ "path": "obs/sensor_data/top_camera/rgb",
2046
+ "shape": [
2047
+ 365,
2048
+ 320,
2049
+ 240,
2050
+ 3
2051
+ ],
2052
+ "dtype": "uint8"
2053
+ }
2054
+ ],
2055
+ "trajectory_sha256": "ee94bf72e238bdfb2a3f647873f15bc683f64387a8d1702a706ac091bfd970ec",
2056
+ "source_sha256": "d24c1f8dc23b10c441f4119f84ea101123b169faf6da5938e0b0ec415ba9c5bf",
2057
+ "view_sha256": "060796c4982fade00959cf88e1e49bb0eddb17fe336708a1cd91b85e65f5d75d"
2058
+ },
2059
+ {
2060
+ "demo_id": "demo_19",
2061
+ "file": "demo_19.h5",
2062
+ "length": 357,
2063
+ "fields": [
2064
+ {
2065
+ "path": "actions/mobile_panda-0",
2066
+ "shape": [
2067
+ 357,
2068
+ 10
2069
+ ],
2070
+ "dtype": "float32"
2071
+ },
2072
+ {
2073
+ "path": "actions/mobile_panda-1",
2074
+ "shape": [
2075
+ 357,
2076
+ 10
2077
+ ],
2078
+ "dtype": "float32"
2079
+ },
2080
+ {
2081
+ "path": "obs/agent/mobile_panda-0/qpos",
2082
+ "shape": [
2083
+ 358,
2084
+ 12
2085
+ ],
2086
+ "dtype": "float32"
2087
+ },
2088
+ {
2089
+ "path": "obs/agent/mobile_panda-0/qvel",
2090
+ "shape": [
2091
+ 358,
2092
+ 12
2093
+ ],
2094
+ "dtype": "float32"
2095
+ },
2096
+ {
2097
+ "path": "obs/agent/mobile_panda-1/qpos",
2098
+ "shape": [
2099
+ 358,
2100
+ 12
2101
+ ],
2102
+ "dtype": "float32"
2103
+ },
2104
+ {
2105
+ "path": "obs/agent/mobile_panda-1/qvel",
2106
+ "shape": [
2107
+ 358,
2108
+ 12
2109
+ ],
2110
+ "dtype": "float32"
2111
+ },
2112
+ {
2113
+ "path": "obs/sensor_data/front_camera/rgb",
2114
+ "shape": [
2115
+ 358,
2116
+ 240,
2117
+ 320,
2118
+ 3
2119
+ ],
2120
+ "dtype": "uint8"
2121
+ },
2122
+ {
2123
+ "path": "obs/sensor_data/left_camera/rgb",
2124
+ "shape": [
2125
+ 358,
2126
+ 240,
2127
+ 320,
2128
+ 3
2129
+ ],
2130
+ "dtype": "uint8"
2131
+ },
2132
+ {
2133
+ "path": "obs/sensor_data/robot_camera_0/rgb",
2134
+ "shape": [
2135
+ 358,
2136
+ 240,
2137
+ 320,
2138
+ 3
2139
+ ],
2140
+ "dtype": "uint8"
2141
+ },
2142
+ {
2143
+ "path": "obs/sensor_data/robot_camera_1/rgb",
2144
+ "shape": [
2145
+ 358,
2146
+ 240,
2147
+ 320,
2148
+ 3
2149
+ ],
2150
+ "dtype": "uint8"
2151
+ },
2152
+ {
2153
+ "path": "obs/sensor_data/top_camera/rgb",
2154
+ "shape": [
2155
+ 358,
2156
+ 320,
2157
+ 240,
2158
+ 3
2159
+ ],
2160
+ "dtype": "uint8"
2161
+ }
2162
+ ],
2163
+ "trajectory_sha256": "0588a47fb3b7adc3c860f8297d94a5de7770eb5a8bf56ded12f849bbc8fc2c5b",
2164
+ "source_sha256": "1cf6ac96f663123cab5ec628ea5ddf30536a6de1fd2f26dac5c360c60137e12b",
2165
+ "view_sha256": "84a2af7ddd88a8da129afc97a7ca3d98974198e8e133b4bf26d95599684140b8"
2166
+ }
2167
+ ]
2168
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/environment.lock ADDED
@@ -0,0 +1,249 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ absl-py==2.4.0
2
+ accelerate==1.13.0
3
+ addict==2.4.0
4
+ aiohappyeyeballs==2.6.1
5
+ aiohttp==3.13.5
6
+ aiosignal==1.4.0
7
+ annotated-types==0.7.0
8
+ anyio==4.13.0
9
+ anytree==2.13.0
10
+ asttokens==3.0.1
11
+ async-timeout==5.0.1
12
+ attrs==26.1.0
13
+ av==15.1.0
14
+ blinker==1.9.0
15
+ casadi==3.7.2
16
+ certifi==2026.4.22
17
+ cffi==2.0.0
18
+ charset-normalizer==3.4.7
19
+ click==8.3.3
20
+ cloudpickle==3.1.2
21
+ cmake==4.1.3
22
+ coacd==1.0.11
23
+ colorama==0.4.6
24
+ colorlog==6.10.1
25
+ comm==0.2.3
26
+ ConfigArgParse==1.7.5
27
+ contourpy==1.3.2
28
+ cuda-bindings==12.9.4
29
+ cuda-pathfinder==1.5.4
30
+ cycler==0.12.1
31
+ dacite==1.9.2
32
+ dash==4.1.0
33
+ dataclasses-json==0.6.7
34
+ datasets==4.8.5
35
+ decorator==5.2.1
36
+ deepdiff==8.6.2
37
+ Deprecated==1.3.1
38
+ diffusers==0.35.2
39
+ dill==0.4.1
40
+ docstring_parser==0.18.0
41
+ draccus==0.10.0
42
+ einops==0.8.2
43
+ embreex==4.4.0
44
+ etils==1.13.0
45
+ evdev==1.9.3
46
+ exceptiongroup==1.3.1
47
+ executing==2.2.1
48
+ Farama-Notifications==0.0.6
49
+ fast_simplification==0.1.13
50
+ fastjsonschema==2.21.2
51
+ filelock==3.29.0
52
+ Flask==3.1.3
53
+ fonttools==4.63.0
54
+ freetype-py==2.5.1
55
+ frozenlist==1.8.0
56
+ fsspec==2026.2.0
57
+ genesis-world @ file:///data/gck/genesis-world
58
+ git-filter-repo==2.47.0
59
+ gitdb==4.0.12
60
+ GitPython==3.1.50
61
+ glfw==2.10.0
62
+ gs-madrona==0.0.5
63
+ gstaichi==3.3.0
64
+ gym==0.26.2
65
+ gym-notices==0.1.0
66
+ gymnasium==1.3.0
67
+ h11==0.16.0
68
+ h5py==3.16.0
69
+ hf-xet==1.5.0
70
+ hf_transfer==0.1.9
71
+ httpcore==1.0.9
72
+ httpx==0.28.1
73
+ huggingface-hub==0.35.3
74
+ idna==3.15
75
+ ImageIO==2.37.3
76
+ imageio-ffmpeg==0.6.0
77
+ importlib_metadata==9.0.0
78
+ importlib_resources==7.1.0
79
+ inquirerpy==0.3.4
80
+ ipython==8.39.0
81
+ ipywidgets==8.1.8
82
+ itsdangerous==2.2.0
83
+ jedi==0.20.0
84
+ Jinja2==3.1.6
85
+ joblib==1.5.3
86
+ jsonlines==4.0.0
87
+ jsonschema==4.26.0
88
+ jsonschema-specifications==2025.9.1
89
+ jupyter_core==5.9.1
90
+ jupyterlab_widgets==3.0.16
91
+ kiwisolver==1.5.0
92
+ lazy-loader==0.5
93
+ lerobot==0.4.4
94
+ libigl==2.6.2
95
+ llvmlite==0.47.0
96
+ loguru==0.7.3
97
+ lxml==6.1.0
98
+ manifold3d==3.4.1
99
+ -e git+ssh://git@github.com/HeegerGao/maniladder.git@f6eed17496816bb41ce484f2d7580990a908d3e6#egg=maniladder
100
+ mapbox_earcut==2.0.0
101
+ markdown-it-py==4.2.0
102
+ MarkupSafe==3.0.3
103
+ marshmallow==3.26.2
104
+ matplotlib==3.10.9
105
+ matplotlib-inline==0.2.2
106
+ mdurl==0.1.2
107
+ mergedeep==1.3.4
108
+ moviepy==2.2.1
109
+ mpmath==1.3.0
110
+ msgspec==0.21.1
111
+ mujoco==3.8.1
112
+ multidict==6.7.1
113
+ multiprocess==0.70.19
114
+ mypy_extensions==1.1.0
115
+ nbformat==5.10.4
116
+ nest-asyncio==1.6.0
117
+ networkx==3.4.2
118
+ ninja==1.13.0
119
+ nlopt==2.10.0
120
+ numba==0.65.1
121
+ numpy @ file:///home/conda/feedstock_root/build_artifacts/numpy_1747544640217/work/dist/numpy-2.2.6-cp310-cp310-linux_x86_64.whl#sha256=d6d964caeef85d00073d27cd62b46883d275b3d8162f723f0fcabbd0b3cc3f9d
122
+ nvidia-cublas-cu12==12.8.4.1
123
+ nvidia-cuda-cupti-cu12==12.8.90
124
+ nvidia-cuda-nvrtc-cu12==12.8.93
125
+ nvidia-cuda-runtime-cu12==12.8.90
126
+ nvidia-cudnn-cu12==9.10.2.21
127
+ nvidia-cufft-cu12==11.3.3.83
128
+ nvidia-cufile-cu12==1.13.1.3
129
+ nvidia-curand-cu12==10.3.9.90
130
+ nvidia-cusolver-cu12==11.7.3.90
131
+ nvidia-cusparse-cu12==12.5.8.93
132
+ nvidia-cusparselt-cu12==0.7.1
133
+ nvidia-nccl-cu12==2.27.5
134
+ nvidia-nvjitlink-cu12==12.8.93
135
+ nvidia-nvshmem-cu12==3.4.5
136
+ nvidia-nvtx-cu12==12.8.90
137
+ open3d==0.19.0
138
+ opencv-python==4.13.0.92
139
+ opencv-python-headless==4.12.0.88
140
+ OpenEXR==3.4.11
141
+ orderly-set==5.5.0
142
+ packaging==25.0
143
+ pandas==2.3.3
144
+ parso==0.8.7
145
+ pexpect==4.9.0
146
+ pfzy==0.3.4
147
+ pillow==11.3.0
148
+ pin==4.0.0
149
+ pip @ file:///home/task_177498883471825/croot/pip_1774988882575/work
150
+ platformdirs==4.9.6
151
+ plotly==5.24.1
152
+ polyscope==2.6.1
153
+ proglog==0.1.12
154
+ prompt_toolkit==3.0.52
155
+ propcache==0.5.2
156
+ protobuf==6.33.6
157
+ psutil==7.2.2
158
+ ptyprocess==0.7.0
159
+ pure_eval==0.2.3
160
+ py-cpuinfo==9.0.0
161
+ py-spy==0.4.2
162
+ pyarrow==24.0.0
163
+ pycollada==0.9.3
164
+ pycparser==3.0
165
+ pydantic==2.13.4
166
+ pydantic_core==2.46.4
167
+ PyGEL3D==0.6.1
168
+ pyglet==2.1.14
169
+ pygltflib==1.16.0
170
+ Pygments==2.20.0
171
+ pymeshlab==2025.7.post1
172
+ pynput==1.8.2
173
+ PyOpenGL==3.1.10
174
+ pyparsing==3.3.2
175
+ pyperclip==1.11.0
176
+ PyQt6==6.11.0
177
+ PyQt6-Qt6==6.11.0
178
+ PyQt6_sip==13.11.1
179
+ pyquaternion==0.9.9
180
+ pyserial==3.5
181
+ pysplashsurf==0.12.0.2
182
+ python-dateutil==2.9.0.post0
183
+ python-dotenv==1.2.2
184
+ python-xlib==0.33
185
+ pytransform3d==3.15.0
186
+ pytz==2026.2
187
+ pyuipc @ file:///tmp/claude-1005/-mnt4-gck-maniladder/9f005e67-04f6-4368-bd0e-9f40896c7dbf/scratchpad/pyuipc_dl/pyuipc-0.0.25-cp310-cp310-manylinux_2_34_x86_64.whl#sha256=76ff13554e1971ea4401db2c875369cf32352ae3a5a4c398c45193231b5cbf00
188
+ PyYAML==6.0.3
189
+ pyyaml-include==1.4.1
190
+ referencing==0.37.0
191
+ regex==2026.5.9
192
+ requests==2.34.2
193
+ rerun-sdk==0.26.2
194
+ retrying==1.4.2
195
+ rich==14.3.4
196
+ rpds-py==0.30.0
197
+ rtree==1.4.1
198
+ safetensors==0.7.0
199
+ sapien==3.0.3
200
+ scikit-image==0.25.2
201
+ scikit-learn==1.7.2
202
+ scipy @ file:///home/conda/feedstock_root/build_artifacts/scipy-split_1739790642651/work/dist/scipy-1.15.2-cp310-cp310-linux_x86_64.whl#sha256=9e52bad6c3294d1a5b04a13632118ca2157130603c6c018c2d710162b223b27e
203
+ sentry-sdk==2.60.0
204
+ setuptools==80.10.2
205
+ shapely==2.1.2
206
+ six==1.17.0
207
+ smmap==5.0.3
208
+ stack-data==0.6.3
209
+ svg.path==7.0
210
+ sympy==1.14.0
211
+ tenacity==9.1.4
212
+ termcolor==3.3.0
213
+ tetgen==0.8.4
214
+ threadpoolctl==3.6.0
215
+ tifffile==2025.5.10
216
+ timm==1.0.27
217
+ toml==0.10.2
218
+ torch==2.10.0
219
+ torchaudio==2.11.0
220
+ torchcodec==0.10.0
221
+ torchvision==0.25.0
222
+ tqdm==4.67.3
223
+ traitlets==5.15.0
224
+ transforms3d==0.4.2
225
+ trimesh==4.12.2
226
+ triton==3.6.0
227
+ typeguard==4.5.2
228
+ typing-inspect==0.9.0
229
+ typing-inspection==0.4.2
230
+ typing_extensions==4.15.0
231
+ tyro==1.0.13
232
+ tzdata==2026.2
233
+ urllib3==2.7.0
234
+ vhacdx==0.0.10
235
+ viser==1.0.27
236
+ vtk==9.6.1
237
+ wandb==0.24.2
238
+ wcwidth==0.7.0
239
+ websockets==16.0
240
+ Werkzeug==3.1.8
241
+ wheel==0.46.3
242
+ widgetsnbextension==4.0.15
243
+ wrapt==2.1.2
244
+ xxhash==3.7.0
245
+ yarl==1.23.0
246
+ yourdfpy==0.0.60
247
+ z3-solver==4.16.0.0
248
+ zipp==3.23.1
249
+ zstandard==0.25.0
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/features.py ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Deterministic RGB descriptors; no learned weights or camera calibration."""
2
+ import cv2
3
+ import numpy as np
4
+ CAMERAS = ('front_camera', 'top_camera')
5
+ def image_feature(image):
6
+ x = np.asarray(image)
7
+ if x.ndim == 4 and x.shape[0] == 1:
8
+ x = x[0]
9
+ if x.ndim != 3 or x.shape[2] != 3 or x.dtype != np.uint8:
10
+ raise ValueError('Expected uint8 HWC or 1HWC RGB')
11
+ # Preserve the whole view; no world-coordinate interpretation.
12
+ return cv2.resize(x, (24, 24), interpolation=cv2.INTER_AREA).astype(np.float32).reshape(-1) / 255.
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/findings.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Findings
2
+
3
+ All 20 authorized demonstrations were numerically analyzed and visually sampled; exact original ledger is ../demo_analysis.md. The nonparametric bank stores 7,176 authorized observation/action pairs. No neural weights were trained. Initial top-camera bridge-line geometry is now measured at 640x480 normalized resolution; the fixed camera's output aspect ratio differs from demonstration storage, so images are resized before line fitting.
4
+
5
+ Exploration 1 had an interactive wrapper schema failure. Episode 2's broad neighbor-phase policy stalled at phase 0.348. Episode 3's time floor advanced but failed to retract the arm. Episode 4 independently rehearsed a narrower timing window: valid runnable artifact, native success false. Demo qpos reveal an arm retraction around frames120–150 while recorded arm commands remain zero, so label replay alone does not reproduce the visible state trajectory.
6
+
7
+ Episode 5 added analytic forward-pose feedback, recovering retraction, but failed the second acquisition/strike. Its base lag reached 0.405m during travel and 0.076–0.087m near acquisition/alignment because an inherited artificial base slew limiter was below demonstrated target-minus-measured offsets. Episode 6 removed that limiter and increased translation feedback clipping to the native bound. It received native success true and terminated at step328. This is an interactive result, not yet an independent success claim.
8
+
9
+ The current controller selects a geometric reference from initial bridge-line appearance, then uses current measured joint pose every action. Analytic serial-arm transforms use standard Panda dimensions as an engineering assumption; checks against this task's demo transitions support robot0 active-motion translation consistency after mobile heading rotation (normalized RMS approximately 0.003/0.013/0.020 for x/y/z in the checked subset). These are pose calculations, not task simulation. No benchmark source, hidden states, reset controls, other tasks, external trajectories or neural updates were used.
10
+
11
+ Localization limitations: the tan-line mask can confuse implements or shadows, initial geometry selection is discrete, and reference matching assumes this task's fixed cameras. Pose limitations: analytic mount/tool assumptions and arm redundancy can produce residual error. Grasp is scheduled and pose-corrected but not contact-certified. Timing uses a fixed 360-step reference schedule within horizon400. Recovery is bounded continuous pose correction only; no robust dropped-cue or missed-ball retry is implemented. Native base bounds are null in the contract, so finite base limits were not invented. The API accepted retained demonstration targets.
12
+
13
+ Audit: ../exploration contains saved legal images, actions, numeric logs, candidate versions and exact rehearsal responses. Episode2 lost its buffered action log on episode closure; periodic images and latest observation survived, and the gap is explicitly documented. Subsequent interactive logs are incremental. Independent rehearsal histories and freeze selection belong to the trusted runner; no evaluation outputs are accessed.
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/freeze_manifest.json ADDED
@@ -0,0 +1,160 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "files": {
3
+ "__pycache__/build_bank.cpython-310.pyc": "42ceba988bad9c8c01739ed5c6771897f223e629696dd2c57daa65998ea592a2",
4
+ "__pycache__/controller.cpython-310.pyc": "1719cad3e7de45f2532b4889a07b985cbc3f42ff6c7e4a125d96c822312ab821",
5
+ "__pycache__/features.cpython-310.pyc": "e12a708c51fcff6430458001822af81f7f20041381473f8139afcd9066262802",
6
+ "build_bank.py": "e5eed9637e3c44b1ae93f4e4670075843280f0085443c027e0770d892dccb4e7",
7
+ "check_synthetic.py": "bed7e2e91113545e8c9ae8881588081dc18f8c845e23148e0d58154e2fcb498c",
8
+ "controller.py": "9f1a66ade4e1a7ba48435fd85685c8861be8b38e46615e73a4d76676ed161131",
9
+ "cue_localization.py": "7b217ff64f1a0158aa0a9fb7f46f9c4f1977575aaabe159bc26f56fa2581bcc5",
10
+ "cue_reference.npy": "ffba21451f2c4126c3464ad739d5732367aa2432b28c7b1e43b6409ecda54ce2",
11
+ "demo_bank.npz": "c422669408c140badea2789c4fe1e0c4b627bbf55517cf26fe55efa60fb3c667",
12
+ "demo_manifest.json": "78332ba5eb959cc6958bf8b9a3af97a43801988e675ae9bfe5edd9ac765807c7",
13
+ "demonstrations_readonly/demo_00.h5": "087068db798005dcd9b1b1c3b24a932009693f7b7b96b26b26c83d76bc383818",
14
+ "demonstrations_readonly/demo_01.h5": "ec25c750ff2f06c6380d697eecda8a6e6f2876290e4afcc639258112816a80e4",
15
+ "demonstrations_readonly/demo_02.h5": "42f827e0eb15d779311f61a6ec10b772cce2905b9193a665bd250793279bc6b5",
16
+ "demonstrations_readonly/demo_03.h5": "8932b625c7da5e356057a8c4cd6eab2c044079eda2b9b93ac3c3f1080b3e072e",
17
+ "demonstrations_readonly/demo_04.h5": "064f73c4e11ce8f724349c73e93a51cad7e0674e922f47ac7fe7a88965ab62c2",
18
+ "demonstrations_readonly/demo_05.h5": "8651ab797a885ebd75fabc470c776d7c59cc5c361c7fd3e5904c21931bb635ac",
19
+ "demonstrations_readonly/demo_06.h5": "487b27d57ebb0039cc89e32960eea33e673eafdcb611a9b19cfdd0f54dcb2ec9",
20
+ "demonstrations_readonly/demo_07.h5": "49ff958d6d14cb60215426a96d3436ec92f0dd524a3f52dcd33a9dae314b0685",
21
+ "demonstrations_readonly/demo_08.h5": "b4df437af648143f9efbe3396a0ee2fe1ac650911f3d2bf1ee906ee554874bb5",
22
+ "demonstrations_readonly/demo_09.h5": "01e97092351b67a8f975b726d38526c0f44f82d6e2521c843cfac8b48104a623",
23
+ "demonstrations_readonly/demo_10.h5": "f7675364397903682722daf84d305081def9b850e5ab3d6066dee844b4abd20a",
24
+ "demonstrations_readonly/demo_11.h5": "2ed935b7425eeefb46aee78b0760872aa9a28b4e5e9f7a9396f540f79068954b",
25
+ "demonstrations_readonly/demo_12.h5": "928c7509339c2592546da6d3399e44b467c21e8c6edd3e7c4e3853efbef498a4",
26
+ "demonstrations_readonly/demo_13.h5": "cc800091ce1ab6bd2f19cae804b1202a8e38cc6688fab4b2b518f56b375fee26",
27
+ "demonstrations_readonly/demo_14.h5": "ee4dd2f611c0deb167fc6c5be7d8d8984324e7de76f040f525ff773549beb3cb",
28
+ "demonstrations_readonly/demo_15.h5": "8179211ab0e8ca1f94d2505b948d00d4eda5991adae74b6af2611b4be7325224",
29
+ "demonstrations_readonly/demo_16.h5": "fc7e2d3590559feafc99a9b5aedfaa16b1623180604ad27858fe92daf8ca5212",
30
+ "demonstrations_readonly/demo_17.h5": "d24dd9454722d0362ae4ee65696410a49304af58482d6fcbfcb4ac710a4e1ab7",
31
+ "demonstrations_readonly/demo_18.h5": "060796c4982fade00959cf88e1e49bb0eddb17fe336708a1cd91b85e65f5d75d",
32
+ "demonstrations_readonly/demo_19.h5": "84a2af7ddd88a8da129afc97a7ca3d98974198e8e133b4bf26d95599684140b8",
33
+ "environment.lock": "f9f11f093744865020243315494d48c69e38ff9e67783e7cf5f0a1e5f22b34aa",
34
+ "features.py": "017fc84c0556a13ea008feb23b764e2e9f5c33c9bf05363f65086e70ea373ef5",
35
+ "findings.md": "4b2c7188dc5b6ce585192f164e40ddfbaeedbedc5503ab796ccfaf7e3bbee412",
36
+ "handoff.md": "27006c3cea23aac42141460d16150706566167ecd0460f1a0729e0f0afb4b810",
37
+ "model_tool_manifest.yaml": "7753fe8e21ae2c559b945feefa226045aec9522d68f1c6ef8da9bd6f81af5297",
38
+ "policy_runner.py": "cd8a30fc763583fb9bf6570414f01d56aba16241c733fc0cdfdfab0f8f27270e",
39
+ "pose_math.py": "da3bdef658779263f3c1215aec6ff7fc6b72aeb68009182e94e0c1c05d5d3590",
40
+ "skills.md": "df194debfa9e5b00871c03c99665c142c6528980b44ce4c3e49576765d1288cc",
41
+ "worker_api.py": "88cca5fa5c1c9570ca2bd90e8848f67c09224fa498d94e63634ad191e913c41e"
42
+ },
43
+ "bundle_hash": "6b1f74e56b9e2e0467d3bfb92e35f8a63c75a7fed6ff2cbf5b0d295d8538c9bb",
44
+ "exploration_ledger_hash": "0fde99103f0d996e910a5c3617412182a9ed037c3a645419fb015d1106d24f4f",
45
+ "entrypoint": "controller.reset_episode(); controller.act(obs)",
46
+ "selection": {
47
+ "rule": "exact-version success rate, valid rehearsal count, recency",
48
+ "rehearsals": [
49
+ {
50
+ "bundle_hash": "f72c655ad2df40a97da258e8e2e26784b92f820b2f8a9430a1f9ed805ba73c16",
51
+ "episode": 4,
52
+ "independent": true,
53
+ "score_source": "native_step_feedback",
54
+ "status": "finished",
55
+ "success": false,
56
+ "valid": true
57
+ },
58
+ {
59
+ "bundle_hash": "6b1f74e56b9e2e0467d3bfb92e35f8a63c75a7fed6ff2cbf5b0d295d8538c9bb",
60
+ "episode": 7,
61
+ "independent": true,
62
+ "score_source": "native_step_feedback",
63
+ "status": "finished",
64
+ "success": true,
65
+ "valid": true
66
+ },
67
+ {
68
+ "bundle_hash": "6b1f74e56b9e2e0467d3bfb92e35f8a63c75a7fed6ff2cbf5b0d295d8538c9bb",
69
+ "episode": 8,
70
+ "independent": true,
71
+ "score_source": "native_step_feedback",
72
+ "status": "finished",
73
+ "success": true,
74
+ "valid": true
75
+ },
76
+ {
77
+ "bundle_hash": "6b1f74e56b9e2e0467d3bfb92e35f8a63c75a7fed6ff2cbf5b0d295d8538c9bb",
78
+ "episode": 9,
79
+ "independent": true,
80
+ "score_source": "native_step_feedback",
81
+ "status": "finished",
82
+ "success": false,
83
+ "valid": true
84
+ },
85
+ {
86
+ "bundle_hash": "d1b3b087c8dbbc9345400a71a7539fa3168847218746f5a93caae39c4b93f834",
87
+ "episode": 12,
88
+ "independent": true,
89
+ "score_source": "native_step_feedback",
90
+ "status": "finished",
91
+ "success": true,
92
+ "valid": true
93
+ },
94
+ {
95
+ "bundle_hash": "d1b3b087c8dbbc9345400a71a7539fa3168847218746f5a93caae39c4b93f834",
96
+ "episode": 13,
97
+ "independent": true,
98
+ "score_source": "native_step_feedback",
99
+ "status": "finished",
100
+ "success": false,
101
+ "valid": true
102
+ },
103
+ {
104
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
105
+ "episode": 15,
106
+ "independent": true,
107
+ "score_source": "native_step_feedback",
108
+ "status": "finished",
109
+ "success": false,
110
+ "valid": true
111
+ },
112
+ {
113
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
114
+ "episode": 16,
115
+ "independent": true,
116
+ "score_source": "native_step_feedback",
117
+ "status": "finished",
118
+ "success": false,
119
+ "valid": true
120
+ },
121
+ {
122
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
123
+ "episode": 17,
124
+ "independent": true,
125
+ "score_source": "native_step_feedback",
126
+ "status": "finished",
127
+ "success": false,
128
+ "valid": true
129
+ },
130
+ {
131
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
132
+ "episode": 18,
133
+ "independent": true,
134
+ "score_source": "native_step_feedback",
135
+ "status": "finished",
136
+ "success": false,
137
+ "valid": true
138
+ },
139
+ {
140
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
141
+ "episode": 19,
142
+ "independent": true,
143
+ "score_source": "native_step_feedback",
144
+ "status": "finished",
145
+ "success": false,
146
+ "valid": true
147
+ },
148
+ {
149
+ "episode": 20,
150
+ "bundle_hash": "9412d81d7871e3a62d3a097395a21c3a17a6531bf50d69d395f38adcaac26e77",
151
+ "independent": true,
152
+ "valid": false,
153
+ "status": "infrastructure_interrupted",
154
+ "success": false,
155
+ "score_source": "interrupted_no_score",
156
+ "recovery": "durable_rehearsal_request_and_charged_episode; no replay"
157
+ }
158
+ ]
159
+ }
160
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/handoff.md ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ # Handoff
2
+
3
+ controller.py exposes reset_episode() and act(obs). Runtime assets: controller.py, pose_math.py, features.py, cue_localization.py, cue_reference.npy, demo_bank.npz; dependencies Python, NumPy, OpenCV and SciPy. All are offline; no network, model-development agent, worker API or simulator is used by the controller. Runner provides verified demo manifest and common environment lock.
4
+
5
+ Candidate has a native-success interactive run (episode6, step328). Independent rehearsals must establish runnable exact snapshots and determine selection. Outcome records are retained externally in ../exploration; this bundle does not invent official success. The earlier independent episode4 version was runnable but unsuccessful.
6
+
7
+ Runner spends initial hold at step1; controller emits at most399 actions and stops at step400. Demonstration references run on a360-step schedule with remaining horizon available for settling. Current qpos drives arm pose feedback; initial RGB selects bridge geometry. Robot0 relocates the cue, retracts, travels, regrips, aligns and strikes. Robot1 supports the bridge with demonstration commands plus position correction. Native arm/gripper bounds are respected; null base bounds are treated as unspecified, and demonstrated absolute targets are retained.
8
+
9
+ Known limits: no verified general grasp-failure recovery, no independent ball/pocket completion detector, discrete reference selection and analytic tool/mount assumptions. See findings.md. After final rehearsal, do not change behavior or add a21st rollout. Call trusted freeze after exactly20 charged slots; submit the runner-selected exact rehearsed artifact even if later trials fail.
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/model_tool_manifest.yaml ADDED
@@ -0,0 +1,87 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "task_id": "DualArmBilliardBridge-v1",
3
+ "stage": "authorized_e20_exploration",
4
+ "status": "candidate_under_development",
5
+ "authorized_demo_ids": [
6
+ "demo_00",
7
+ "demo_01",
8
+ "demo_02",
9
+ "demo_03",
10
+ "demo_04",
11
+ "demo_05",
12
+ "demo_06",
13
+ "demo_07",
14
+ "demo_08",
15
+ "demo_09",
16
+ "demo_10",
17
+ "demo_11",
18
+ "demo_12",
19
+ "demo_13",
20
+ "demo_14",
21
+ "demo_15",
22
+ "demo_16",
23
+ "demo_17",
24
+ "demo_18",
25
+ "demo_19"
26
+ ],
27
+ "demonstrations_used": 20,
28
+ "observation_action_pairs": 7176,
29
+ "neural_finetuning": false,
30
+ "pretrained_tool_weights": [],
31
+ "frozen_weight_references": [],
32
+ "coding_model": "provider-supplied coding model; exact immutable model identifier unavailable; no weight modification",
33
+ "tools_used": [
34
+ "functions.exec / exec_command: local Python and shell",
35
+ "view_image: authorized RGB contact sheet inspection",
36
+ "worker_api.API.read_demo: authorized local HDF5 reads only",
37
+ "worker_api.API: authorized budget, episode actions, rehearsal, scoring, freeze"
38
+ ],
39
+ "dependencies": {
40
+ "python": "3.10.20",
41
+ "numpy": "2.2.6",
42
+ "opencv": "4.12.0",
43
+ "h5py": "3.16.0"
44
+ },
45
+ "runtime_dependencies": [
46
+ "python",
47
+ "numpy",
48
+ "opencv",
49
+ "scipy"
50
+ ],
51
+ "offline_only_dependencies": [
52
+ "h5py",
53
+ "worker_api.py",
54
+ "Python standard library importlib/json/pathlib/hashlib"
55
+ ],
56
+ "provenance": {
57
+ "inputs": [
58
+ "/task_contract.json",
59
+ "/demo_manifest.json",
60
+ "/worker_api.py",
61
+ "/demonstrations/demo_00.h5 through demo_19.h5"
62
+ ],
63
+ "bank_builder": "build_bank.py",
64
+ "feature_extractor": "features.py: deterministic 24x24 RGB area resize",
65
+ "bank_type": "nonparametric authorized demonstration features and labels",
66
+ "verified_manifest": "runner supplies separately",
67
+ "common_environment_lock": "runner supplies separately",
68
+ "pose_math": "Analytic serial-arm forward transform, checked against authorized demonstration joint/action differences; no simulation",
69
+ "cue_reference": "20 authorized initial top-camera frames, color-mask Huber line fit"
70
+ },
71
+ "validation": [
72
+ "py_compile",
73
+ "check_synthetic.py; fabricated input and fabricated bank only, plus artifact integrity dimensions"
74
+ ],
75
+ "limitations": [
76
+ "native base bounds absent in contract",
77
+ "no task outcome validation",
78
+ "narrow demonstration coverage",
79
+ "no reliable completion detector",
80
+ "internet restricted to audited proxy; no network attempted"
81
+ ],
82
+ "sha256": {
83
+ "/task_contract.json": "5d8847a43613c11ef400c6b2ddc40fc82b0f2999b3f92ff5506d7aef0404b45d",
84
+ "/demo_manifest.json": "afa43f378f806eeea720f23fd32b8f4f83d330a6fcdb82c31e5e0300fd43149d",
85
+ "/worker_api.py": "88cca5fa5c1c9570ca2bd90e8848f67c09224fa498d94e63634ad191e913c41e"
86
+ }
87
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/policy_runner.py ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Frozen-program entry point; no development agent and no reset capability."""
2
+ import importlib.util
3
+ import sys
4
+
5
+ sys.path.insert(0,'/artifact')
6
+ sys.path.insert(0,'/')
7
+ from worker_api import API
8
+
9
+
10
+ def main():
11
+ spec=importlib.util.spec_from_file_location('controller','/artifact/controller.py')
12
+ module=importlib.util.module_from_spec(spec)
13
+ spec.loader.exec_module(module)
14
+ module.reset_episode()
15
+ api=API()
16
+ result=api.latest_observation()
17
+ while not (result['terminated'] or result['truncated'] or result['horizon_reached']):
18
+ obs=dict(result['observation'],step_id=result['step_id'])
19
+ action=module.act(obs)
20
+ if action is None:break
21
+ response=api.execute_actions([action])
22
+ result=response['steps'][-1]
23
+
24
+
25
+ if __name__=='__main__':main()
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/pose_math.py ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ import numpy as np
2
+ def fk(q,tool=.2104):
3
+ q=np.asarray(q);T=np.broadcast_to(np.eye(4),q.shape[:-1]+(4,4)).copy()
4
+ for i,(a,alpha,d) in enumerate(zip([0,0,0,.0825,-.0825,0,.088],[0,-np.pi/2,np.pi/2,np.pi/2,-np.pi/2,np.pi/2,np.pi/2],[.333,0,.316,0,.384,0,0])):
5
+ c,s=np.cos(q[...,i]),np.sin(q[...,i]);ca,sa=np.cos(alpha),np.sin(alpha)
6
+ M=np.zeros_like(T);M[...,0,0]=c;M[...,0,1]=-s;M[...,0,3]=a;M[...,1,0]=s*ca;M[...,1,1]=c*ca;M[...,1,2]=-sa;M[...,1,3]=-d*sa;M[...,2,0]=s*sa;M[...,2,1]=c*sa;M[...,2,2]=ca;M[...,2,3]=d*ca;M[...,3,3]=1;T=T@M
7
+ T[...,:3,3]+=tool*T[...,:3,2]
8
+ return T
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/skills.md ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ # Compiled skills
2
+
3
+ 1. Localize the diagonal bridge line in initial top-camera RGB using a color mask and robust Huber line fit. Compare its normalized projected endpoints to the same features from all 20 authorized demonstrations. This is geometry matching, not hidden scene/seed inference.
4
+ 2. Select the closest demonstration reference and track its timed sequence over 360 native control steps. Recompute robot0 tool pose from current qpos each call. Use the next demonstrated tool pose as the target, accounting for measured mobile-base heading. This reproduces arm retraction that appears in demonstration states without corresponding nonzero action labels.
5
+ 3. Preserve demonstration absolute base targets. Artificial current-state slew limits caused large lag and were removed. Clip normalized arm/gripper outputs to native [-1,1]. Robot1 follows demonstration arm commands with bounded position feedback while supporting the bridge.
6
+ 4. Grasp, release, regrasp, align and strike according to the reference. Robot0 uses pose feedback; robot1 retains contact-producing action labels. Current pose errors are corrected every action. No general dropped-tool recovery or visual completion detector is claimed.
7
+ 5. Stop at horizon or runner termination. Never assert success from ball disappearance; use native sparse feedback when available.
agent_d20_e20/frozen_20261102/tasks/DualArmBilliardBridge-v1/frozen/worker_api.py ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Standalone worker client; safe to mount without the runner package."""
2
+ import base64
3
+ import json
4
+ import socket
5
+ import struct
6
+ import uuid
7
+ import os
8
+ from pathlib import Path
9
+
10
+ import numpy as np
11
+
12
+
13
+ def array_hook(value):
14
+ if value.get('__array__') is True:
15
+ dtype=np.dtype(value['dtype'])
16
+ if dtype.kind not in 'bifu':raise ValueError('non-numeric array from service')
17
+ raw=base64.b64decode(value['data'],validate=True)
18
+ return np.frombuffer(raw,dtype=dtype).reshape(value['shape']).copy()
19
+ return value
20
+
21
+
22
+ class API:
23
+ def __init__(self,socket_path='/rpc/control.sock',demo_root='/demonstrations',manifest='/demo_manifest.json'):
24
+ self.socket_path=socket_path
25
+ self.demo_root=Path(demo_root)
26
+ self.manifest=Path(manifest)
27
+
28
+ def call(self,method,arguments=None,request_id=None):
29
+ # Caller can persist a request ID before sending. Never automatically retry.
30
+ request_id=request_id or str(uuid.uuid4())
31
+ request={'request_id':request_id,'method':method,'arguments':arguments or {}}
32
+ if os.environ.get('AGENT_E20_RPC_TOKEN'):
33
+ request['token']=os.environ['AGENT_E20_RPC_TOKEN']
34
+ payload=json.dumps(request,allow_nan=False).encode()
35
+ if len(payload)>65536:raise ValueError('request too large')
36
+ with socket.socket(socket.AF_UNIX,socket.SOCK_STREAM) as s:
37
+ s.settimeout(1810);s.connect(self.socket_path)
38
+ s.sendall(struct.pack('!I',len(payload))+payload)
39
+ def exact(n):
40
+ chunks=[]
41
+ while n:
42
+ chunk=s.recv(min(n,1024*1024))
43
+ if not chunk:raise RuntimeError('RPC interrupted; do not replay action with a new ID')
44
+ chunks.append(chunk);n-=len(chunk)
45
+ return b''.join(chunks)
46
+ length=struct.unpack('!I',exact(4))[0]
47
+ if length>64*1024*1024:raise RuntimeError('response too large')
48
+ result=json.loads(exact(length),object_hook=array_hook)
49
+ if not result['ok']:raise RuntimeError(result['error'])
50
+ return result['result']
51
+
52
+ def next_episode(self,request_id=None):return self.call('next_episode',request_id=request_id)
53
+ def latest_observation(self):return self.call('latest_observation')
54
+ def execute_actions(self,actions,request_id=None):
55
+ return self.call('execute_actions',{'actions':np.asarray(actions).tolist()},request_id)
56
+ def finish_episode(self):return self.call('finish_episode')
57
+ def budget_status(self):return self.call('budget_status')
58
+ def rehearse(self,candidate='candidate',request_id=None):
59
+ return self.call('rehearse',{'candidate':candidate},request_id)
60
+ def score_rehearsal(self,episode,visible_success,evidence):
61
+ return self.call('score_rehearsal',{'episode':episode,'visible_success':visible_success,'evidence':evidence})
62
+ def freeze(self):return self.call('freeze')
63
+
64
+ def read_demo(self,demo_id,start=0,stop=None,fields=None):
65
+ import h5py
66
+ manifest=json.loads(self.manifest.read_text())
67
+ if manifest.get('status') not in ('released','released_for_offline_analysis'):
68
+ raise RuntimeError('demonstrations not released by trusted preflight')
69
+ entries={e['demo_id']:e for e in manifest['episodes']}
70
+ if demo_id not in entries:raise ValueError('unauthorized demo ID')
71
+ entry=entries[demo_id]
72
+ allowed={f['path'] for f in entry['fields']}
73
+ fields=sorted(allowed) if fields is None else fields
74
+ if not set(fields)<=allowed:raise ValueError('unauthorized demo field')
75
+ stop=entry['length']+1 if stop is None else stop
76
+ if not isinstance(start,int) or not isinstance(stop,int) or not 0<=start<stop<=entry['length']+1:
77
+ raise ValueError('invalid frame interval')
78
+ path=(self.demo_root/entry['file']).resolve()
79
+ if path.parent!=self.demo_root.resolve():raise ValueError('invalid demo file')
80
+ with h5py.File(path,'r') as f:
81
+ return {field:f[field][start:min(stop,len(f[field]))] for field in fields}
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/build_bank.cpython-310.pyc ADDED
Binary file (2.91 kB). View file
 
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/controller.cpython-310.pyc ADDED
Binary file (4.22 kB). View file
 
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/__pycache__/synthetic_checks.cpython-310.pyc ADDED
Binary file (2.99 kB). View file
 
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/bank_provenance.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "demo_ids": [
3
+ "demo_00",
4
+ "demo_01",
5
+ "demo_02",
6
+ "demo_03",
7
+ "demo_04",
8
+ "demo_05",
9
+ "demo_06",
10
+ "demo_07",
11
+ "demo_08",
12
+ "demo_09",
13
+ "demo_10",
14
+ "demo_11",
15
+ "demo_12",
16
+ "demo_13",
17
+ "demo_14",
18
+ "demo_15",
19
+ "demo_16",
20
+ "demo_17",
21
+ "demo_18",
22
+ "demo_19"
23
+ ],
24
+ "frames": "Every observation index 0..length inclusive; action indices 0..length-1; endpoint rows have synthetic zero deltas, not expert labels.",
25
+ "count": 5962
26
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/build_bank.py ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Offline compilation of authorized examples, without fitting neural weights."""
2
+ import importlib.util,json,sys
3
+ from pathlib import Path
4
+ import numpy as np
5
+ sys.path.insert(0,str(Path(__file__).resolve().parent))
6
+ from controller import visual_features, proprio_features, CAMERAS, PATHS, ROBOTS
7
+ s=importlib.util.spec_from_file_location('worker_api','/worker_api.py'); m=importlib.util.module_from_spec(s); s.loader.exec_module(m)
8
+ api=m.API(); manifest=json.load(open('/demo_manifest.json'))
9
+ rows={k:[] for k in ('visual','q','v','actions','phase','demo_index','frame_index')}
10
+ for di,e in enumerate(manifest['episodes']):
11
+ fields=['obs/sensor_data/'+c+'/rgb' for c in CAMERAS]+['obs/'+p for p in PATHS]+['actions/'+r for r in ROBOTS]
12
+ d=api.read_demo(e['demo_id'],fields=fields); n=e['length']
13
+ for i in range(n+1):
14
+ q,v=proprio_features({p:d['obs/'+p][i] for p in PATHS})
15
+ rows['visual'].append(visual_features({c:d['obs/sensor_data/'+c+'/rgb'][i] for c in CAMERAS}))
16
+ rows['q'].append(q);rows['v'].append(v)
17
+ rows['actions'].append(np.concatenate([d['actions/'+r][i] for r in ROBOTS]) if i<n else np.zeros(44))
18
+ rows['phase'].append(i/n);rows['demo_index'].append(di);rows['frame_index'].append(i)
19
+ print(e['demo_id'],n,flush=True)
20
+ arrays={k:np.asarray(v,dtype=np.int32 if k in ('demo_index','frame_index') else np.float32) for k,v in rows.items()}
21
+ arrays['q_scale']=np.maximum(np.std(arrays['q'],axis=0),.15)
22
+ arrays['v_scale']=np.maximum(np.std(arrays['v'],axis=0),.3)
23
+ np.savez_compressed(Path(__file__).with_name('demo_bank.npz'),**arrays)
24
+ json.dump({'demo_ids':[e['demo_id'] for e in manifest['episodes']], 'frames':'Every observation index 0..length inclusive; action indices 0..length-1; endpoint rows have synthetic zero deltas, not expert labels.', 'count':len(arrays['q'])},open(Path(__file__).with_name('bank_provenance.json'),'w'),indent=2)
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/controller.py ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """D20 compiled controller: nonparametric observation-conditioned action lookup."""
2
+ from pathlib import Path
3
+ import numpy as np
4
+ import cv2
5
+
6
+ ROOT = Path(__file__).resolve().parent
7
+ ROBOTS = ('panda_leaphand-1', 'panda_leaphand_left-0')
8
+ CAMERAS = ('top_camera', 'front_camera')
9
+ PATHS = tuple('agent/' + r + '/' + k for r in ROBOTS for k in ('qpos', 'qvel'))
10
+ _bank = None
11
+ _phase = 0.0
12
+ _terminal_count = 0
13
+ last_diagnostic = {}
14
+
15
+
16
+ def visual_features(rgb):
17
+ """Fixed, untrained RGB and color occupancy descriptors; no metric calibration."""
18
+ out = []
19
+ for camera in CAMERAS:
20
+ im = np.asarray(rgb[camera])
21
+ if im.ndim == 4 and im.shape[0] == 1:
22
+ im = im[0]
23
+ if im.ndim != 3 or im.shape[-1] != 3 or im.dtype != np.uint8:
24
+ raise ValueError('Expected uint8 HWC or 1HWC RGB')
25
+ f = im.astype(np.float32) / 255.0
26
+ r, g, b = f.transpose(2, 0, 1)
27
+ yellow = ((r > .65) & (g > .52) & (b < .40)).astype(np.float32)
28
+ white = ((f.min(axis=2) > .65) & ((f.max(axis=2)-f.min(axis=2)) < .18)).astype(np.float32)
29
+ out.append(cv2.resize(f, (12, 16), interpolation=cv2.INTER_AREA).ravel())
30
+ for mask in (yellow, white):
31
+ out.append(2 * cv2.resize(mask, (12, 16), interpolation=cv2.INTER_AREA).ravel())
32
+ return np.concatenate(out).astype(np.float32)
33
+
34
+
35
+ def proprio_features(proprioception):
36
+ parts = [np.asarray(proprioception[p], dtype=np.float32).reshape(-1) for p in PATHS]
37
+ if any(p.shape != (23,) for p in parts):
38
+ raise ValueError('Expected 23 joint coordinates/velocities per robot')
39
+ q = np.concatenate([parts[0], parts[2]])
40
+ v = np.concatenate([parts[1], parts[3]])
41
+ if not (np.isfinite(q).all() and np.isfinite(v).all()):
42
+ raise ValueError('Nonfinite proprioception')
43
+ return q, v
44
+
45
+
46
+ def reset_episode():
47
+ global _phase, _terminal_count, last_diagnostic
48
+ _phase = 0.0
49
+ _terminal_count = 0
50
+ last_diagnostic = {}
51
+
52
+
53
+ def act(obs):
54
+ global _bank, _phase, _terminal_count, last_diagnostic
55
+ step = int(obs['step_id'])
56
+ # The runner already spent the initial native step. No additional reset hold.
57
+ if step >= 400:
58
+ last_diagnostic = {'stop_reason': 'native_horizon'}
59
+ return None
60
+ if _bank is None:
61
+ with np.load(ROOT / 'demo_bank.npz', allow_pickle=False) as z:
62
+ _bank = {k: z[k] for k in z.files}
63
+ try:
64
+ x = visual_features(obs['rgb'])
65
+ q, v = proprio_features(obs['proprioception'])
66
+ except (KeyError, ValueError, TypeError):
67
+ last_diagnostic = {'stop_reason': 'invalid_required_observation'}
68
+ return None
69
+ b = _bank
70
+ # Scene-sensitive RGB participates on every call; no episode/seed identity lookup.
71
+ dv = np.mean((b['visual'] - x) ** 2, axis=1)
72
+ dq = np.mean(((b['q'] - q) / b['q_scale']) ** 2, axis=1)
73
+ dvel = np.mean(((b['v'] - v) / b['v_scale']) ** 2, axis=1)
74
+ # A weak local phase prior breaks repeated-state ties. It does not schedule actions.
75
+ target_phase = min(1.0, _phase + 1 / 300)
76
+ distance = 16 * dv + .6 * dq + .04 * dvel + .12 * (b['phase'] - target_phase) ** 2
77
+ # Prevent confusing initial/released hand configurations; permit slow recovery.
78
+ eligible = (b['phase'] >= _phase - .08) & (b['phase'] <= _phase + .18)
79
+ ids = np.flatnonzero(eligible)
80
+ if len(ids) == 0:
81
+ ids = np.arange(len(distance))
82
+ best = ids[np.argsort(distance[ids])[:5]]
83
+ w = np.exp(-(distance[best] - distance[best[0]]) / .025)
84
+ w /= w.sum()
85
+ observed_phase = float(w @ b['phase'][best])
86
+ _phase = float(np.clip(observed_phase, max(0, _phase - .015), min(1, _phase + .025)))
87
+ # Endpoint similarity is a heuristic, never a success assertion.
88
+ near_end = _phase > .975 and float(distance[best[0]]) < .12 and np.max(abs(v)) < .3
89
+ _terminal_count = _terminal_count + 1 if near_end else 0
90
+ last_diagnostic = {'phase': _phase, 'distance': float(distance[best[0]]),
91
+ 'endpoint_streak': _terminal_count, 'demo': int(b['demo_index'][best[0]]), 'frame': int(b['frame_index'][best[0]])}
92
+ # Endpoint similarity is recorded only; keep observing through settling.
93
+ a = w @ b['actions'][best]
94
+ if a.shape != (44,) or not np.isfinite(a).all():
95
+ raise ValueError('Invalid compiled action')
96
+ # Exact contract concatenation: right-key 22, then left-key 22.
97
+ return np.clip(a, -1.0, 1.0).astype(np.float32)
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/demo_manifest.json ADDED
@@ -0,0 +1,2168 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "task_id": "DualArmCoverCloth-v1",
3
+ "status": "released",
4
+ "selection_rule": "prefer existing pinned D20, otherwise numeric trajectory ID sort before reading data",
5
+ "lineage_status": "pinned_comparator",
6
+ "episodes": [
7
+ {
8
+ "demo_id": "demo_00",
9
+ "file": "demo_00.h5",
10
+ "length": 313,
11
+ "fields": [
12
+ {
13
+ "path": "actions/panda_leaphand-1",
14
+ "shape": [
15
+ 313,
16
+ 22
17
+ ],
18
+ "dtype": "float32"
19
+ },
20
+ {
21
+ "path": "actions/panda_leaphand_left-0",
22
+ "shape": [
23
+ 313,
24
+ 22
25
+ ],
26
+ "dtype": "float32"
27
+ },
28
+ {
29
+ "path": "obs/agent/panda_leaphand-1/qpos",
30
+ "shape": [
31
+ 314,
32
+ 23
33
+ ],
34
+ "dtype": "float32"
35
+ },
36
+ {
37
+ "path": "obs/agent/panda_leaphand-1/qvel",
38
+ "shape": [
39
+ 314,
40
+ 23
41
+ ],
42
+ "dtype": "float32"
43
+ },
44
+ {
45
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
46
+ "shape": [
47
+ 314,
48
+ 23
49
+ ],
50
+ "dtype": "float32"
51
+ },
52
+ {
53
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
54
+ "shape": [
55
+ 314,
56
+ 23
57
+ ],
58
+ "dtype": "float32"
59
+ },
60
+ {
61
+ "path": "obs/sensor_data/front_camera/rgb",
62
+ "shape": [
63
+ 314,
64
+ 240,
65
+ 320,
66
+ 3
67
+ ],
68
+ "dtype": "uint8"
69
+ },
70
+ {
71
+ "path": "obs/sensor_data/left_camera/rgb",
72
+ "shape": [
73
+ 314,
74
+ 240,
75
+ 320,
76
+ 3
77
+ ],
78
+ "dtype": "uint8"
79
+ },
80
+ {
81
+ "path": "obs/sensor_data/robot_camera_0/rgb",
82
+ "shape": [
83
+ 314,
84
+ 240,
85
+ 320,
86
+ 3
87
+ ],
88
+ "dtype": "uint8"
89
+ },
90
+ {
91
+ "path": "obs/sensor_data/robot_camera_1/rgb",
92
+ "shape": [
93
+ 314,
94
+ 240,
95
+ 320,
96
+ 3
97
+ ],
98
+ "dtype": "uint8"
99
+ },
100
+ {
101
+ "path": "obs/sensor_data/top_camera/rgb",
102
+ "shape": [
103
+ 314,
104
+ 320,
105
+ 240,
106
+ 3
107
+ ],
108
+ "dtype": "uint8"
109
+ }
110
+ ],
111
+ "trajectory_sha256": "3a85d772961d842538250b3bb8e73413328a8d641ef63a6c9c84c1204a657d02",
112
+ "source_sha256": "9bd66765881234f7e31374b85f323da7dcfe6ee1db8284eb3fba30b77e49d61e",
113
+ "view_sha256": "ee5396bb3f95889b68f0ac1a5a68d3e4ace91927549ad3104a51e0d08c01c8f4"
114
+ },
115
+ {
116
+ "demo_id": "demo_01",
117
+ "file": "demo_01.h5",
118
+ "length": 315,
119
+ "fields": [
120
+ {
121
+ "path": "actions/panda_leaphand-1",
122
+ "shape": [
123
+ 315,
124
+ 22
125
+ ],
126
+ "dtype": "float32"
127
+ },
128
+ {
129
+ "path": "actions/panda_leaphand_left-0",
130
+ "shape": [
131
+ 315,
132
+ 22
133
+ ],
134
+ "dtype": "float32"
135
+ },
136
+ {
137
+ "path": "obs/agent/panda_leaphand-1/qpos",
138
+ "shape": [
139
+ 316,
140
+ 23
141
+ ],
142
+ "dtype": "float32"
143
+ },
144
+ {
145
+ "path": "obs/agent/panda_leaphand-1/qvel",
146
+ "shape": [
147
+ 316,
148
+ 23
149
+ ],
150
+ "dtype": "float32"
151
+ },
152
+ {
153
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
154
+ "shape": [
155
+ 316,
156
+ 23
157
+ ],
158
+ "dtype": "float32"
159
+ },
160
+ {
161
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
162
+ "shape": [
163
+ 316,
164
+ 23
165
+ ],
166
+ "dtype": "float32"
167
+ },
168
+ {
169
+ "path": "obs/sensor_data/front_camera/rgb",
170
+ "shape": [
171
+ 316,
172
+ 240,
173
+ 320,
174
+ 3
175
+ ],
176
+ "dtype": "uint8"
177
+ },
178
+ {
179
+ "path": "obs/sensor_data/left_camera/rgb",
180
+ "shape": [
181
+ 316,
182
+ 240,
183
+ 320,
184
+ 3
185
+ ],
186
+ "dtype": "uint8"
187
+ },
188
+ {
189
+ "path": "obs/sensor_data/robot_camera_0/rgb",
190
+ "shape": [
191
+ 316,
192
+ 240,
193
+ 320,
194
+ 3
195
+ ],
196
+ "dtype": "uint8"
197
+ },
198
+ {
199
+ "path": "obs/sensor_data/robot_camera_1/rgb",
200
+ "shape": [
201
+ 316,
202
+ 240,
203
+ 320,
204
+ 3
205
+ ],
206
+ "dtype": "uint8"
207
+ },
208
+ {
209
+ "path": "obs/sensor_data/top_camera/rgb",
210
+ "shape": [
211
+ 316,
212
+ 320,
213
+ 240,
214
+ 3
215
+ ],
216
+ "dtype": "uint8"
217
+ }
218
+ ],
219
+ "trajectory_sha256": "b0000e26a0e94ac5dc19a0ed6a025794462f33de0e0dd6fad71d6a4ae8700039",
220
+ "source_sha256": "097c3e28b5fb8e8c3c37e7cae0bb5e7bdc82be3d5df4dd48cdfb56be6dd01138",
221
+ "view_sha256": "dadf39714ec47a2197289c2d7b3e442e69014f27e01289464971ad51f2e85fcc"
222
+ },
223
+ {
224
+ "demo_id": "demo_02",
225
+ "file": "demo_02.h5",
226
+ "length": 292,
227
+ "fields": [
228
+ {
229
+ "path": "actions/panda_leaphand-1",
230
+ "shape": [
231
+ 292,
232
+ 22
233
+ ],
234
+ "dtype": "float32"
235
+ },
236
+ {
237
+ "path": "actions/panda_leaphand_left-0",
238
+ "shape": [
239
+ 292,
240
+ 22
241
+ ],
242
+ "dtype": "float32"
243
+ },
244
+ {
245
+ "path": "obs/agent/panda_leaphand-1/qpos",
246
+ "shape": [
247
+ 293,
248
+ 23
249
+ ],
250
+ "dtype": "float32"
251
+ },
252
+ {
253
+ "path": "obs/agent/panda_leaphand-1/qvel",
254
+ "shape": [
255
+ 293,
256
+ 23
257
+ ],
258
+ "dtype": "float32"
259
+ },
260
+ {
261
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
262
+ "shape": [
263
+ 293,
264
+ 23
265
+ ],
266
+ "dtype": "float32"
267
+ },
268
+ {
269
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
270
+ "shape": [
271
+ 293,
272
+ 23
273
+ ],
274
+ "dtype": "float32"
275
+ },
276
+ {
277
+ "path": "obs/sensor_data/front_camera/rgb",
278
+ "shape": [
279
+ 293,
280
+ 240,
281
+ 320,
282
+ 3
283
+ ],
284
+ "dtype": "uint8"
285
+ },
286
+ {
287
+ "path": "obs/sensor_data/left_camera/rgb",
288
+ "shape": [
289
+ 293,
290
+ 240,
291
+ 320,
292
+ 3
293
+ ],
294
+ "dtype": "uint8"
295
+ },
296
+ {
297
+ "path": "obs/sensor_data/robot_camera_0/rgb",
298
+ "shape": [
299
+ 293,
300
+ 240,
301
+ 320,
302
+ 3
303
+ ],
304
+ "dtype": "uint8"
305
+ },
306
+ {
307
+ "path": "obs/sensor_data/robot_camera_1/rgb",
308
+ "shape": [
309
+ 293,
310
+ 240,
311
+ 320,
312
+ 3
313
+ ],
314
+ "dtype": "uint8"
315
+ },
316
+ {
317
+ "path": "obs/sensor_data/top_camera/rgb",
318
+ "shape": [
319
+ 293,
320
+ 320,
321
+ 240,
322
+ 3
323
+ ],
324
+ "dtype": "uint8"
325
+ }
326
+ ],
327
+ "trajectory_sha256": "51a78069bdf636be57c7e501dafdf2d268674c23ad365f3d35c8886815ed6faf",
328
+ "source_sha256": "080492cb01c95e446b99c28502781a75dab5e19ba2d9128fb5164cdcc84527ad",
329
+ "view_sha256": "3a68e49d12048d752c06fcc18cc0ea82e39bb5808e67fe6304f850417583167b"
330
+ },
331
+ {
332
+ "demo_id": "demo_03",
333
+ "file": "demo_03.h5",
334
+ "length": 292,
335
+ "fields": [
336
+ {
337
+ "path": "actions/panda_leaphand-1",
338
+ "shape": [
339
+ 292,
340
+ 22
341
+ ],
342
+ "dtype": "float32"
343
+ },
344
+ {
345
+ "path": "actions/panda_leaphand_left-0",
346
+ "shape": [
347
+ 292,
348
+ 22
349
+ ],
350
+ "dtype": "float32"
351
+ },
352
+ {
353
+ "path": "obs/agent/panda_leaphand-1/qpos",
354
+ "shape": [
355
+ 293,
356
+ 23
357
+ ],
358
+ "dtype": "float32"
359
+ },
360
+ {
361
+ "path": "obs/agent/panda_leaphand-1/qvel",
362
+ "shape": [
363
+ 293,
364
+ 23
365
+ ],
366
+ "dtype": "float32"
367
+ },
368
+ {
369
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
370
+ "shape": [
371
+ 293,
372
+ 23
373
+ ],
374
+ "dtype": "float32"
375
+ },
376
+ {
377
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
378
+ "shape": [
379
+ 293,
380
+ 23
381
+ ],
382
+ "dtype": "float32"
383
+ },
384
+ {
385
+ "path": "obs/sensor_data/front_camera/rgb",
386
+ "shape": [
387
+ 293,
388
+ 240,
389
+ 320,
390
+ 3
391
+ ],
392
+ "dtype": "uint8"
393
+ },
394
+ {
395
+ "path": "obs/sensor_data/left_camera/rgb",
396
+ "shape": [
397
+ 293,
398
+ 240,
399
+ 320,
400
+ 3
401
+ ],
402
+ "dtype": "uint8"
403
+ },
404
+ {
405
+ "path": "obs/sensor_data/robot_camera_0/rgb",
406
+ "shape": [
407
+ 293,
408
+ 240,
409
+ 320,
410
+ 3
411
+ ],
412
+ "dtype": "uint8"
413
+ },
414
+ {
415
+ "path": "obs/sensor_data/robot_camera_1/rgb",
416
+ "shape": [
417
+ 293,
418
+ 240,
419
+ 320,
420
+ 3
421
+ ],
422
+ "dtype": "uint8"
423
+ },
424
+ {
425
+ "path": "obs/sensor_data/top_camera/rgb",
426
+ "shape": [
427
+ 293,
428
+ 320,
429
+ 240,
430
+ 3
431
+ ],
432
+ "dtype": "uint8"
433
+ }
434
+ ],
435
+ "trajectory_sha256": "745426361ec265930bcd0ee750863e924a3d56032189339b85be886146ca157f",
436
+ "source_sha256": "d18e7d0afdf4c0672aa5f943978909ada5e6a94eb95faae6493e4884aad94e9d",
437
+ "view_sha256": "751e7f3193d5e4c236cf1ba24153d8bc7a5bd6319dd192640c3b09beb773e978"
438
+ },
439
+ {
440
+ "demo_id": "demo_04",
441
+ "file": "demo_04.h5",
442
+ "length": 292,
443
+ "fields": [
444
+ {
445
+ "path": "actions/panda_leaphand-1",
446
+ "shape": [
447
+ 292,
448
+ 22
449
+ ],
450
+ "dtype": "float32"
451
+ },
452
+ {
453
+ "path": "actions/panda_leaphand_left-0",
454
+ "shape": [
455
+ 292,
456
+ 22
457
+ ],
458
+ "dtype": "float32"
459
+ },
460
+ {
461
+ "path": "obs/agent/panda_leaphand-1/qpos",
462
+ "shape": [
463
+ 293,
464
+ 23
465
+ ],
466
+ "dtype": "float32"
467
+ },
468
+ {
469
+ "path": "obs/agent/panda_leaphand-1/qvel",
470
+ "shape": [
471
+ 293,
472
+ 23
473
+ ],
474
+ "dtype": "float32"
475
+ },
476
+ {
477
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
478
+ "shape": [
479
+ 293,
480
+ 23
481
+ ],
482
+ "dtype": "float32"
483
+ },
484
+ {
485
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
486
+ "shape": [
487
+ 293,
488
+ 23
489
+ ],
490
+ "dtype": "float32"
491
+ },
492
+ {
493
+ "path": "obs/sensor_data/front_camera/rgb",
494
+ "shape": [
495
+ 293,
496
+ 240,
497
+ 320,
498
+ 3
499
+ ],
500
+ "dtype": "uint8"
501
+ },
502
+ {
503
+ "path": "obs/sensor_data/left_camera/rgb",
504
+ "shape": [
505
+ 293,
506
+ 240,
507
+ 320,
508
+ 3
509
+ ],
510
+ "dtype": "uint8"
511
+ },
512
+ {
513
+ "path": "obs/sensor_data/robot_camera_0/rgb",
514
+ "shape": [
515
+ 293,
516
+ 240,
517
+ 320,
518
+ 3
519
+ ],
520
+ "dtype": "uint8"
521
+ },
522
+ {
523
+ "path": "obs/sensor_data/robot_camera_1/rgb",
524
+ "shape": [
525
+ 293,
526
+ 240,
527
+ 320,
528
+ 3
529
+ ],
530
+ "dtype": "uint8"
531
+ },
532
+ {
533
+ "path": "obs/sensor_data/top_camera/rgb",
534
+ "shape": [
535
+ 293,
536
+ 320,
537
+ 240,
538
+ 3
539
+ ],
540
+ "dtype": "uint8"
541
+ }
542
+ ],
543
+ "trajectory_sha256": "0979b3d9ce19f82d50b6e7446f4ded5dc04589130929e9fef05b0e3068970036",
544
+ "source_sha256": "e8735aff244bf8e22e08e06c0b00cfef8e85f58ea604dcf44a66cb47c503caa3",
545
+ "view_sha256": "51c563e892261ada3c26d45fd282447fa7aef0b4f5531f42466c69f486f79985"
546
+ },
547
+ {
548
+ "demo_id": "demo_05",
549
+ "file": "demo_05.h5",
550
+ "length": 310,
551
+ "fields": [
552
+ {
553
+ "path": "actions/panda_leaphand-1",
554
+ "shape": [
555
+ 310,
556
+ 22
557
+ ],
558
+ "dtype": "float32"
559
+ },
560
+ {
561
+ "path": "actions/panda_leaphand_left-0",
562
+ "shape": [
563
+ 310,
564
+ 22
565
+ ],
566
+ "dtype": "float32"
567
+ },
568
+ {
569
+ "path": "obs/agent/panda_leaphand-1/qpos",
570
+ "shape": [
571
+ 311,
572
+ 23
573
+ ],
574
+ "dtype": "float32"
575
+ },
576
+ {
577
+ "path": "obs/agent/panda_leaphand-1/qvel",
578
+ "shape": [
579
+ 311,
580
+ 23
581
+ ],
582
+ "dtype": "float32"
583
+ },
584
+ {
585
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
586
+ "shape": [
587
+ 311,
588
+ 23
589
+ ],
590
+ "dtype": "float32"
591
+ },
592
+ {
593
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
594
+ "shape": [
595
+ 311,
596
+ 23
597
+ ],
598
+ "dtype": "float32"
599
+ },
600
+ {
601
+ "path": "obs/sensor_data/front_camera/rgb",
602
+ "shape": [
603
+ 311,
604
+ 240,
605
+ 320,
606
+ 3
607
+ ],
608
+ "dtype": "uint8"
609
+ },
610
+ {
611
+ "path": "obs/sensor_data/left_camera/rgb",
612
+ "shape": [
613
+ 311,
614
+ 240,
615
+ 320,
616
+ 3
617
+ ],
618
+ "dtype": "uint8"
619
+ },
620
+ {
621
+ "path": "obs/sensor_data/robot_camera_0/rgb",
622
+ "shape": [
623
+ 311,
624
+ 240,
625
+ 320,
626
+ 3
627
+ ],
628
+ "dtype": "uint8"
629
+ },
630
+ {
631
+ "path": "obs/sensor_data/robot_camera_1/rgb",
632
+ "shape": [
633
+ 311,
634
+ 240,
635
+ 320,
636
+ 3
637
+ ],
638
+ "dtype": "uint8"
639
+ },
640
+ {
641
+ "path": "obs/sensor_data/top_camera/rgb",
642
+ "shape": [
643
+ 311,
644
+ 320,
645
+ 240,
646
+ 3
647
+ ],
648
+ "dtype": "uint8"
649
+ }
650
+ ],
651
+ "trajectory_sha256": "2c3cb6916989716692451613dedb6c5df053a27561b4d58ee3c85f500ea616b5",
652
+ "source_sha256": "7f6a0584f174c46b597a3b606b323a6c03124732266a8670049c4a41a8237c35",
653
+ "view_sha256": "8941219225da56cd7a983d21ca3265b1282e2b6a89442e37c69cfa394c1bdf5b"
654
+ },
655
+ {
656
+ "demo_id": "demo_06",
657
+ "file": "demo_06.h5",
658
+ "length": 292,
659
+ "fields": [
660
+ {
661
+ "path": "actions/panda_leaphand-1",
662
+ "shape": [
663
+ 292,
664
+ 22
665
+ ],
666
+ "dtype": "float32"
667
+ },
668
+ {
669
+ "path": "actions/panda_leaphand_left-0",
670
+ "shape": [
671
+ 292,
672
+ 22
673
+ ],
674
+ "dtype": "float32"
675
+ },
676
+ {
677
+ "path": "obs/agent/panda_leaphand-1/qpos",
678
+ "shape": [
679
+ 293,
680
+ 23
681
+ ],
682
+ "dtype": "float32"
683
+ },
684
+ {
685
+ "path": "obs/agent/panda_leaphand-1/qvel",
686
+ "shape": [
687
+ 293,
688
+ 23
689
+ ],
690
+ "dtype": "float32"
691
+ },
692
+ {
693
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
694
+ "shape": [
695
+ 293,
696
+ 23
697
+ ],
698
+ "dtype": "float32"
699
+ },
700
+ {
701
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
702
+ "shape": [
703
+ 293,
704
+ 23
705
+ ],
706
+ "dtype": "float32"
707
+ },
708
+ {
709
+ "path": "obs/sensor_data/front_camera/rgb",
710
+ "shape": [
711
+ 293,
712
+ 240,
713
+ 320,
714
+ 3
715
+ ],
716
+ "dtype": "uint8"
717
+ },
718
+ {
719
+ "path": "obs/sensor_data/left_camera/rgb",
720
+ "shape": [
721
+ 293,
722
+ 240,
723
+ 320,
724
+ 3
725
+ ],
726
+ "dtype": "uint8"
727
+ },
728
+ {
729
+ "path": "obs/sensor_data/robot_camera_0/rgb",
730
+ "shape": [
731
+ 293,
732
+ 240,
733
+ 320,
734
+ 3
735
+ ],
736
+ "dtype": "uint8"
737
+ },
738
+ {
739
+ "path": "obs/sensor_data/robot_camera_1/rgb",
740
+ "shape": [
741
+ 293,
742
+ 240,
743
+ 320,
744
+ 3
745
+ ],
746
+ "dtype": "uint8"
747
+ },
748
+ {
749
+ "path": "obs/sensor_data/top_camera/rgb",
750
+ "shape": [
751
+ 293,
752
+ 320,
753
+ 240,
754
+ 3
755
+ ],
756
+ "dtype": "uint8"
757
+ }
758
+ ],
759
+ "trajectory_sha256": "eea8ff991f29dcb7f3b19a892acdc1755cbbd50c97c19fdfddb51ed77cebc6a6",
760
+ "source_sha256": "45dd149d0b3e70f47c30e76ec291c7cea767f8eb00359010657cc7fe0444ff94",
761
+ "view_sha256": "aeff77cf6b71332dd164d3b07ad983844de57002957fed3f06281df58b5daec6"
762
+ },
763
+ {
764
+ "demo_id": "demo_07",
765
+ "file": "demo_07.h5",
766
+ "length": 272,
767
+ "fields": [
768
+ {
769
+ "path": "actions/panda_leaphand-1",
770
+ "shape": [
771
+ 272,
772
+ 22
773
+ ],
774
+ "dtype": "float32"
775
+ },
776
+ {
777
+ "path": "actions/panda_leaphand_left-0",
778
+ "shape": [
779
+ 272,
780
+ 22
781
+ ],
782
+ "dtype": "float32"
783
+ },
784
+ {
785
+ "path": "obs/agent/panda_leaphand-1/qpos",
786
+ "shape": [
787
+ 273,
788
+ 23
789
+ ],
790
+ "dtype": "float32"
791
+ },
792
+ {
793
+ "path": "obs/agent/panda_leaphand-1/qvel",
794
+ "shape": [
795
+ 273,
796
+ 23
797
+ ],
798
+ "dtype": "float32"
799
+ },
800
+ {
801
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
802
+ "shape": [
803
+ 273,
804
+ 23
805
+ ],
806
+ "dtype": "float32"
807
+ },
808
+ {
809
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
810
+ "shape": [
811
+ 273,
812
+ 23
813
+ ],
814
+ "dtype": "float32"
815
+ },
816
+ {
817
+ "path": "obs/sensor_data/front_camera/rgb",
818
+ "shape": [
819
+ 273,
820
+ 240,
821
+ 320,
822
+ 3
823
+ ],
824
+ "dtype": "uint8"
825
+ },
826
+ {
827
+ "path": "obs/sensor_data/left_camera/rgb",
828
+ "shape": [
829
+ 273,
830
+ 240,
831
+ 320,
832
+ 3
833
+ ],
834
+ "dtype": "uint8"
835
+ },
836
+ {
837
+ "path": "obs/sensor_data/robot_camera_0/rgb",
838
+ "shape": [
839
+ 273,
840
+ 240,
841
+ 320,
842
+ 3
843
+ ],
844
+ "dtype": "uint8"
845
+ },
846
+ {
847
+ "path": "obs/sensor_data/robot_camera_1/rgb",
848
+ "shape": [
849
+ 273,
850
+ 240,
851
+ 320,
852
+ 3
853
+ ],
854
+ "dtype": "uint8"
855
+ },
856
+ {
857
+ "path": "obs/sensor_data/top_camera/rgb",
858
+ "shape": [
859
+ 273,
860
+ 320,
861
+ 240,
862
+ 3
863
+ ],
864
+ "dtype": "uint8"
865
+ }
866
+ ],
867
+ "trajectory_sha256": "80fb489e586ece0ca2682ad2471fd362766cabe4ab38c537f2112c2ea3781dd9",
868
+ "source_sha256": "7918227181d4b480f51921e24d0103e17cd770d670e998824abdb13eb72bbe62",
869
+ "view_sha256": "65672147188dedf12e84137c5c42aac9a68c889e47ade08989e26c9d7d471a84"
870
+ },
871
+ {
872
+ "demo_id": "demo_08",
873
+ "file": "demo_08.h5",
874
+ "length": 293,
875
+ "fields": [
876
+ {
877
+ "path": "actions/panda_leaphand-1",
878
+ "shape": [
879
+ 293,
880
+ 22
881
+ ],
882
+ "dtype": "float32"
883
+ },
884
+ {
885
+ "path": "actions/panda_leaphand_left-0",
886
+ "shape": [
887
+ 293,
888
+ 22
889
+ ],
890
+ "dtype": "float32"
891
+ },
892
+ {
893
+ "path": "obs/agent/panda_leaphand-1/qpos",
894
+ "shape": [
895
+ 294,
896
+ 23
897
+ ],
898
+ "dtype": "float32"
899
+ },
900
+ {
901
+ "path": "obs/agent/panda_leaphand-1/qvel",
902
+ "shape": [
903
+ 294,
904
+ 23
905
+ ],
906
+ "dtype": "float32"
907
+ },
908
+ {
909
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
910
+ "shape": [
911
+ 294,
912
+ 23
913
+ ],
914
+ "dtype": "float32"
915
+ },
916
+ {
917
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
918
+ "shape": [
919
+ 294,
920
+ 23
921
+ ],
922
+ "dtype": "float32"
923
+ },
924
+ {
925
+ "path": "obs/sensor_data/front_camera/rgb",
926
+ "shape": [
927
+ 294,
928
+ 240,
929
+ 320,
930
+ 3
931
+ ],
932
+ "dtype": "uint8"
933
+ },
934
+ {
935
+ "path": "obs/sensor_data/left_camera/rgb",
936
+ "shape": [
937
+ 294,
938
+ 240,
939
+ 320,
940
+ 3
941
+ ],
942
+ "dtype": "uint8"
943
+ },
944
+ {
945
+ "path": "obs/sensor_data/robot_camera_0/rgb",
946
+ "shape": [
947
+ 294,
948
+ 240,
949
+ 320,
950
+ 3
951
+ ],
952
+ "dtype": "uint8"
953
+ },
954
+ {
955
+ "path": "obs/sensor_data/robot_camera_1/rgb",
956
+ "shape": [
957
+ 294,
958
+ 240,
959
+ 320,
960
+ 3
961
+ ],
962
+ "dtype": "uint8"
963
+ },
964
+ {
965
+ "path": "obs/sensor_data/top_camera/rgb",
966
+ "shape": [
967
+ 294,
968
+ 320,
969
+ 240,
970
+ 3
971
+ ],
972
+ "dtype": "uint8"
973
+ }
974
+ ],
975
+ "trajectory_sha256": "2d6135c0a28993bd46c127f5fef412ae413c0e907e2221e9904390780700c432",
976
+ "source_sha256": "396ee04cc4512f4554f86f49f9d22f3e790939ba3d5f1ca8e4a91790754cf949",
977
+ "view_sha256": "0420bebe99a2376aff2c8a95f14d7da09116101ad9188044178604f8d8a953f5"
978
+ },
979
+ {
980
+ "demo_id": "demo_09",
981
+ "file": "demo_09.h5",
982
+ "length": 315,
983
+ "fields": [
984
+ {
985
+ "path": "actions/panda_leaphand-1",
986
+ "shape": [
987
+ 315,
988
+ 22
989
+ ],
990
+ "dtype": "float32"
991
+ },
992
+ {
993
+ "path": "actions/panda_leaphand_left-0",
994
+ "shape": [
995
+ 315,
996
+ 22
997
+ ],
998
+ "dtype": "float32"
999
+ },
1000
+ {
1001
+ "path": "obs/agent/panda_leaphand-1/qpos",
1002
+ "shape": [
1003
+ 316,
1004
+ 23
1005
+ ],
1006
+ "dtype": "float32"
1007
+ },
1008
+ {
1009
+ "path": "obs/agent/panda_leaphand-1/qvel",
1010
+ "shape": [
1011
+ 316,
1012
+ 23
1013
+ ],
1014
+ "dtype": "float32"
1015
+ },
1016
+ {
1017
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1018
+ "shape": [
1019
+ 316,
1020
+ 23
1021
+ ],
1022
+ "dtype": "float32"
1023
+ },
1024
+ {
1025
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1026
+ "shape": [
1027
+ 316,
1028
+ 23
1029
+ ],
1030
+ "dtype": "float32"
1031
+ },
1032
+ {
1033
+ "path": "obs/sensor_data/front_camera/rgb",
1034
+ "shape": [
1035
+ 316,
1036
+ 240,
1037
+ 320,
1038
+ 3
1039
+ ],
1040
+ "dtype": "uint8"
1041
+ },
1042
+ {
1043
+ "path": "obs/sensor_data/left_camera/rgb",
1044
+ "shape": [
1045
+ 316,
1046
+ 240,
1047
+ 320,
1048
+ 3
1049
+ ],
1050
+ "dtype": "uint8"
1051
+ },
1052
+ {
1053
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1054
+ "shape": [
1055
+ 316,
1056
+ 240,
1057
+ 320,
1058
+ 3
1059
+ ],
1060
+ "dtype": "uint8"
1061
+ },
1062
+ {
1063
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1064
+ "shape": [
1065
+ 316,
1066
+ 240,
1067
+ 320,
1068
+ 3
1069
+ ],
1070
+ "dtype": "uint8"
1071
+ },
1072
+ {
1073
+ "path": "obs/sensor_data/top_camera/rgb",
1074
+ "shape": [
1075
+ 316,
1076
+ 320,
1077
+ 240,
1078
+ 3
1079
+ ],
1080
+ "dtype": "uint8"
1081
+ }
1082
+ ],
1083
+ "trajectory_sha256": "ea5b3416d71b9a2c3d5907c1183584006fe04b38d35269115f77981ba7653663",
1084
+ "source_sha256": "e11d7159884e855a3267c58b98c458cdeed096538efbec5af05e0b99ae122900",
1085
+ "view_sha256": "10a01c5a20df9ecb2b8909afac1e444b4f2478df85a35460cc8d6bda09da981a"
1086
+ },
1087
+ {
1088
+ "demo_id": "demo_10",
1089
+ "file": "demo_10.h5",
1090
+ "length": 297,
1091
+ "fields": [
1092
+ {
1093
+ "path": "actions/panda_leaphand-1",
1094
+ "shape": [
1095
+ 297,
1096
+ 22
1097
+ ],
1098
+ "dtype": "float32"
1099
+ },
1100
+ {
1101
+ "path": "actions/panda_leaphand_left-0",
1102
+ "shape": [
1103
+ 297,
1104
+ 22
1105
+ ],
1106
+ "dtype": "float32"
1107
+ },
1108
+ {
1109
+ "path": "obs/agent/panda_leaphand-1/qpos",
1110
+ "shape": [
1111
+ 298,
1112
+ 23
1113
+ ],
1114
+ "dtype": "float32"
1115
+ },
1116
+ {
1117
+ "path": "obs/agent/panda_leaphand-1/qvel",
1118
+ "shape": [
1119
+ 298,
1120
+ 23
1121
+ ],
1122
+ "dtype": "float32"
1123
+ },
1124
+ {
1125
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1126
+ "shape": [
1127
+ 298,
1128
+ 23
1129
+ ],
1130
+ "dtype": "float32"
1131
+ },
1132
+ {
1133
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1134
+ "shape": [
1135
+ 298,
1136
+ 23
1137
+ ],
1138
+ "dtype": "float32"
1139
+ },
1140
+ {
1141
+ "path": "obs/sensor_data/front_camera/rgb",
1142
+ "shape": [
1143
+ 298,
1144
+ 240,
1145
+ 320,
1146
+ 3
1147
+ ],
1148
+ "dtype": "uint8"
1149
+ },
1150
+ {
1151
+ "path": "obs/sensor_data/left_camera/rgb",
1152
+ "shape": [
1153
+ 298,
1154
+ 240,
1155
+ 320,
1156
+ 3
1157
+ ],
1158
+ "dtype": "uint8"
1159
+ },
1160
+ {
1161
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1162
+ "shape": [
1163
+ 298,
1164
+ 240,
1165
+ 320,
1166
+ 3
1167
+ ],
1168
+ "dtype": "uint8"
1169
+ },
1170
+ {
1171
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1172
+ "shape": [
1173
+ 298,
1174
+ 240,
1175
+ 320,
1176
+ 3
1177
+ ],
1178
+ "dtype": "uint8"
1179
+ },
1180
+ {
1181
+ "path": "obs/sensor_data/top_camera/rgb",
1182
+ "shape": [
1183
+ 298,
1184
+ 320,
1185
+ 240,
1186
+ 3
1187
+ ],
1188
+ "dtype": "uint8"
1189
+ }
1190
+ ],
1191
+ "trajectory_sha256": "94f2c6849c49bd3aa2b098d101ef1c08ac09dd671e5a14c1a80e8414b4f910ce",
1192
+ "source_sha256": "e468d2ebaacd908a04bced79bd049f55cb4e72dcad0032bc38e272d5f3f2bf3e",
1193
+ "view_sha256": "3e40a2ba60e2cc67244d1ce64996ec7b77baf6d89ab5d206a91c0ae0280b6dc3"
1194
+ },
1195
+ {
1196
+ "demo_id": "demo_11",
1197
+ "file": "demo_11.h5",
1198
+ "length": 297,
1199
+ "fields": [
1200
+ {
1201
+ "path": "actions/panda_leaphand-1",
1202
+ "shape": [
1203
+ 297,
1204
+ 22
1205
+ ],
1206
+ "dtype": "float32"
1207
+ },
1208
+ {
1209
+ "path": "actions/panda_leaphand_left-0",
1210
+ "shape": [
1211
+ 297,
1212
+ 22
1213
+ ],
1214
+ "dtype": "float32"
1215
+ },
1216
+ {
1217
+ "path": "obs/agent/panda_leaphand-1/qpos",
1218
+ "shape": [
1219
+ 298,
1220
+ 23
1221
+ ],
1222
+ "dtype": "float32"
1223
+ },
1224
+ {
1225
+ "path": "obs/agent/panda_leaphand-1/qvel",
1226
+ "shape": [
1227
+ 298,
1228
+ 23
1229
+ ],
1230
+ "dtype": "float32"
1231
+ },
1232
+ {
1233
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1234
+ "shape": [
1235
+ 298,
1236
+ 23
1237
+ ],
1238
+ "dtype": "float32"
1239
+ },
1240
+ {
1241
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1242
+ "shape": [
1243
+ 298,
1244
+ 23
1245
+ ],
1246
+ "dtype": "float32"
1247
+ },
1248
+ {
1249
+ "path": "obs/sensor_data/front_camera/rgb",
1250
+ "shape": [
1251
+ 298,
1252
+ 240,
1253
+ 320,
1254
+ 3
1255
+ ],
1256
+ "dtype": "uint8"
1257
+ },
1258
+ {
1259
+ "path": "obs/sensor_data/left_camera/rgb",
1260
+ "shape": [
1261
+ 298,
1262
+ 240,
1263
+ 320,
1264
+ 3
1265
+ ],
1266
+ "dtype": "uint8"
1267
+ },
1268
+ {
1269
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1270
+ "shape": [
1271
+ 298,
1272
+ 240,
1273
+ 320,
1274
+ 3
1275
+ ],
1276
+ "dtype": "uint8"
1277
+ },
1278
+ {
1279
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1280
+ "shape": [
1281
+ 298,
1282
+ 240,
1283
+ 320,
1284
+ 3
1285
+ ],
1286
+ "dtype": "uint8"
1287
+ },
1288
+ {
1289
+ "path": "obs/sensor_data/top_camera/rgb",
1290
+ "shape": [
1291
+ 298,
1292
+ 320,
1293
+ 240,
1294
+ 3
1295
+ ],
1296
+ "dtype": "uint8"
1297
+ }
1298
+ ],
1299
+ "trajectory_sha256": "b0cb91e359d9a791cd28bb2fb920abb2aa32c80990ee581250c8dceba87925b5",
1300
+ "source_sha256": "24eacfba5a5cadad6784316e200ff99021c20bd8fe8d950ce58b2647d448638a",
1301
+ "view_sha256": "18abd9b7cf9eeff71e229d7b116c9b47fbeb96502eb20a50050f2060884cd154"
1302
+ },
1303
+ {
1304
+ "demo_id": "demo_12",
1305
+ "file": "demo_12.h5",
1306
+ "length": 276,
1307
+ "fields": [
1308
+ {
1309
+ "path": "actions/panda_leaphand-1",
1310
+ "shape": [
1311
+ 276,
1312
+ 22
1313
+ ],
1314
+ "dtype": "float32"
1315
+ },
1316
+ {
1317
+ "path": "actions/panda_leaphand_left-0",
1318
+ "shape": [
1319
+ 276,
1320
+ 22
1321
+ ],
1322
+ "dtype": "float32"
1323
+ },
1324
+ {
1325
+ "path": "obs/agent/panda_leaphand-1/qpos",
1326
+ "shape": [
1327
+ 277,
1328
+ 23
1329
+ ],
1330
+ "dtype": "float32"
1331
+ },
1332
+ {
1333
+ "path": "obs/agent/panda_leaphand-1/qvel",
1334
+ "shape": [
1335
+ 277,
1336
+ 23
1337
+ ],
1338
+ "dtype": "float32"
1339
+ },
1340
+ {
1341
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1342
+ "shape": [
1343
+ 277,
1344
+ 23
1345
+ ],
1346
+ "dtype": "float32"
1347
+ },
1348
+ {
1349
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1350
+ "shape": [
1351
+ 277,
1352
+ 23
1353
+ ],
1354
+ "dtype": "float32"
1355
+ },
1356
+ {
1357
+ "path": "obs/sensor_data/front_camera/rgb",
1358
+ "shape": [
1359
+ 277,
1360
+ 240,
1361
+ 320,
1362
+ 3
1363
+ ],
1364
+ "dtype": "uint8"
1365
+ },
1366
+ {
1367
+ "path": "obs/sensor_data/left_camera/rgb",
1368
+ "shape": [
1369
+ 277,
1370
+ 240,
1371
+ 320,
1372
+ 3
1373
+ ],
1374
+ "dtype": "uint8"
1375
+ },
1376
+ {
1377
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1378
+ "shape": [
1379
+ 277,
1380
+ 240,
1381
+ 320,
1382
+ 3
1383
+ ],
1384
+ "dtype": "uint8"
1385
+ },
1386
+ {
1387
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1388
+ "shape": [
1389
+ 277,
1390
+ 240,
1391
+ 320,
1392
+ 3
1393
+ ],
1394
+ "dtype": "uint8"
1395
+ },
1396
+ {
1397
+ "path": "obs/sensor_data/top_camera/rgb",
1398
+ "shape": [
1399
+ 277,
1400
+ 320,
1401
+ 240,
1402
+ 3
1403
+ ],
1404
+ "dtype": "uint8"
1405
+ }
1406
+ ],
1407
+ "trajectory_sha256": "97210321a2877fd56f8279e9545fdfb18bc6445613588cc313d360a638d0911e",
1408
+ "source_sha256": "133df8e69e45aa9fc43e747b368e75f978c9b9ac90235dd8e1c052673b4ee3e1",
1409
+ "view_sha256": "131138956c8172b0b65bfc105728d170e81f1f38b9662a70eaa6ae3af93ceb2f"
1410
+ },
1411
+ {
1412
+ "demo_id": "demo_13",
1413
+ "file": "demo_13.h5",
1414
+ "length": 315,
1415
+ "fields": [
1416
+ {
1417
+ "path": "actions/panda_leaphand-1",
1418
+ "shape": [
1419
+ 315,
1420
+ 22
1421
+ ],
1422
+ "dtype": "float32"
1423
+ },
1424
+ {
1425
+ "path": "actions/panda_leaphand_left-0",
1426
+ "shape": [
1427
+ 315,
1428
+ 22
1429
+ ],
1430
+ "dtype": "float32"
1431
+ },
1432
+ {
1433
+ "path": "obs/agent/panda_leaphand-1/qpos",
1434
+ "shape": [
1435
+ 316,
1436
+ 23
1437
+ ],
1438
+ "dtype": "float32"
1439
+ },
1440
+ {
1441
+ "path": "obs/agent/panda_leaphand-1/qvel",
1442
+ "shape": [
1443
+ 316,
1444
+ 23
1445
+ ],
1446
+ "dtype": "float32"
1447
+ },
1448
+ {
1449
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1450
+ "shape": [
1451
+ 316,
1452
+ 23
1453
+ ],
1454
+ "dtype": "float32"
1455
+ },
1456
+ {
1457
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1458
+ "shape": [
1459
+ 316,
1460
+ 23
1461
+ ],
1462
+ "dtype": "float32"
1463
+ },
1464
+ {
1465
+ "path": "obs/sensor_data/front_camera/rgb",
1466
+ "shape": [
1467
+ 316,
1468
+ 240,
1469
+ 320,
1470
+ 3
1471
+ ],
1472
+ "dtype": "uint8"
1473
+ },
1474
+ {
1475
+ "path": "obs/sensor_data/left_camera/rgb",
1476
+ "shape": [
1477
+ 316,
1478
+ 240,
1479
+ 320,
1480
+ 3
1481
+ ],
1482
+ "dtype": "uint8"
1483
+ },
1484
+ {
1485
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1486
+ "shape": [
1487
+ 316,
1488
+ 240,
1489
+ 320,
1490
+ 3
1491
+ ],
1492
+ "dtype": "uint8"
1493
+ },
1494
+ {
1495
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1496
+ "shape": [
1497
+ 316,
1498
+ 240,
1499
+ 320,
1500
+ 3
1501
+ ],
1502
+ "dtype": "uint8"
1503
+ },
1504
+ {
1505
+ "path": "obs/sensor_data/top_camera/rgb",
1506
+ "shape": [
1507
+ 316,
1508
+ 320,
1509
+ 240,
1510
+ 3
1511
+ ],
1512
+ "dtype": "uint8"
1513
+ }
1514
+ ],
1515
+ "trajectory_sha256": "2fbb3987cb1ff20976391c932dcbd41f01a1fe3cb7f548ce85cbf3776f9c760f",
1516
+ "source_sha256": "c74106b43458bfcab29ac2a4e7c087f69d90f0b15ecf163c3eb6331fa122a7dd",
1517
+ "view_sha256": "7b884550c79df632017bbe2b892bb35230eb17f8b64100042c94802341e67b10"
1518
+ },
1519
+ {
1520
+ "demo_id": "demo_14",
1521
+ "file": "demo_14.h5",
1522
+ "length": 297,
1523
+ "fields": [
1524
+ {
1525
+ "path": "actions/panda_leaphand-1",
1526
+ "shape": [
1527
+ 297,
1528
+ 22
1529
+ ],
1530
+ "dtype": "float32"
1531
+ },
1532
+ {
1533
+ "path": "actions/panda_leaphand_left-0",
1534
+ "shape": [
1535
+ 297,
1536
+ 22
1537
+ ],
1538
+ "dtype": "float32"
1539
+ },
1540
+ {
1541
+ "path": "obs/agent/panda_leaphand-1/qpos",
1542
+ "shape": [
1543
+ 298,
1544
+ 23
1545
+ ],
1546
+ "dtype": "float32"
1547
+ },
1548
+ {
1549
+ "path": "obs/agent/panda_leaphand-1/qvel",
1550
+ "shape": [
1551
+ 298,
1552
+ 23
1553
+ ],
1554
+ "dtype": "float32"
1555
+ },
1556
+ {
1557
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1558
+ "shape": [
1559
+ 298,
1560
+ 23
1561
+ ],
1562
+ "dtype": "float32"
1563
+ },
1564
+ {
1565
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1566
+ "shape": [
1567
+ 298,
1568
+ 23
1569
+ ],
1570
+ "dtype": "float32"
1571
+ },
1572
+ {
1573
+ "path": "obs/sensor_data/front_camera/rgb",
1574
+ "shape": [
1575
+ 298,
1576
+ 240,
1577
+ 320,
1578
+ 3
1579
+ ],
1580
+ "dtype": "uint8"
1581
+ },
1582
+ {
1583
+ "path": "obs/sensor_data/left_camera/rgb",
1584
+ "shape": [
1585
+ 298,
1586
+ 240,
1587
+ 320,
1588
+ 3
1589
+ ],
1590
+ "dtype": "uint8"
1591
+ },
1592
+ {
1593
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1594
+ "shape": [
1595
+ 298,
1596
+ 240,
1597
+ 320,
1598
+ 3
1599
+ ],
1600
+ "dtype": "uint8"
1601
+ },
1602
+ {
1603
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1604
+ "shape": [
1605
+ 298,
1606
+ 240,
1607
+ 320,
1608
+ 3
1609
+ ],
1610
+ "dtype": "uint8"
1611
+ },
1612
+ {
1613
+ "path": "obs/sensor_data/top_camera/rgb",
1614
+ "shape": [
1615
+ 298,
1616
+ 320,
1617
+ 240,
1618
+ 3
1619
+ ],
1620
+ "dtype": "uint8"
1621
+ }
1622
+ ],
1623
+ "trajectory_sha256": "923280f26875b3f60cc83f82718a986099c8f55610b0e6674cdfdffc2558422d",
1624
+ "source_sha256": "876863fbcdca52a49b332ab5faaeb7cf1d7509eb46113f7475d57a09610bbfeb",
1625
+ "view_sha256": "42aa696af5ce97842036930165104c22b0c05dcb3f7cf36fe40b855bdea9f060"
1626
+ },
1627
+ {
1628
+ "demo_id": "demo_15",
1629
+ "file": "demo_15.h5",
1630
+ "length": 313,
1631
+ "fields": [
1632
+ {
1633
+ "path": "actions/panda_leaphand-1",
1634
+ "shape": [
1635
+ 313,
1636
+ 22
1637
+ ],
1638
+ "dtype": "float32"
1639
+ },
1640
+ {
1641
+ "path": "actions/panda_leaphand_left-0",
1642
+ "shape": [
1643
+ 313,
1644
+ 22
1645
+ ],
1646
+ "dtype": "float32"
1647
+ },
1648
+ {
1649
+ "path": "obs/agent/panda_leaphand-1/qpos",
1650
+ "shape": [
1651
+ 314,
1652
+ 23
1653
+ ],
1654
+ "dtype": "float32"
1655
+ },
1656
+ {
1657
+ "path": "obs/agent/panda_leaphand-1/qvel",
1658
+ "shape": [
1659
+ 314,
1660
+ 23
1661
+ ],
1662
+ "dtype": "float32"
1663
+ },
1664
+ {
1665
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1666
+ "shape": [
1667
+ 314,
1668
+ 23
1669
+ ],
1670
+ "dtype": "float32"
1671
+ },
1672
+ {
1673
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1674
+ "shape": [
1675
+ 314,
1676
+ 23
1677
+ ],
1678
+ "dtype": "float32"
1679
+ },
1680
+ {
1681
+ "path": "obs/sensor_data/front_camera/rgb",
1682
+ "shape": [
1683
+ 314,
1684
+ 240,
1685
+ 320,
1686
+ 3
1687
+ ],
1688
+ "dtype": "uint8"
1689
+ },
1690
+ {
1691
+ "path": "obs/sensor_data/left_camera/rgb",
1692
+ "shape": [
1693
+ 314,
1694
+ 240,
1695
+ 320,
1696
+ 3
1697
+ ],
1698
+ "dtype": "uint8"
1699
+ },
1700
+ {
1701
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1702
+ "shape": [
1703
+ 314,
1704
+ 240,
1705
+ 320,
1706
+ 3
1707
+ ],
1708
+ "dtype": "uint8"
1709
+ },
1710
+ {
1711
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1712
+ "shape": [
1713
+ 314,
1714
+ 240,
1715
+ 320,
1716
+ 3
1717
+ ],
1718
+ "dtype": "uint8"
1719
+ },
1720
+ {
1721
+ "path": "obs/sensor_data/top_camera/rgb",
1722
+ "shape": [
1723
+ 314,
1724
+ 320,
1725
+ 240,
1726
+ 3
1727
+ ],
1728
+ "dtype": "uint8"
1729
+ }
1730
+ ],
1731
+ "trajectory_sha256": "70daac8771b84b1dd634896a3bfd8e000b0b89231f91e3f06d75a25bc092defa",
1732
+ "source_sha256": "5dfea85ced47e49149b8bf01403cc70c047ea59f9d6ea3129605024dad75608b",
1733
+ "view_sha256": "51450b2dfb879238267089771f34a4645335b021b3893e6440f2d7b07b3f4c00"
1734
+ },
1735
+ {
1736
+ "demo_id": "demo_16",
1737
+ "file": "demo_16.h5",
1738
+ "length": 309,
1739
+ "fields": [
1740
+ {
1741
+ "path": "actions/panda_leaphand-1",
1742
+ "shape": [
1743
+ 309,
1744
+ 22
1745
+ ],
1746
+ "dtype": "float32"
1747
+ },
1748
+ {
1749
+ "path": "actions/panda_leaphand_left-0",
1750
+ "shape": [
1751
+ 309,
1752
+ 22
1753
+ ],
1754
+ "dtype": "float32"
1755
+ },
1756
+ {
1757
+ "path": "obs/agent/panda_leaphand-1/qpos",
1758
+ "shape": [
1759
+ 310,
1760
+ 23
1761
+ ],
1762
+ "dtype": "float32"
1763
+ },
1764
+ {
1765
+ "path": "obs/agent/panda_leaphand-1/qvel",
1766
+ "shape": [
1767
+ 310,
1768
+ 23
1769
+ ],
1770
+ "dtype": "float32"
1771
+ },
1772
+ {
1773
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1774
+ "shape": [
1775
+ 310,
1776
+ 23
1777
+ ],
1778
+ "dtype": "float32"
1779
+ },
1780
+ {
1781
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1782
+ "shape": [
1783
+ 310,
1784
+ 23
1785
+ ],
1786
+ "dtype": "float32"
1787
+ },
1788
+ {
1789
+ "path": "obs/sensor_data/front_camera/rgb",
1790
+ "shape": [
1791
+ 310,
1792
+ 240,
1793
+ 320,
1794
+ 3
1795
+ ],
1796
+ "dtype": "uint8"
1797
+ },
1798
+ {
1799
+ "path": "obs/sensor_data/left_camera/rgb",
1800
+ "shape": [
1801
+ 310,
1802
+ 240,
1803
+ 320,
1804
+ 3
1805
+ ],
1806
+ "dtype": "uint8"
1807
+ },
1808
+ {
1809
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1810
+ "shape": [
1811
+ 310,
1812
+ 240,
1813
+ 320,
1814
+ 3
1815
+ ],
1816
+ "dtype": "uint8"
1817
+ },
1818
+ {
1819
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1820
+ "shape": [
1821
+ 310,
1822
+ 240,
1823
+ 320,
1824
+ 3
1825
+ ],
1826
+ "dtype": "uint8"
1827
+ },
1828
+ {
1829
+ "path": "obs/sensor_data/top_camera/rgb",
1830
+ "shape": [
1831
+ 310,
1832
+ 320,
1833
+ 240,
1834
+ 3
1835
+ ],
1836
+ "dtype": "uint8"
1837
+ }
1838
+ ],
1839
+ "trajectory_sha256": "ef879d841a8e56a46d522766f5cb8c560392cf91cad73b6d7413656d2c2a0e6c",
1840
+ "source_sha256": "a2271ccb1251ede5449872b03829ca0812b76f6f527c67d274ed31d09204034b",
1841
+ "view_sha256": "d3ae02942a1d769d9c4983fcfbf03890a2cc4108dbb4b2cf45148f262a21e395"
1842
+ },
1843
+ {
1844
+ "demo_id": "demo_17",
1845
+ "file": "demo_17.h5",
1846
+ "length": 288,
1847
+ "fields": [
1848
+ {
1849
+ "path": "actions/panda_leaphand-1",
1850
+ "shape": [
1851
+ 288,
1852
+ 22
1853
+ ],
1854
+ "dtype": "float32"
1855
+ },
1856
+ {
1857
+ "path": "actions/panda_leaphand_left-0",
1858
+ "shape": [
1859
+ 288,
1860
+ 22
1861
+ ],
1862
+ "dtype": "float32"
1863
+ },
1864
+ {
1865
+ "path": "obs/agent/panda_leaphand-1/qpos",
1866
+ "shape": [
1867
+ 289,
1868
+ 23
1869
+ ],
1870
+ "dtype": "float32"
1871
+ },
1872
+ {
1873
+ "path": "obs/agent/panda_leaphand-1/qvel",
1874
+ "shape": [
1875
+ 289,
1876
+ 23
1877
+ ],
1878
+ "dtype": "float32"
1879
+ },
1880
+ {
1881
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1882
+ "shape": [
1883
+ 289,
1884
+ 23
1885
+ ],
1886
+ "dtype": "float32"
1887
+ },
1888
+ {
1889
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1890
+ "shape": [
1891
+ 289,
1892
+ 23
1893
+ ],
1894
+ "dtype": "float32"
1895
+ },
1896
+ {
1897
+ "path": "obs/sensor_data/front_camera/rgb",
1898
+ "shape": [
1899
+ 289,
1900
+ 240,
1901
+ 320,
1902
+ 3
1903
+ ],
1904
+ "dtype": "uint8"
1905
+ },
1906
+ {
1907
+ "path": "obs/sensor_data/left_camera/rgb",
1908
+ "shape": [
1909
+ 289,
1910
+ 240,
1911
+ 320,
1912
+ 3
1913
+ ],
1914
+ "dtype": "uint8"
1915
+ },
1916
+ {
1917
+ "path": "obs/sensor_data/robot_camera_0/rgb",
1918
+ "shape": [
1919
+ 289,
1920
+ 240,
1921
+ 320,
1922
+ 3
1923
+ ],
1924
+ "dtype": "uint8"
1925
+ },
1926
+ {
1927
+ "path": "obs/sensor_data/robot_camera_1/rgb",
1928
+ "shape": [
1929
+ 289,
1930
+ 240,
1931
+ 320,
1932
+ 3
1933
+ ],
1934
+ "dtype": "uint8"
1935
+ },
1936
+ {
1937
+ "path": "obs/sensor_data/top_camera/rgb",
1938
+ "shape": [
1939
+ 289,
1940
+ 320,
1941
+ 240,
1942
+ 3
1943
+ ],
1944
+ "dtype": "uint8"
1945
+ }
1946
+ ],
1947
+ "trajectory_sha256": "e6050bda04453f4ba03f9d2bfe6eb716bc6d07894cc72ca07cf3b9d46c09a48b",
1948
+ "source_sha256": "65e939350c95954801958b4d1bf57e95f1bb431f537eeea0a55e577335bccc8f",
1949
+ "view_sha256": "9a38b386f141e22b2b480659ad4288311b4e26e4921c436fa1a91f8df67dcef7"
1950
+ },
1951
+ {
1952
+ "demo_id": "demo_18",
1953
+ "file": "demo_18.h5",
1954
+ "length": 277,
1955
+ "fields": [
1956
+ {
1957
+ "path": "actions/panda_leaphand-1",
1958
+ "shape": [
1959
+ 277,
1960
+ 22
1961
+ ],
1962
+ "dtype": "float32"
1963
+ },
1964
+ {
1965
+ "path": "actions/panda_leaphand_left-0",
1966
+ "shape": [
1967
+ 277,
1968
+ 22
1969
+ ],
1970
+ "dtype": "float32"
1971
+ },
1972
+ {
1973
+ "path": "obs/agent/panda_leaphand-1/qpos",
1974
+ "shape": [
1975
+ 278,
1976
+ 23
1977
+ ],
1978
+ "dtype": "float32"
1979
+ },
1980
+ {
1981
+ "path": "obs/agent/panda_leaphand-1/qvel",
1982
+ "shape": [
1983
+ 278,
1984
+ 23
1985
+ ],
1986
+ "dtype": "float32"
1987
+ },
1988
+ {
1989
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
1990
+ "shape": [
1991
+ 278,
1992
+ 23
1993
+ ],
1994
+ "dtype": "float32"
1995
+ },
1996
+ {
1997
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
1998
+ "shape": [
1999
+ 278,
2000
+ 23
2001
+ ],
2002
+ "dtype": "float32"
2003
+ },
2004
+ {
2005
+ "path": "obs/sensor_data/front_camera/rgb",
2006
+ "shape": [
2007
+ 278,
2008
+ 240,
2009
+ 320,
2010
+ 3
2011
+ ],
2012
+ "dtype": "uint8"
2013
+ },
2014
+ {
2015
+ "path": "obs/sensor_data/left_camera/rgb",
2016
+ "shape": [
2017
+ 278,
2018
+ 240,
2019
+ 320,
2020
+ 3
2021
+ ],
2022
+ "dtype": "uint8"
2023
+ },
2024
+ {
2025
+ "path": "obs/sensor_data/robot_camera_0/rgb",
2026
+ "shape": [
2027
+ 278,
2028
+ 240,
2029
+ 320,
2030
+ 3
2031
+ ],
2032
+ "dtype": "uint8"
2033
+ },
2034
+ {
2035
+ "path": "obs/sensor_data/robot_camera_1/rgb",
2036
+ "shape": [
2037
+ 278,
2038
+ 240,
2039
+ 320,
2040
+ 3
2041
+ ],
2042
+ "dtype": "uint8"
2043
+ },
2044
+ {
2045
+ "path": "obs/sensor_data/top_camera/rgb",
2046
+ "shape": [
2047
+ 278,
2048
+ 320,
2049
+ 240,
2050
+ 3
2051
+ ],
2052
+ "dtype": "uint8"
2053
+ }
2054
+ ],
2055
+ "trajectory_sha256": "c40ef03013a2386bc693939246decbd169803189875715029a7fd241152c6dc4",
2056
+ "source_sha256": "10de9a37fe64e9cea5248baf3f44e0e675f5457e532a97553c5173e7af153859",
2057
+ "view_sha256": "03b7e2c723b35683aafd488d87d681e253eb35461550b331210646f4be4bdb2e"
2058
+ },
2059
+ {
2060
+ "demo_id": "demo_19",
2061
+ "file": "demo_19.h5",
2062
+ "length": 287,
2063
+ "fields": [
2064
+ {
2065
+ "path": "actions/panda_leaphand-1",
2066
+ "shape": [
2067
+ 287,
2068
+ 22
2069
+ ],
2070
+ "dtype": "float32"
2071
+ },
2072
+ {
2073
+ "path": "actions/panda_leaphand_left-0",
2074
+ "shape": [
2075
+ 287,
2076
+ 22
2077
+ ],
2078
+ "dtype": "float32"
2079
+ },
2080
+ {
2081
+ "path": "obs/agent/panda_leaphand-1/qpos",
2082
+ "shape": [
2083
+ 288,
2084
+ 23
2085
+ ],
2086
+ "dtype": "float32"
2087
+ },
2088
+ {
2089
+ "path": "obs/agent/panda_leaphand-1/qvel",
2090
+ "shape": [
2091
+ 288,
2092
+ 23
2093
+ ],
2094
+ "dtype": "float32"
2095
+ },
2096
+ {
2097
+ "path": "obs/agent/panda_leaphand_left-0/qpos",
2098
+ "shape": [
2099
+ 288,
2100
+ 23
2101
+ ],
2102
+ "dtype": "float32"
2103
+ },
2104
+ {
2105
+ "path": "obs/agent/panda_leaphand_left-0/qvel",
2106
+ "shape": [
2107
+ 288,
2108
+ 23
2109
+ ],
2110
+ "dtype": "float32"
2111
+ },
2112
+ {
2113
+ "path": "obs/sensor_data/front_camera/rgb",
2114
+ "shape": [
2115
+ 288,
2116
+ 240,
2117
+ 320,
2118
+ 3
2119
+ ],
2120
+ "dtype": "uint8"
2121
+ },
2122
+ {
2123
+ "path": "obs/sensor_data/left_camera/rgb",
2124
+ "shape": [
2125
+ 288,
2126
+ 240,
2127
+ 320,
2128
+ 3
2129
+ ],
2130
+ "dtype": "uint8"
2131
+ },
2132
+ {
2133
+ "path": "obs/sensor_data/robot_camera_0/rgb",
2134
+ "shape": [
2135
+ 288,
2136
+ 240,
2137
+ 320,
2138
+ 3
2139
+ ],
2140
+ "dtype": "uint8"
2141
+ },
2142
+ {
2143
+ "path": "obs/sensor_data/robot_camera_1/rgb",
2144
+ "shape": [
2145
+ 288,
2146
+ 240,
2147
+ 320,
2148
+ 3
2149
+ ],
2150
+ "dtype": "uint8"
2151
+ },
2152
+ {
2153
+ "path": "obs/sensor_data/top_camera/rgb",
2154
+ "shape": [
2155
+ 288,
2156
+ 320,
2157
+ 240,
2158
+ 3
2159
+ ],
2160
+ "dtype": "uint8"
2161
+ }
2162
+ ],
2163
+ "trajectory_sha256": "8e20705d0179d228886a007ee30c11be49195f662f8bd57882cc2df7a4c7ba5f",
2164
+ "source_sha256": "48e40d0e9b8ccab01c838c837e54e0645c47034e98cdf8b2034df272d38dc3ee",
2165
+ "view_sha256": "e99841d14b7d1e288643a63eaecd4e9460b4c9cf290042baaadfc43d3d028068"
2166
+ }
2167
+ ]
2168
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/environment.lock ADDED
@@ -0,0 +1,249 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ absl-py==2.4.0
2
+ accelerate==1.13.0
3
+ addict==2.4.0
4
+ aiohappyeyeballs==2.6.1
5
+ aiohttp==3.13.5
6
+ aiosignal==1.4.0
7
+ annotated-types==0.7.0
8
+ anyio==4.13.0
9
+ anytree==2.13.0
10
+ asttokens==3.0.1
11
+ async-timeout==5.0.1
12
+ attrs==26.1.0
13
+ av==15.1.0
14
+ blinker==1.9.0
15
+ casadi==3.7.2
16
+ certifi==2026.4.22
17
+ cffi==2.0.0
18
+ charset-normalizer==3.4.7
19
+ click==8.3.3
20
+ cloudpickle==3.1.2
21
+ cmake==4.1.3
22
+ coacd==1.0.11
23
+ colorama==0.4.6
24
+ colorlog==6.10.1
25
+ comm==0.2.3
26
+ ConfigArgParse==1.7.5
27
+ contourpy==1.3.2
28
+ cuda-bindings==12.9.4
29
+ cuda-pathfinder==1.5.4
30
+ cycler==0.12.1
31
+ dacite==1.9.2
32
+ dash==4.1.0
33
+ dataclasses-json==0.6.7
34
+ datasets==4.8.5
35
+ decorator==5.2.1
36
+ deepdiff==8.6.2
37
+ Deprecated==1.3.1
38
+ diffusers==0.35.2
39
+ dill==0.4.1
40
+ docstring_parser==0.18.0
41
+ draccus==0.10.0
42
+ einops==0.8.2
43
+ embreex==4.4.0
44
+ etils==1.13.0
45
+ evdev==1.9.3
46
+ exceptiongroup==1.3.1
47
+ executing==2.2.1
48
+ Farama-Notifications==0.0.6
49
+ fast_simplification==0.1.13
50
+ fastjsonschema==2.21.2
51
+ filelock==3.29.0
52
+ Flask==3.1.3
53
+ fonttools==4.63.0
54
+ freetype-py==2.5.1
55
+ frozenlist==1.8.0
56
+ fsspec==2026.2.0
57
+ genesis-world @ file:///data/gck/genesis-world
58
+ git-filter-repo==2.47.0
59
+ gitdb==4.0.12
60
+ GitPython==3.1.50
61
+ glfw==2.10.0
62
+ gs-madrona==0.0.5
63
+ gstaichi==3.3.0
64
+ gym==0.26.2
65
+ gym-notices==0.1.0
66
+ gymnasium==1.3.0
67
+ h11==0.16.0
68
+ h5py==3.16.0
69
+ hf-xet==1.5.0
70
+ hf_transfer==0.1.9
71
+ httpcore==1.0.9
72
+ httpx==0.28.1
73
+ huggingface-hub==0.35.3
74
+ idna==3.15
75
+ ImageIO==2.37.3
76
+ imageio-ffmpeg==0.6.0
77
+ importlib_metadata==9.0.0
78
+ importlib_resources==7.1.0
79
+ inquirerpy==0.3.4
80
+ ipython==8.39.0
81
+ ipywidgets==8.1.8
82
+ itsdangerous==2.2.0
83
+ jedi==0.20.0
84
+ Jinja2==3.1.6
85
+ joblib==1.5.3
86
+ jsonlines==4.0.0
87
+ jsonschema==4.26.0
88
+ jsonschema-specifications==2025.9.1
89
+ jupyter_core==5.9.1
90
+ jupyterlab_widgets==3.0.16
91
+ kiwisolver==1.5.0
92
+ lazy-loader==0.5
93
+ lerobot==0.4.4
94
+ libigl==2.6.2
95
+ llvmlite==0.47.0
96
+ loguru==0.7.3
97
+ lxml==6.1.0
98
+ manifold3d==3.4.1
99
+ -e git+ssh://git@github.com/HeegerGao/maniladder.git@f6eed17496816bb41ce484f2d7580990a908d3e6#egg=maniladder
100
+ mapbox_earcut==2.0.0
101
+ markdown-it-py==4.2.0
102
+ MarkupSafe==3.0.3
103
+ marshmallow==3.26.2
104
+ matplotlib==3.10.9
105
+ matplotlib-inline==0.2.2
106
+ mdurl==0.1.2
107
+ mergedeep==1.3.4
108
+ moviepy==2.2.1
109
+ mpmath==1.3.0
110
+ msgspec==0.21.1
111
+ mujoco==3.8.1
112
+ multidict==6.7.1
113
+ multiprocess==0.70.19
114
+ mypy_extensions==1.1.0
115
+ nbformat==5.10.4
116
+ nest-asyncio==1.6.0
117
+ networkx==3.4.2
118
+ ninja==1.13.0
119
+ nlopt==2.10.0
120
+ numba==0.65.1
121
+ numpy @ file:///home/conda/feedstock_root/build_artifacts/numpy_1747544640217/work/dist/numpy-2.2.6-cp310-cp310-linux_x86_64.whl#sha256=d6d964caeef85d00073d27cd62b46883d275b3d8162f723f0fcabbd0b3cc3f9d
122
+ nvidia-cublas-cu12==12.8.4.1
123
+ nvidia-cuda-cupti-cu12==12.8.90
124
+ nvidia-cuda-nvrtc-cu12==12.8.93
125
+ nvidia-cuda-runtime-cu12==12.8.90
126
+ nvidia-cudnn-cu12==9.10.2.21
127
+ nvidia-cufft-cu12==11.3.3.83
128
+ nvidia-cufile-cu12==1.13.1.3
129
+ nvidia-curand-cu12==10.3.9.90
130
+ nvidia-cusolver-cu12==11.7.3.90
131
+ nvidia-cusparse-cu12==12.5.8.93
132
+ nvidia-cusparselt-cu12==0.7.1
133
+ nvidia-nccl-cu12==2.27.5
134
+ nvidia-nvjitlink-cu12==12.8.93
135
+ nvidia-nvshmem-cu12==3.4.5
136
+ nvidia-nvtx-cu12==12.8.90
137
+ open3d==0.19.0
138
+ opencv-python==4.13.0.92
139
+ opencv-python-headless==4.12.0.88
140
+ OpenEXR==3.4.11
141
+ orderly-set==5.5.0
142
+ packaging==25.0
143
+ pandas==2.3.3
144
+ parso==0.8.7
145
+ pexpect==4.9.0
146
+ pfzy==0.3.4
147
+ pillow==11.3.0
148
+ pin==4.0.0
149
+ pip @ file:///home/task_177498883471825/croot/pip_1774988882575/work
150
+ platformdirs==4.9.6
151
+ plotly==5.24.1
152
+ polyscope==2.6.1
153
+ proglog==0.1.12
154
+ prompt_toolkit==3.0.52
155
+ propcache==0.5.2
156
+ protobuf==6.33.6
157
+ psutil==7.2.2
158
+ ptyprocess==0.7.0
159
+ pure_eval==0.2.3
160
+ py-cpuinfo==9.0.0
161
+ py-spy==0.4.2
162
+ pyarrow==24.0.0
163
+ pycollada==0.9.3
164
+ pycparser==3.0
165
+ pydantic==2.13.4
166
+ pydantic_core==2.46.4
167
+ PyGEL3D==0.6.1
168
+ pyglet==2.1.14
169
+ pygltflib==1.16.0
170
+ Pygments==2.20.0
171
+ pymeshlab==2025.7.post1
172
+ pynput==1.8.2
173
+ PyOpenGL==3.1.10
174
+ pyparsing==3.3.2
175
+ pyperclip==1.11.0
176
+ PyQt6==6.11.0
177
+ PyQt6-Qt6==6.11.0
178
+ PyQt6_sip==13.11.1
179
+ pyquaternion==0.9.9
180
+ pyserial==3.5
181
+ pysplashsurf==0.12.0.2
182
+ python-dateutil==2.9.0.post0
183
+ python-dotenv==1.2.2
184
+ python-xlib==0.33
185
+ pytransform3d==3.15.0
186
+ pytz==2026.2
187
+ pyuipc @ file:///tmp/claude-1005/-mnt4-gck-maniladder/9f005e67-04f6-4368-bd0e-9f40896c7dbf/scratchpad/pyuipc_dl/pyuipc-0.0.25-cp310-cp310-manylinux_2_34_x86_64.whl#sha256=76ff13554e1971ea4401db2c875369cf32352ae3a5a4c398c45193231b5cbf00
188
+ PyYAML==6.0.3
189
+ pyyaml-include==1.4.1
190
+ referencing==0.37.0
191
+ regex==2026.5.9
192
+ requests==2.34.2
193
+ rerun-sdk==0.26.2
194
+ retrying==1.4.2
195
+ rich==14.3.4
196
+ rpds-py==0.30.0
197
+ rtree==1.4.1
198
+ safetensors==0.7.0
199
+ sapien==3.0.3
200
+ scikit-image==0.25.2
201
+ scikit-learn==1.7.2
202
+ scipy @ file:///home/conda/feedstock_root/build_artifacts/scipy-split_1739790642651/work/dist/scipy-1.15.2-cp310-cp310-linux_x86_64.whl#sha256=9e52bad6c3294d1a5b04a13632118ca2157130603c6c018c2d710162b223b27e
203
+ sentry-sdk==2.60.0
204
+ setuptools==80.10.2
205
+ shapely==2.1.2
206
+ six==1.17.0
207
+ smmap==5.0.3
208
+ stack-data==0.6.3
209
+ svg.path==7.0
210
+ sympy==1.14.0
211
+ tenacity==9.1.4
212
+ termcolor==3.3.0
213
+ tetgen==0.8.4
214
+ threadpoolctl==3.6.0
215
+ tifffile==2025.5.10
216
+ timm==1.0.27
217
+ toml==0.10.2
218
+ torch==2.10.0
219
+ torchaudio==2.11.0
220
+ torchcodec==0.10.0
221
+ torchvision==0.25.0
222
+ tqdm==4.67.3
223
+ traitlets==5.15.0
224
+ transforms3d==0.4.2
225
+ trimesh==4.12.2
226
+ triton==3.6.0
227
+ typeguard==4.5.2
228
+ typing-inspect==0.9.0
229
+ typing-inspection==0.4.2
230
+ typing_extensions==4.15.0
231
+ tyro==1.0.13
232
+ tzdata==2026.2
233
+ urllib3==2.7.0
234
+ vhacdx==0.0.10
235
+ viser==1.0.27
236
+ vtk==9.6.1
237
+ wandb==0.24.2
238
+ wcwidth==0.7.0
239
+ websockets==16.0
240
+ Werkzeug==3.1.8
241
+ wheel==0.46.3
242
+ widgetsnbextension==4.0.15
243
+ wrapt==2.1.2
244
+ xxhash==3.7.0
245
+ yarl==1.23.0
246
+ yourdfpy==0.0.60
247
+ z3-solver==4.16.0.0
248
+ zipp==3.23.1
249
+ zstandard==0.25.0
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/findings.md ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Findings through exploration episode 4
2
+
3
+ The authorized offline D20 analysis is in ../demo_analysis.md, with immutable bank row provenance in bank_provenance.json. All 20 demos contribute. No neural finetuning occurred.
4
+
5
+ Localization and pose: fixed RGB/color occupancy plus proprioception retrieve scene-conditioned examples; camera/root calibration and absolute yaw remain unknown. Square yaw ambiguity, occlusion, and cross-example blending are limitations.
6
+
7
+ Grasp: episodes 1, 3, and 4 visibly lifted cloth. Contact is inferred from legal images, not contact state. Transfer was visibly achieved in these trials.
8
+
9
+ Timing and release: episode 1 stopped at 323 actions on endpoint similarity while cloth was visibly raised. Episode 2 independently rehearsed stronger image weighting with that early stop and returned native success false. Episode 3 removed early stopping and achieved native success at step 329. Episode 4 used image weight 8 and neutral-hand opening after phase .94; native success occurred at step 318. Thus endpoint similarity is retained only as a diagnostic, and settling is allowed.
10
+
11
+ Recovery: modest phase regression is permitted. Reliable drop detection or regrasp is not established. Do not describe this as general recovery competence.
12
+
13
+ Program failure: episode 3's exploration recorder attempted one action after native termination. API rejected it without a native step. Recorder now stops on terminated/truncated. Executed and rejected attempted actions are separated in evidence. Candidate independent rehearsal 2 completed validly.
14
+
15
+ Current evidence is small and layouts vary; interactive results are not independent rehearsal success rates. Later ledger entries and exact rehearsal results are recorded outside this snapshot until final documentation.
16
+
17
+ ## Continuation through episode 9
18
+ Episodes5,6,8 failed natively at horizon. Neutral opening and backward withdrawal did not reliably release cloth, so these modifications were rejected. V3 original hand actions with continued settling succeeded in episodes3,7, but failed8 after asymmetric lift. V8 adds initial RGB descriptor scene preference while retaining current image/proprioception feedback. Episode9 was interrupted at native248 without a saved outcome. Episode10 tests unchanged V8. Recovery from missed or asymmetric grasp remains unestablished.
19
+
20
+ ## Independent comparison after episode12
21
+ V8 initial-scene preference achieved native success in interactive10 and independent11, but failed independent12. Exact V8 bundle e296f5de033cea2ff95b09b6681c00ff813f892339d0410a56884e38316de766 has 1/2 native independent successes. The candidate now restores V3 original hand actions and current-observation matching, without initial-scene bias. V3 succeeded interactive3,7 and failed8; its independent reliability is not yet established. The return for12 supplies native failure but no images, so its physical failure mode is unknown.
22
+
23
+ ## Comparison through episode14 and next candidate
24
+ Independent13 was a valid native success and independent14 a valid native failure for V3 bundle07cf6578c4e5228ba4c7e4f9f29a4e1e25707282afa6bd4bde85f636b0882655. Both scene-weight16 and scene-weight0 therefore have1/2 independent success. This candidate uses scene-weight8 as a compromise between layout consistency and adaptation. No additional grasp, pose, release, timing, or recovery changes are introduced. This hand-chosen change is not neural training and its performance remains to be independently established. Native-feedback-only rehearsal returns do not reveal physical failure causes.
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/freeze_manifest.json ADDED
@@ -0,0 +1,149 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "files": {
3
+ "__pycache__/build_bank.cpython-310.pyc": "f5a360dc7b14866bdfef9fe6cbe996a6fae96f29ae9ff68f7226c1f70adb400e",
4
+ "__pycache__/controller.cpython-310.pyc": "a47096b00e0cf23aae9db2f47d5fb4020c8169d680f5335af9ae7014e5bc73c3",
5
+ "__pycache__/synthetic_checks.cpython-310.pyc": "8db46dcb714f2329ab0837cfddc1b408e4f5d819d4b6cca164b8d1d319f88f05",
6
+ "bank_provenance.json": "af1ebe3d9e80aedaa25b795d856e9bd578780c8d14a695d28ac0f0ffaf7b88f8",
7
+ "build_bank.py": "76ba6f69cef10ab7c03b70def0a06c5408200cc9e23afd6ce4cc8c205cabaeb4",
8
+ "controller.py": "83a17b246dfc9365d06aaaec106f815594ae76aba8c1432b9582a922d08a0e92",
9
+ "demo_bank.npz": "94b22194ba5904fa2de5968ea345990893ac5ca0e5772d3f658bb2df6925fd5d",
10
+ "demo_manifest.json": "1746cfe54336b4d0d1a329df21263b32f9e29a8aeb8467d0828c181ccca8c1eb",
11
+ "demonstrations_readonly/demo_00.h5": "ee5396bb3f95889b68f0ac1a5a68d3e4ace91927549ad3104a51e0d08c01c8f4",
12
+ "demonstrations_readonly/demo_01.h5": "dadf39714ec47a2197289c2d7b3e442e69014f27e01289464971ad51f2e85fcc",
13
+ "demonstrations_readonly/demo_02.h5": "3a68e49d12048d752c06fcc18cc0ea82e39bb5808e67fe6304f850417583167b",
14
+ "demonstrations_readonly/demo_03.h5": "751e7f3193d5e4c236cf1ba24153d8bc7a5bd6319dd192640c3b09beb773e978",
15
+ "demonstrations_readonly/demo_04.h5": "51c563e892261ada3c26d45fd282447fa7aef0b4f5531f42466c69f486f79985",
16
+ "demonstrations_readonly/demo_05.h5": "8941219225da56cd7a983d21ca3265b1282e2b6a89442e37c69cfa394c1bdf5b",
17
+ "demonstrations_readonly/demo_06.h5": "aeff77cf6b71332dd164d3b07ad983844de57002957fed3f06281df58b5daec6",
18
+ "demonstrations_readonly/demo_07.h5": "65672147188dedf12e84137c5c42aac9a68c889e47ade08989e26c9d7d471a84",
19
+ "demonstrations_readonly/demo_08.h5": "0420bebe99a2376aff2c8a95f14d7da09116101ad9188044178604f8d8a953f5",
20
+ "demonstrations_readonly/demo_09.h5": "10a01c5a20df9ecb2b8909afac1e444b4f2478df85a35460cc8d6bda09da981a",
21
+ "demonstrations_readonly/demo_10.h5": "3e40a2ba60e2cc67244d1ce64996ec7b77baf6d89ab5d206a91c0ae0280b6dc3",
22
+ "demonstrations_readonly/demo_11.h5": "18abd9b7cf9eeff71e229d7b116c9b47fbeb96502eb20a50050f2060884cd154",
23
+ "demonstrations_readonly/demo_12.h5": "131138956c8172b0b65bfc105728d170e81f1f38b9662a70eaa6ae3af93ceb2f",
24
+ "demonstrations_readonly/demo_13.h5": "7b884550c79df632017bbe2b892bb35230eb17f8b64100042c94802341e67b10",
25
+ "demonstrations_readonly/demo_14.h5": "42aa696af5ce97842036930165104c22b0c05dcb3f7cf36fe40b855bdea9f060",
26
+ "demonstrations_readonly/demo_15.h5": "51450b2dfb879238267089771f34a4645335b021b3893e6440f2d7b07b3f4c00",
27
+ "demonstrations_readonly/demo_16.h5": "d3ae02942a1d769d9c4983fcfbf03890a2cc4108dbb4b2cf45148f262a21e395",
28
+ "demonstrations_readonly/demo_17.h5": "9a38b386f141e22b2b480659ad4288311b4e26e4921c436fa1a91f8df67dcef7",
29
+ "demonstrations_readonly/demo_18.h5": "03b7e2c723b35683aafd488d87d681e253eb35461550b331210646f4be4bdb2e",
30
+ "demonstrations_readonly/demo_19.h5": "e99841d14b7d1e288643a63eaecd4e9460b4c9cf290042baaadfc43d3d028068",
31
+ "environment.lock": "f9f11f093744865020243315494d48c69e38ff9e67783e7cf5f0a1e5f22b34aa",
32
+ "findings.md": "9385940cf33907d032eafd53d0c63a245bd6cdcae3ae798141403e2adc5b670a",
33
+ "handoff.md": "1b2e37ab0e8bf8955f8ce5ffc82e0e5e113973e34b40349b68015dc15d610604",
34
+ "model_tool_manifest.yaml": "cf32cd70305ffb9693d4cd11ab9254c196d7273f18b95b95e3105e010507c438",
35
+ "policy_runner.py": "cd8a30fc763583fb9bf6570414f01d56aba16241c733fc0cdfdfab0f8f27270e",
36
+ "skills.md": "529df0824505d09320c91c3ec5553dccb1c378c30875e8bb68b3f068d3a98207",
37
+ "synthetic_check_results.json": "2961b20f7212b967bc6988265717ef823a685eaedcd6ab04adb8219cea106d08",
38
+ "synthetic_checks.py": "92cc6d9d28de4d9a88df2e0c66502945d4e6769562236533938f4fb6ffcb045f",
39
+ "worker_api.py": "88cca5fa5c1c9570ca2bd90e8848f67c09224fa498d94e63634ad191e913c41e"
40
+ },
41
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
42
+ "exploration_ledger_hash": "fc4149edf39f78a7aa9eea31b42f11ddd9400a35a04232e63751da4e30463cd6",
43
+ "entrypoint": "controller.reset_episode(); controller.act(obs)",
44
+ "selection": {
45
+ "rule": "exact-version success rate, valid rehearsal count, recency",
46
+ "rehearsals": [
47
+ {
48
+ "bundle_hash": "09f9858a07cbe12543d2dbdab45fcef3312438d3179823a1ee3393259fdb580f",
49
+ "episode": 2,
50
+ "independent": true,
51
+ "score_source": "native_step_feedback",
52
+ "status": "finished",
53
+ "success": false,
54
+ "valid": true
55
+ },
56
+ {
57
+ "bundle_hash": "e296f5de033cea2ff95b09b6681c00ff813f892339d0410a56884e38316de766",
58
+ "episode": 11,
59
+ "independent": true,
60
+ "score_source": "native_step_feedback",
61
+ "status": "finished",
62
+ "success": true,
63
+ "valid": true
64
+ },
65
+ {
66
+ "bundle_hash": "e296f5de033cea2ff95b09b6681c00ff813f892339d0410a56884e38316de766",
67
+ "episode": 12,
68
+ "independent": true,
69
+ "score_source": "native_step_feedback",
70
+ "status": "finished",
71
+ "success": false,
72
+ "valid": true
73
+ },
74
+ {
75
+ "bundle_hash": "07cf6578c4e5228ba4c7e4f9f29a4e1e25707282afa6bd4bde85f636b0882655",
76
+ "episode": 13,
77
+ "independent": true,
78
+ "score_source": "native_step_feedback",
79
+ "status": "finished",
80
+ "success": true,
81
+ "valid": true
82
+ },
83
+ {
84
+ "bundle_hash": "07cf6578c4e5228ba4c7e4f9f29a4e1e25707282afa6bd4bde85f636b0882655",
85
+ "episode": 14,
86
+ "independent": true,
87
+ "score_source": "native_step_feedback",
88
+ "status": "finished",
89
+ "success": false,
90
+ "valid": true
91
+ },
92
+ {
93
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
94
+ "episode": 15,
95
+ "independent": true,
96
+ "score_source": "native_step_feedback",
97
+ "status": "finished",
98
+ "success": true,
99
+ "valid": true
100
+ },
101
+ {
102
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
103
+ "episode": 16,
104
+ "independent": true,
105
+ "score_source": "native_step_feedback",
106
+ "status": "finished",
107
+ "success": true,
108
+ "valid": true
109
+ },
110
+ {
111
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
112
+ "episode": 17,
113
+ "independent": true,
114
+ "score_source": "native_step_feedback",
115
+ "status": "finished",
116
+ "success": true,
117
+ "valid": true
118
+ },
119
+ {
120
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
121
+ "episode": 18,
122
+ "independent": true,
123
+ "score_source": "native_step_feedback",
124
+ "status": "finished",
125
+ "success": false,
126
+ "valid": true
127
+ },
128
+ {
129
+ "bundle_hash": "c8199f2a0e50d84325ee6ab859a0037852a3e70d6b5a846e0296ec16d0b943f3",
130
+ "episode": 19,
131
+ "independent": true,
132
+ "score_source": "native_step_feedback",
133
+ "status": "finished",
134
+ "success": true,
135
+ "valid": true
136
+ },
137
+ {
138
+ "episode": 20,
139
+ "bundle_hash": null,
140
+ "independent": true,
141
+ "valid": false,
142
+ "status": "infrastructure_interrupted",
143
+ "success": false,
144
+ "score_source": "interrupted_no_score",
145
+ "recovery": "durable_rehearsal_request_and_charged_episode; no replay"
146
+ }
147
+ ]
148
+ }
149
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/handoff.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # E20 controller handoff
2
+
3
+ Entry points: controller.reset_episode() and controller.act(obs). Required files: controller.py and demo_bank.npz. Runtime dependencies are NumPy and OpenCV; bank paths are relative to controller.py. The runner supplies the verified D20 manifest, readonly demonstrations, and environment lock.
4
+
5
+ Native task: DualArmCoverCloth-v1; 44-dimensional pd_ee_delta_pose actions at 20 Hz; 400 native steps including runner-owned hold step 1. Action order is panda_leaphand-1 (22), then panda_leaphand_left-0 (22). Each part contains root-frame translation, rotation, and 16 hand joint deltas. Policy uses current RGB and qpos/qvel. It never initializes or resets a simulator.
6
+
7
+ The current candidate removes an unreliable early endpoint stop and uses current-image and proprioception nearest-neighbor matching with a modest initial-scene preference of weight 8. Original demonstrated hand deltas are retained; neutral opening and withdrawal experiments were rejected. Endpoint similarity is diagnostic only. Termination is not a success assertion. The runner must honor native terminated/truncated flags.
8
+
9
+ Exploration evidence is preserved in the parent evidence/ directory. Original offline-only reports are retained under evidence/preparation_docs. Exact independent rehearsals, not interactive success alone, determine the frozen submission. No performance beyond recorded native returns is claimed.
10
+
11
+ This version is the compromise selected for episodes15-16 after both initial-scene weight16 and weight0 returned one native success and one failure in independent comparison. Later exact rehearsal outcomes are recorded in the parent exploration ledger; no success is claimed for this version before its own rehearsals. All final trials must use an independently rehearsed exact bundle.
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/model_tool_manifest.yaml ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema_version": 1,
3
+ "stage": "authorized_E20_exploration",
4
+ "neural_finetuning": false,
5
+ "pretrained_weights_modified": false,
6
+ "frozen_weight_references": [],
7
+ "runtime_dependencies": [
8
+ {
9
+ "name": "numpy",
10
+ "version": "2.2.6"
11
+ },
12
+ {
13
+ "name": "opencv-python",
14
+ "version": "4.13.0.92"
15
+ }
16
+ ],
17
+ "python_version": "3.10.20",
18
+ "runtime_network": false,
19
+ "runtime_external_models": false,
20
+ "runtime_agent": false,
21
+ "runtime_simulator_imports": false,
22
+ "inputs": [
23
+ "top_camera RGB",
24
+ "front_camera RGB",
25
+ "both robots qpos/qvel",
26
+ "step_id"
27
+ ],
28
+ "action_contract": "44 native normalized deltas, right-key then left-key, bounds [-1,1]",
29
+ "demo_count": 20,
30
+ "expert_action_count": 5942,
31
+ "bank_observation_rows": 5962,
32
+ "terminal_synthetic_rows": 20,
33
+ "provenance": "bank_provenance.json; ../demo_analysis.md; ../evidence/",
34
+ "runtime_assets": {
35
+ "controller.py": "83a17b246dfc9365d06aaaec106f815594ae76aba8c1432b9582a922d08a0e92",
36
+ "demo_bank.npz": "94b22194ba5904fa2de5968ea345990893ac5ca0e5772d3f658bb2df6925fd5d",
37
+ "bank_provenance.json": "af1ebe3d9e80aedaa25b795d856e9bd578780c8d14a695d28ac0f0ffaf7b88f8"
38
+ },
39
+ "notes": "JSON is YAML-compatible. Runner adds verified demo manifest, readonly demos and common lock. Exploration uses only trusted worker_api; no neural training."
40
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/policy_runner.py ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Frozen-program entry point; no development agent and no reset capability."""
2
+ import importlib.util
3
+ import sys
4
+
5
+ sys.path.insert(0,'/artifact')
6
+ sys.path.insert(0,'/')
7
+ from worker_api import API
8
+
9
+
10
+ def main():
11
+ spec=importlib.util.spec_from_file_location('controller','/artifact/controller.py')
12
+ module=importlib.util.module_from_spec(spec)
13
+ spec.loader.exec_module(module)
14
+ module.reset_episode()
15
+ api=API()
16
+ result=api.latest_observation()
17
+ while not (result['terminated'] or result['truncated'] or result['horizon_reached']):
18
+ obs=dict(result['observation'],step_id=result['step_id'])
19
+ action=module.act(obs)
20
+ if action is None:break
21
+ response=api.execute_actions([action])
22
+ result=response['steps'][-1]
23
+
24
+
25
+ if __name__=='__main__':main()
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/skills.md ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ # Compiled controller skills
2
+
3
+ - Localize scene appearance using fixed top/front RGB grids and yellow/white occupancy. No calibrated pose, depth, segmentation labels, or hidden state.
4
+ - Match current arm/hand positions and velocities against the authorized 20-demo bank, with an observation-updated phase window. This supports demonstrated approach, grasp, lift, transfer, and placement motions.
5
+ - Blend five nearby native action vectors in the required robot order. Rotation channels remain zero as in every authorized demonstration.
6
+ - Preserve demonstrated hand commands during placement and release. A modest initial two-camera visual preference (weight 8) discourages incompatible layout switches; current RGB and proprioception select nearby examples on every action.
7
+ - Continue observing during release and settling; return None only for invalid required input or native horizon. The environment owns success termination.
8
+
9
+ No generic dropped-cloth recovery is claimed. The phase window permits modest regression but cannot restart a failed grasp reliably. No neural weights, network, external model, task simulator, or agent are needed at runtime.
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/synthetic_check_results.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "scope": "syntax and fabricated observation interface checks only",
3
+ "passed": true,
4
+ "checks": [
5
+ "compile",
6
+ "44-vector float32 finite native bounds",
7
+ "HWC/1HWC equivalence",
8
+ "reset determinism",
9
+ "RGB perturbation changes output",
10
+ "proprioception perturbation changes output",
11
+ "step 399 emits action",
12
+ "step 400 finishes",
13
+ "missing RGB finishes",
14
+ "nonfinite proprioception finishes"
15
+ ],
16
+ "first_call_seconds_local_synthetic": 0.20044974889606237,
17
+ "rgb_action_max_change": 0.030082233250141144,
18
+ "q_action_max_change": 0.00035074353218078613,
19
+ "task_performance_tested": false
20
+ }
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/synthetic_checks.py ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Interface checks only. No demo observation, simulator, or environment rollout."""
2
+ import json,py_compile,time
3
+ from pathlib import Path
4
+ import numpy as np
5
+ import controller as c
6
+ root=Path(__file__).resolve().parent
7
+ for file in ('controller.py','build_bank.py','synthetic_checks.py'):
8
+ py_compile.compile(str(root/file),doraise=True)
9
+ # Fabricated values: not sampled from any demonstration or task state.
10
+ q=np.array([0,-.4,0,-1.8,0,1.5,.6]+[.2]*16,dtype=np.float32)
11
+ p={path:(q.copy() if path.endswith('qpos') else np.zeros(23,np.float32)) for path in c.PATHS}
12
+ im=np.full((320,240,3),90,np.uint8);im[100:180,120:200]=[250,220,20]
13
+ front=np.full((240,320,3),100,np.uint8);front[100:140,100:140]=255
14
+ obs={'rgb':{'top_camera':im,'front_camera':front},'proprioception':p,'instruction':'Synthetic interface check','step_id':1}
15
+ c.reset_episode();start=time.perf_counter();a=c.act(obs);elapsed=time.perf_counter()-start
16
+ assert a.shape==(44,) and a.dtype==np.float32 and np.isfinite(a).all() and (abs(a)<=1).all()
17
+ c.reset_episode();b=c.act({**obs,'rgb':{k:v[None] for k,v in obs['rgb'].items()}});assert np.array_equal(a,b)
18
+ c.reset_episode();assert np.array_equal(a,c.act(obs))
19
+ shift={'top_camera':np.roll(im,50,axis=1),'front_camera':np.roll(front,30,axis=0)}
20
+ assert not np.array_equal(c.visual_features(obs['rgb']),c.visual_features(shift))
21
+ c.reset_episode();changed=c.act({**obs,'rgb':shift});rgb_delta=float(np.max(abs(changed-a)))
22
+ c.reset_episode();shiftp={k:v.copy() for k,v in p.items()};shiftp[c.PATHS[0]][0]+=.3
23
+ changedq=c.act({**obs,'proprioception':shiftp});q_delta=float(np.max(abs(changedq-a)))
24
+ assert rgb_delta>0 and q_delta>0
25
+ c.reset_episode();z=c.act({**obs,'step_id':399});assert z.shape==(44,)
26
+ assert c.act({**obs,'step_id':400}) is None
27
+ c.reset_episode();assert c.act({**obs,'rgb':{}}) is None
28
+ badp={k:v.copy() for k,v in p.items()};badp[c.PATHS[0]][0]=np.nan
29
+ assert c.act({**obs,'proprioception':badp}) is None
30
+ result={'scope':'syntax and fabricated observation interface checks only','passed':True,'checks':['compile','44-vector float32 finite native bounds','HWC/1HWC equivalence','reset determinism','RGB perturbation changes output','proprioception perturbation changes output','step 399 emits action','step 400 finishes','missing RGB finishes','nonfinite proprioception finishes'],'first_call_seconds_local_synthetic':elapsed,'rgb_action_max_change':rgb_delta,'q_action_max_change':q_delta,'task_performance_tested':False}
31
+ (root/'synthetic_check_results.json').write_text(json.dumps(result,indent=2));print(json.dumps(result,indent=2))
agent_d20_e20/frozen_20261102/tasks/DualArmCoverCloth-v1/frozen/worker_api.py ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Standalone worker client; safe to mount without the runner package."""
2
+ import base64
3
+ import json
4
+ import socket
5
+ import struct
6
+ import uuid
7
+ import os
8
+ from pathlib import Path
9
+
10
+ import numpy as np
11
+
12
+
13
+ def array_hook(value):
14
+ if value.get('__array__') is True:
15
+ dtype=np.dtype(value['dtype'])
16
+ if dtype.kind not in 'bifu':raise ValueError('non-numeric array from service')
17
+ raw=base64.b64decode(value['data'],validate=True)
18
+ return np.frombuffer(raw,dtype=dtype).reshape(value['shape']).copy()
19
+ return value
20
+
21
+
22
+ class API:
23
+ def __init__(self,socket_path='/rpc/control.sock',demo_root='/demonstrations',manifest='/demo_manifest.json'):
24
+ self.socket_path=socket_path
25
+ self.demo_root=Path(demo_root)
26
+ self.manifest=Path(manifest)
27
+
28
+ def call(self,method,arguments=None,request_id=None):
29
+ # Caller can persist a request ID before sending. Never automatically retry.
30
+ request_id=request_id or str(uuid.uuid4())
31
+ request={'request_id':request_id,'method':method,'arguments':arguments or {}}
32
+ if os.environ.get('AGENT_E20_RPC_TOKEN'):
33
+ request['token']=os.environ['AGENT_E20_RPC_TOKEN']
34
+ payload=json.dumps(request,allow_nan=False).encode()
35
+ if len(payload)>65536:raise ValueError('request too large')
36
+ with socket.socket(socket.AF_UNIX,socket.SOCK_STREAM) as s:
37
+ s.settimeout(1810);s.connect(self.socket_path)
38
+ s.sendall(struct.pack('!I',len(payload))+payload)
39
+ def exact(n):
40
+ chunks=[]
41
+ while n:
42
+ chunk=s.recv(min(n,1024*1024))
43
+ if not chunk:raise RuntimeError('RPC interrupted; do not replay action with a new ID')
44
+ chunks.append(chunk);n-=len(chunk)
45
+ return b''.join(chunks)
46
+ length=struct.unpack('!I',exact(4))[0]
47
+ if length>64*1024*1024:raise RuntimeError('response too large')
48
+ result=json.loads(exact(length),object_hook=array_hook)
49
+ if not result['ok']:raise RuntimeError(result['error'])
50
+ return result['result']
51
+
52
+ def next_episode(self,request_id=None):return self.call('next_episode',request_id=request_id)
53
+ def latest_observation(self):return self.call('latest_observation')
54
+ def execute_actions(self,actions,request_id=None):
55
+ return self.call('execute_actions',{'actions':np.asarray(actions).tolist()},request_id)
56
+ def finish_episode(self):return self.call('finish_episode')
57
+ def budget_status(self):return self.call('budget_status')
58
+ def rehearse(self,candidate='candidate',request_id=None):
59
+ return self.call('rehearse',{'candidate':candidate},request_id)
60
+ def score_rehearsal(self,episode,visible_success,evidence):
61
+ return self.call('score_rehearsal',{'episode':episode,'visible_success':visible_success,'evidence':evidence})
62
+ def freeze(self):return self.call('freeze')
63
+
64
+ def read_demo(self,demo_id,start=0,stop=None,fields=None):
65
+ import h5py
66
+ manifest=json.loads(self.manifest.read_text())
67
+ if manifest.get('status') not in ('released','released_for_offline_analysis'):
68
+ raise RuntimeError('demonstrations not released by trusted preflight')
69
+ entries={e['demo_id']:e for e in manifest['episodes']}
70
+ if demo_id not in entries:raise ValueError('unauthorized demo ID')
71
+ entry=entries[demo_id]
72
+ allowed={f['path'] for f in entry['fields']}
73
+ fields=sorted(allowed) if fields is None else fields
74
+ if not set(fields)<=allowed:raise ValueError('unauthorized demo field')
75
+ stop=entry['length']+1 if stop is None else stop
76
+ if not isinstance(start,int) or not isinstance(stop,int) or not 0<=start<stop<=entry['length']+1:
77
+ raise ValueError('invalid frame interval')
78
+ path=(self.demo_root/entry['file']).resolve()
79
+ if path.parent!=self.demo_root.resolve():raise ValueError('invalid demo file')
80
+ with h5py.File(path,'r') as f:
81
+ return {field:f[field][start:min(stop,len(f[field]))] for field in fields}
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_00.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86d12baa67226bbce45df91f6f4bf6a42211454bb0b2530f5ecb5798deba7923
3
+ size 74035370
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_01.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6feaae38a42aef0fc87ecb572f7856cc9815e92a64b733817b479e1a5d313b3
3
+ size 83823461
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_02.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41442c9de6cbec0e18c328b8c887a9fa718bdb6429f5d0ed092020134bd1e950
3
+ size 78185025
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_05.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbd22f18a95edb6616339cc5d4a4cba2a4d8f9dc3e68ca5dda206b078bee05df
3
+ size 76427276
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_07.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad31e5e2ced962e40029d678ebe9088f55cccc1c417574088f2ce0d3373db2e4
3
+ size 79093682
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_10.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b45758b14889ea559055c57814a2e9b94d00c876a8edede1446a0e39f6fb4db
3
+ size 71907835
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_11.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14939697824e6d08d6dfd648b906885f80bf87b7378eab0af13038696e83a241
3
+ size 74101257
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_12.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04c92be1d6924fa9f0799187a9b07b6f215c94dceaaf3531eea94df3986ec42e
3
+ size 84997678
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_13.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10b787ce6f5251fea712d9931d6644ce54fc7934141844d55b836d03f3f24cae
3
+ size 72055352
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_14.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49ad3137e5f12e607be76b780dfe0ecba47e8ea8fa7ca579ffc9b922f177f38c
3
+ size 72844051
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_15.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e237032a791b021736c6dd4ed5d73f6e91f569866c98c451e91786b8126fdffb
3
+ size 76498125
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_16.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90332e029671cf6c6937fc2e3bfa4ac5190c240f85363da5dc4301b691ef5691
3
+ size 73141862
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_17.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90ca9e1b8e1ed2f092246918126c1660ee8f3f8eeaba56b2761932cbeaa5f0bd
3
+ size 77213005
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/demonstrations_readonly/demo_18.h5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e3834be653bff024b52bd0e591ede700c8be788ccfe9833414293f9f9300188
3
+ size 73029012
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/reference_bank.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e172f702629b75ab09a30cbe3cdaa503370cfe7269512f4bc58b41b47161b7d8
3
+ size 7135640
agent_d20_e20/frozen_20261102/tasks/DualArmFoldHandKerchief-v1/frozen/servo_bank.npz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a49af7b71e87d28e3609d70143548927807532ec7b8b94a2d62592b26023f6c
3
+ size 461959
agent_d20_e20/frozen_20261102/tasks/DualArmJumpRope-v1/frozen/controller.py ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Task-local compiled controller: observation-conditioned reference actions,
2
+ image-derived block timing, and bounded arm/hand pose corrections.
3
+ No network, neural model, simulator, task state, or episode-identity access.
4
+ """
5
+ from pathlib import Path
6
+ import importlib.util
7
+ import numpy as np
8
+ _spec=importlib.util.spec_from_file_location('_d20_features',Path(__file__).with_name('features.py'))
9
+ _f=importlib.util.module_from_spec(_spec);_spec.loader.exec_module(_f)
10
+ _bank=None
11
+ _phase_bank=None
12
+ _servo_bank=None
13
+ _block_history=[]
14
+ _fit=None
15
+ _previous_visual=None
16
+ _previous_step=None
17
+
18
+ def reset_episode():
19
+ global _previous_visual,_previous_step,_block_history,_fit
20
+ _previous_visual=None
21
+ _previous_step=None
22
+ _block_history=[];_fit=None
23
+
24
+ def act(obs):
25
+ global _bank,_previous_visual,_previous_step,_phase_bank,_block_history,_fit,_servo_bank
26
+ step=int(obs['step_id'])
27
+ if step>=500: return None # runner already spent one of 500 native steps
28
+ if step<1: raise ValueError('act expects post-hold step_id >= 1')
29
+ if _bank is None:
30
+ with np.load(Path(__file__).with_name('demo_bank.npz'),allow_pickle=False) as data:
31
+ _bank={k:data[k] for k in data.files}
32
+ try:
33
+ q,v=_f.proprio(obs['proprioception']);vis=_f.visual(obs['rgb'])
34
+ except (KeyError,ValueError,TypeError):
35
+ _previous_visual=None;_previous_step=None
36
+ return np.zeros(44,dtype=np.float32)
37
+ if _phase_bank is None:
38
+ with np.load(Path(__file__).with_name('phase_bank.npz')) as z:
39
+ _phase_bank={k:z[k] for k in z.files}
40
+ if vis[26]>.5:
41
+ _block_history.append((step,float(vis[25])))
42
+ if step>=70 and (step%10==0 or _fit is None) and len(_block_history)>=50:
43
+ hist=np.array(_block_history[-160:]);tt=hist[:,0];yy=hist[:,1]
44
+ best=None
45
+ for period in np.arange(37.,66.01,.25):
46
+ omega=2*np.pi/period
47
+ xx=np.c_[np.ones(len(tt)),np.sin(omega*tt),np.cos(omega*tt)]
48
+ ww=np.linalg.lstsq(xx,yy,rcond=None)[0]
49
+ err=np.mean((xx@ww-yy)**2)
50
+ if best is None or err<best[0]:best=(err,period,ww)
51
+ _fit=best
52
+ # Fixed metric scales are design choices, not fitted neural weights.
53
+ arm=np.r_[0:7,23:30]; hand=np.r_[7:23,30:46]
54
+ d=np.mean(((_bank['q'][:,arm]-q[arm])/.18)**2,axis=1)
55
+ d+=.35*np.mean(((_bank['q'][:,hand]-q[hand])/.25)**2,axis=1)
56
+ d+=.4*np.mean(((_bank['v']-v)/1.5)**2,axis=1)
57
+ d+=1.5*np.mean(((_bank['vis']-vis)/.12)**2,axis=1)
58
+ if _previous_visual is not None and step==_previous_step+1:
59
+ dv=vis-_previous_visual
60
+ d+=.25*np.mean(((_bank['dv']-dv)/.025)**2,axis=1)
61
+ if step>=80 and _fit is not None and _fit[0]<.0001:
62
+ _,period,ww=_fit;omega=2*np.pi/period
63
+ slope=omega*(ww[1]*np.cos(omega*step)-ww[2]*np.sin(omega*step))
64
+ d+=2.0*((_bank['vis'][:,25]-vis[25])/.055)**2
65
+ d+=.8*((_phase_bank['slope']-slope)/.007)**2
66
+ d+=.7*((_phase_bank['period']-period)/3.)**2
67
+ _previous_visual=vis.copy();_previous_step=step
68
+ nearest=np.argpartition(d,4)[:5]
69
+ w=np.exp(-(d[nearest]-d[nearest].min())/.15);w/=w.sum()
70
+ action=w@_bank['a'][nearest]
71
+ if _servo_bank is None:
72
+ with np.load(Path(__file__).with_name('servo_bank.npz')) as z:_servo_bank=z['inverse']
73
+ if step>=80:
74
+ qref=w@_bank['q'][nearest]
75
+ for ri,(qs,aa) in enumerate(((0,0),(23,22))):
76
+ inv=np.einsum('n,nij->ij',w,_servo_bank[nearest,ri])
77
+ correction=.10*inv@(qref[qs:qs+7]-q[qs:qs+7])
78
+ action[aa:aa+3]+=np.clip(correction,-.25,.25)
79
+ if step>=50:
80
+ qref=w@_bank['q'][nearest]
81
+ # Action-to-qpos permutation measured with isolated legal API pulses in ep12.
82
+ hand_map=np.array([4, 0, 8, 12, 5, 1, 9, 13, 6, 2, 10, 14, 3, 7, 11, 15],dtype=np.int64)
83
+ for qs,aa in ((0,0),(23,22)):
84
+ hand_error=(qref[qs+7:qs+23]-q[qs+7:qs+23])[hand_map]
85
+ action[aa+6:aa+22]+=np.clip(1.0*hand_error,-.10,.10)
86
+ # Far outside observed support: hold deltas, without claiming completion.
87
+ if d[nearest].min()>25: action=np.zeros(44,dtype=np.float32)
88
+ return np.clip(action,-1,1).astype(np.float32)
agent_d20_e20/frozen_20261102/tasks/DualArmJumpRope-v1/frozen/demo_analysis.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # D20 offline preparation — DualArmJumpRope-v1
2
+
3
+ Status: draft, unrehearsed, not frozen. Zero exploration episodes and no task testing. Only the 20 authorized demonstrations, task contract, and worker client were read. No simulator, hidden state, task-specific expert, internet search, or neural finetuning was used.
4
+
5
+ ## Sources and inspection ledger
6
+
7
+ Read `/task_contract.json` and the complete `/demo_manifest.json` programmatically. Frames and numeric sequences were read with `/worker_api.py` `API.read_demo`, whose local implementation reads sanitized HDF5. Indices below are zero-based observation indices, including terminal observation N; actions are indices 0 through N-1. Human/model visual inspection used `evidence/front_0.jpg` through `front_3.jpg` and `views_0.jpg` through `views_3.jpg`. Each front row contains the six listed frames. Each multiview row contains all five contract cameras at the listed midpoint. Top views were resized for the contact sheet, so their displayed aspect ratio is distorted.
8
+
9
+ All action labels and all qpos/qvel samples were analyzed numerically in every trajectory. Separately, front and top RGB indices 0 through N-1 were processed computationally for controller descriptors; this is not a claim of visual inspection of every frame. Terminal RGB was not added to the action bank.
10
+
11
+ | Demo ID | N actions | Front frames visually inspected | All-five-camera frame | Out-of-bound scalar labels | Median z-action peak interval (steps) |
12
+ |---|---:|---|---:|---:|---:|
13
+ | demo_00 | 311 | 0, 20, 60, 155, 271, 311 | 155 | 16 | 40.0 |
14
+ | demo_01 | 385 | 0, 20, 60, 192, 345, 385 | 192 | 18 | 50.5 |
15
+ | demo_02 | 333 | 0, 20, 60, 166, 293, 333 | 166 | 15 | 39.0 |
16
+ | demo_03 | 449 | 0, 20, 60, 224, 409, 449 | 224 | 19 | 61.0 |
17
+ | demo_04 | 426 | 0, 20, 60, 213, 386, 426 | 213 | 19 | 63.0 |
18
+ | demo_05 | 394 | 0, 20, 60, 197, 354, 394 | 197 | 18 | 53.0 |
19
+ | demo_06 | 333 | 0, 20, 60, 166, 293, 333 | 166 | 17 | 39.5 |
20
+ | demo_07 | 384 | 0, 20, 60, 192, 344, 384 | 192 | 18 | 53.0 |
21
+ | demo_08 | 381 | 0, 20, 60, 190, 341, 381 | 190 | 18 | 57.0 |
22
+ | demo_09 | 359 | 0, 20, 60, 179, 319, 359 | 179 | 17 | 52.0 |
23
+ | demo_10 | 452 | 0, 20, 60, 226, 412, 452 | 226 | 19 | 60.0 |
24
+ | demo_11 | 500 | 0, 20, 60, 250, 460, 500 | 250 | 35 | 49.0 |
25
+ | demo_12 | 315 | 0, 20, 60, 157, 275, 315 | 157 | 15 | 40.0 |
26
+ | demo_13 | 309 | 0, 20, 60, 154, 269, 309 | 154 | 15 | 39.5 |
27
+ | demo_14 | 350 | 0, 20, 60, 175, 310, 350 | 175 | 15 | 41.0 |
28
+ | demo_15 | 394 | 0, 20, 60, 197, 354, 394 | 197 | 17 | 53.5 |
29
+ | demo_16 | 421 | 0, 20, 60, 210, 381, 421 | 210 | 19 | 59.0 |
30
+ | demo_17 | 442 | 0, 20, 60, 221, 402, 442 | 221 | 20 | 59.0 |
31
+ | demo_18 | 402 | 0, 20, 60, 201, 362, 402 | 201 | 18 | 60.0 |
32
+ | demo_19 | 318 | 0, 20, 60, 159, 278, 318 | 159 | 15 | 39.0 |
33
+
34
+ ## Image evidence and observable completion
35
+
36
+ Across all 20 initial front images, two hands are outside the supported red cable endpoints and an orange block is central. At frame 20 the hands are close to the supports; at frame 60 they are near the endpoints with the rope stretched more broadly. Midpoint and late images show the cable suspended between hands, with varying sag and height relative to the orange block. Midpoint top/left views show lateral separation that is ambiguous in front projections. Wrist cameras mostly show close-up red rope and table; they do not resolve the entire scene.
37
+
38
+ All 20 terminal front frames still show the rope spanning the two hands. In demo_01, 07, 08, 09, 10, and 17 the terminal rope is visibly higher in the front projection than the block; in others it is at or below it. This is a projected relationship, not a measured 3D clearance. Sparse snapshots cannot establish four completed revolutions, uninterrupted physical grasp, absence of block contact, or success. No success/contact/reward fields exist in the authorized manifest. Demo_11 reaches the 500-action horizon; its completion is especially ambiguous. Other early endings do not prove success either. No demonstration is labeled successful in this analysis.
39
+
40
+ ## Action and coordinate evidence
41
+
42
+ There are 7,658 action vectors, each width 44. Exact contract concatenation is `panda_leaphand-1` first (indices 0:22), then `panda_leaphand_left-0` (22:44), despite a different `robot_uids` ordering. Each part has xyz translation, three rotation components, and 16 hand deltas. All recorded rotation components are exactly zero. Translation uses robot-root coordinates with normalized 1 equal to 0.1 m; hand 1 equals 0.1 rad. Contract rotation semantics use norm clipping then multiplication by -0.5 rad and Euler-to-quaternion conversion in root-aligned coordinates. The two root-to-world transforms and image-to-root calibration are unknown; no sign conversion based on screen left/right is assumed.
43
+
44
+ All initial 46 concatenated qpos values are identical across demos; the first 80 full action vectors are also exactly identical across all 20. This limits demonstrated variation in the approach stage and does not justify assuming the same live scene. For the first arm, frames 0:10 average translation approximately [-0.519, +0.580, +0.585]; 10:20 averages [-0.007, +0.003, -0.165]. Strong hand deltas (>0.5 on any first-hand component) occupy action indices 32 through 44 in every demo, consistent with closing near the endpoints. Later hand corrections are small. Each qpos/qvel has 23 entries; the draft uses the conventional first-seven arm/last-sixteen hand split as an explicit unverified ordering assumption.
45
+
46
+ Later xyz commands oscillate. Per-demo peak-spacing estimates above use first-arm z actions after index 80, SciPy find_peaks(prominence=0.15, distance=15); their medians vary from 39 to 63 steps (1.95–3.15 s at 20 Hz). These are command periodicities, not verified block periods or completed rope revolutions; transients introduce extra peaks. The full detected peak indices, component RMS, start/end qpos, and hand-active indices are in evidence/stats.json. The numeric arrays are in evidence/sequences.npz. Rotational RMS is zero in both parts; translation RMS ranges roughly 0.206–0.286 for the first part and 0.207–0.273 for the second.
47
+
48
+ The source labels range from -1.25 to +1.25, conflicting with contract native [-1,1] bounds: 363 scalar entries exceed limits, exclusively xyz components. Counts by flat dimension are 0:134, 1:5, 2:60, 22:136, 24:28. All demos contain some violations. The controller bank clips each label to native bounds; the actual effects of source-side saturation and timing are unknown. No native limits, horizon, or control rate are changed.
49
+
50
+ ## Draft design and limitations
51
+
52
+ candidate/controller.py exposes reset_episode() and act(obs). Its nonparametric bank includes all 7,658 legal-observation/action pairs from all 20 demos. Deterministic red-rope centerline bins and orange-block centroid features use front/top RGB; joint positions, velocities, and consecutive visual differences condition nearest-neighbor selection. Five local bounded action labels are weighted by observation distance. There is no hidden seed, demo-ID selection, phase clock replay, external model, simulator, or neural parameter optimization. Bank row provenance is stored for audit only and is not used by act. Numeric distance scales and feature thresholds are hand-chosen, unvalidated design choices.
53
+
54
+ The runner owns the initial hold. act expects step_id >=1, issues at most the remaining 499 native actions, and returns None at step_id >=500 solely for budget exhaustion. It has no verified visual success predicate and never infers success from a nearest terminal frame. Missing/invalid required observations or very distant observations yield zero deltas, which can stall. It does not add a second initial hold deliberately.
55
+
56
+ Important unresolved risks: uncalibrated color segmentation, occlusion, unknown camera changes, ambiguous cycle phase, action averaging near distinct phases, unseen perturbations, unverified joint ordering, fixed thresholds, no grasp/contact sensing, and no recovery controller. Observations alone may not reveal the full cable dynamics. Identical initial demo prefixes and sparse scene variation limit transfer. This draft has no evidence of task success.
57
+
58
+ ## Validation and tool limits
59
+
60
+ Only Python syntax compilation and synthetic-input/interface checks are permitted and performed. No controller was run on an environment or scored/rehearsed, and no demo was executed as a rollout. No API methods other than read_demo were called. There is no environment available. Internet is restricted to the audited provider proxy and was not used; no external packages or weights were downloaded. Tool output initially truncated the combined text dump; all manifest entries were subsequently parsed from the complete local file. No other task's data was read. The runner supplies the verified manifest and common lock separately.
61
+
62
+ ## Authorized E20 continuation (historical note)
63
+
64
+ The preceding offline-only record is preserved verbatim as preparation history. The trusted API subsequently enabled this task's authorized exploration. See exploration/findings.md and native returns for actual results. Episode12 isolated pulses established the hand-action-to-qpos permutation [4,0,8,12,5,1,9,13,6,2,10,14,3,7,11,15] for both arms, replacing the original unverified same-order assumption. The compiled continuation uses image-derived block timing and bounded local arm/hand pose corrections; no neural weights were fine-tuned. Final independent rehearsal records and freeze result are preserved externally to keep the submitted bundle unchanged.