| /workspace/ego6d_rag/method1b.py:18: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https: |
| fnet = Forecaster(cin=12, P=1).to(DEV); fnet.enc.load_state_dict(torch.load(AN / 'p3_fcx/shared_encoder.pt', map_location=DEV)); fnet.eval() |
| /workspace/ego6d_rag/method1b.py:19: FutureWarning: You are using `torch.load` with `weights_only=False` (the current default value), which uses the default pickle module implicitly. It is possible to construct malicious pickle data which will execute arbitrary code during unpickling (See https: |
| cnet = CamFormer().to(DEV); cnet.load_state_dict(torch.load(AN / 'p3_cf/camformer.pt', map_location=DEV)); cnet.eval() |
| precompute train (CamFormer+forecasting modes, scene-leave-out) ... |
| /opt/conda/envs/trajgaze/lib/python3.10/site-packages/torch/nn/modules/transformer.py:409: UserWarning: The PyTorch API of nested tensors is in prototype stage and will change in the near future. (Triggered internally at ../aten/src/ATen/NestedTensorImpl.cpp:178.) |
| output = torch._nested_tensor_from_mask(output, src_key_padding_mask.logical_not(), mask_check=False) |
| pooled 149,127; training mass-gated dual head ... |
| ep 0 Lpos=1.189 Lsel=1.469 Lroom=1.627 Lact=0.463 beta=0.86 |
| ep 30 Lpos=0.959 Lsel=1.090 Lroom=0.784 Lact=0.211 beta=0.28 |
| ep 60 Lpos=0.922 Lsel=1.044 Lroom=0.721 Lact=0.216 beta=0.28 |
| ep 90 Lpos=0.902 Lsel=1.018 Lroom=0.672 Lact=0.219 beta=0.27 |
| ep119 Lpos=0.890 Lsel=1.003 Lroom=0.634 Lact=0.221 beta=0.27 |
|
|
| venue mass soft hard oracle selA room actF1 |
| Loc_18 3.88 4.02 3.83 2.16 0.32 0.250 0.256 |
| Loc_19 2.31 3.71 4.09 0.65 0.30 0.198 0.218 |
| Loc_20 1.67 1.77 1.85 0.59 0.41 0.497 0.230 |
| Loc_21 1.12 1.08 0.85 0.58 0.65 0.731 0.282 |
| Loc_22 4.49 5.39 6.54 0.83 0.22 0.261 0.306 |
| Loc_23 5.06 4.86 6.06 2.27 0.23 0.283 0.307 |
| Loc_24 3.09 3.07 3.59 0.81 0.36 0.422 0.262 |
| Loc_25 2.77 2.60 3.01 0.66 0.37 0.433 0.314 |
| Loc_26 4.04 3.52 3.11 0.65 0.45 0.307 0.206 |
| Loc_27 1.60 2.54 1.54 0.76 0.52 0.421 0.268 |
| Loc_28 5.31 4.71 4.69 1.16 0.35 0.279 0.275 |
| Loc_29 3.87 4.22 4.76 0.94 0.24 0.294 0.254 |
| MACRO 3.27 3.46 3.66 1.01 0.37 0.365 0.265 |
|
|
| [refs] FCx top-1 3.31 | Method1 soft 3.43/hard 3.77 selA 0.37 | mass-baseline 3.27 | oracle ~1.0 |
| [sem refs] FCx probe room .462/actF1 .282 | CamFormer room .453/actF1 .353 |
|
|