add global_step_80/actor
e55370c verified - huggingface add global_step_80/actor
extra_state_world_size_2_rank_0.pt Detected Pickle imports (7)
- "_codecs.encode",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "numpy.dtype",
- "numpy.ndarray",
- "numpy._core.multiarray._reconstruct",
- "collections.OrderedDict"
How to fix it?
15.1 kB add global_step_80/actor extra_state_world_size_2_rank_1.pt Detected Pickle imports (7)
- "numpy.dtype",
- "numpy._core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "collections.OrderedDict"
How to fix it?
15.1 kB add global_step_80/actor - 46 Bytes add global_step_80/actor
model_world_size_2_rank_0.pt Detected Pickle imports (15)
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._tensor._rebuild_from_type_v2",
- "torch.Size",
- "collections.OrderedDict",
- "torch.distributed.tensor.DTensor",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.device",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "torch.IntStorage",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.FloatStorage"
How to fix it?
8.82 GB add global_step_80/actor model_world_size_2_rank_1.pt Detected Pickle imports (15)
- "torch.float32",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._tensor._rebuild_from_type_v2",
- "torch.FloatStorage",
- "torch.distributed.tensor.placement_types.Shard",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.IntStorage",
- "torch.Size",
- "torch.device",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor"
How to fix it?
8.82 GB add global_step_80/actor - 16.1 GB add global_step_80/actor
- 16.1 GB add global_step_80/actor