Translations:PyTorch/313/en

From Alliance Doc
Jump to navigation Jump to search
torch.distributed.barrier()
map_location = f"cuda:{local_rank}"  
ddp_model.load_state_dict(
torch.load("./checkpoint_path", map_location=map_location))