pytorch Default process group is not initialized
【摘要】
报错:Default process group is not initialized
报错代码,yolov5训练时不报错, 参数配置错了,
with torch_distributed_zero_first(rank): dataset = LoadImagesAndLabels(path, imgsz, b...
报错:Default process group is not initialized
报错代码,yolov5训练时不报错, 参数配置错了,
-
with torch_distributed_zero_first(rank):
-
dataset = LoadImagesAndLabels(path, imgsz, batch_size, augment=augment, # augment images
-
hyp=hyp, # augmentation hyperparameters
-
rect=rect, # rectangular training
-
cache_images=cache, single_cls=opt.single_cls, stride=int(stride), pad=pad, image_weights=image_weights, prefix=prefix,data_type=data_type)
-
-
-
@contextmanager
-
def torch_distributed_zero_first(local_rank: int):
-
"""
-
Decorator to make all processes in distributed training wait for each local_master to do something.
-
"""
-
if local_rank not in [-1, 0]:
-
torch.distributed.barrier()
-
yield
-
if local_rank == 0:
文章来源: blog.csdn.net,作者:AI视觉网奇,版权归原作者所有,如需转载,请联系作者。
原文链接:blog.csdn.net/jacke121/article/details/125476898
【版权声明】本文为华为云社区用户转载文章,如果您发现本社区中有涉嫌抄袭的内容,欢迎发送邮件进行举报,并提供相关证据,一经查实,本社区将立刻删除涉嫌侵权内容,举报邮箱:
cloudbbs@huaweicloud.com
- 点赞
- 收藏
- 关注作者
评论(0)