2021-08-16 18:23:00 [INFO] Loading pretrained model from output/yolov3_mobilenet/pretrain/MobileNetV3_large_x1_0_ssld_pretrained.pdparams
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv0.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv0.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv0.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv0.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv0.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv1.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv1.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv1.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv1.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv1.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv2.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv2.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv2.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv2.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv2.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv3.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv3.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv3.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv3.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.conv3.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.route.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.route.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.route.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.route.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.conv_module.route.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.tip.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.tip.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.tip.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.tip.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.0.tip.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.0.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.0.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.0.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.0.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.0.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv0.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv0.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv0.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv0.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv0.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv1.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv1.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv1.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv1.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv1.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv2.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv2.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv2.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv2.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv2.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv3.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv3.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv3.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv3.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.conv3.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.route.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.route.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.route.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.route.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.conv_module.route.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.tip.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.tip.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.tip.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.tip.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.1.tip.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.1.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.1.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.1.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.1.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_transition.1.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv0.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv0.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv0.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv0.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv0.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv1.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv1.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv1.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv1.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv1.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv2.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv2.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv2.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv2.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv2.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv3.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv3.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv3.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv3.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.conv3.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.route.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.route.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.route.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.route.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.conv_module.route.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.tip.conv.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.tip.batch_norm.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.tip.batch_norm.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.tip.batch_norm._mean is not in pretrained model
2021-08-16 18:23:00 [WARNING] neck.yolo_block.2.tip.batch_norm._variance is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.0.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.0.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.1.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.1.bias is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.2.weight is not in pretrained model
2021-08-16 18:23:00 [WARNING] yolo_head.yolo_output.2.bias is not in pretrained model
2021-08-16 18:23:00 [INFO] There are 262/368 variables loaded into YOLOv3.

/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/nn/layer/norm.py:641: UserWarning: When training, we now always track global mean and variance.
"When training, we now always track global mean and variance.")

2021-08-16 18:23:03 [INFO] [TRAIN] Epoch=1/270, Step=10/143, loss_xy=3.909126, loss_wh=9.138032, loss_obj=6041.941406, loss_cls=2.127524, loss=6057.116211, lr=0.000001, time_each_step=0.17s, eta=1:46:47
2021-08-16 18:23:04 [INFO] [TRAIN] Epoch=1/270, Step=20/143, loss_xy=6.586701, loss_wh=6.237633, loss_obj=620.451782, loss_cls=2.416080, loss=635.692200, lr=0.000002, time_each_step=0.15s, eta=1:38:21
2021-08-16 18:23:05 [INFO] [TRAIN] Epoch=1/270, Step=30/143, loss_xy=6.877599, loss_wh=12.423089, loss_obj=132.911057, loss_cls=5.405531, loss=157.617279, lr=0.000004, time_each_step=0.13s, eta=1:21:10
2021-08-16 18:23:07 [INFO] [TRAIN] Epoch=1/270, Step=40/143, loss_xy=4.128353, loss_wh=2.365643, loss_obj=21.592628, loss_cls=2.125822, loss=30.212446, lr=0.000005, time_each_step=0.14s, eta=1:28:33
2021-08-16 18:23:08 [INFO] [TRAIN] Epoch=1/270, Step=50/143, loss_xy=3.685493, loss_wh=3.649158, loss_obj=25.656229, loss_cls=2.299515, loss=35.290394, lr=0.000006, time_each_step=0.16s, eta=1:42:6
2021-08-16 18:23:09 [INFO] [TRAIN] Epoch=1/270, Step=60/143, loss_xy=4.834059, loss_wh=3.678580, loss_obj=14.430384, loss_cls=1.764377, loss=24.707401, lr=0.000007, time_each_step=0.11s, eta=1:8:10
2021-08-16 18:23:11 [INFO] [TRAIN] Epoch=1/270, Step=70/143, loss_xy=3.024445, loss_wh=3.258746, loss_obj=12.482793, loss_cls=1.913129, loss=20.679111, lr=0.000009, time_each_step=0.15s, eta=1:38:42
2021-08-16 18:23:13 [INFO] [TRAIN] Epoch=1/270, Step=80/143, loss_xy=4.102737, loss_wh=7.886775, loss_obj=26.989304, loss_cls=3.803079, loss=42.781895, lr=0.000010, time_each_step=0.18s, eta=1:54:15
2021-08-16 18:23:14 [INFO] [TRAIN] Epoch=1/270, Step=90/143, loss_xy=4.109097, loss_wh=4.128008, loss_obj=15.213926, loss_cls=2.499591, loss=25.950623, lr=0.000011, time_each_step=0.16s, eta=1:45:31
2021-08-16 18:23:16 [INFO] [TRAIN] Epoch=1/270, Step=100/143, loss_xy=6.323049, loss_wh=6.724238, loss_obj=15.303445, loss_cls=3.910646, loss=32.261375, lr=0.000012, time_each_step=0.18s, eta=1:54:18

ERROR:root:DataLoader reader thread raised an exception!
Exception in thread Thread-6:
Traceback (most recent call last):
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 391, in _thread_loop
batch = self._get_data()
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py", line 505, in _get_data
batch.reraise()
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 168, in reraise
raise self.exc_type(msg)
AttributeError: DataLoader worker(1) caught AttributeError with message:
Traceback (most recent call last):
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/worker.py", line 320, in _worker_loop
batch = fetcher.fetch(indices)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/fetcher.py", line 106, in fetch
data = [self.dataset[idx] for idx in batch_indices]
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/fetcher.py", line 106, in
data = [self.dataset[idx] for idx in batch_indices]
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/datasets/voc.py", line 286, in __getitem__
Decode(to_rgb=False)(sample), Decode(to_rgb=False)(sample_mix)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/transforms/operators.py", line 81, in __call__
sample = self.apply(sample)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/transforms/operators.py", line 197, in apply
sample['image'].shape[:2], dtype=np.float32)
AttributeError: 'NoneType' object has no attribute 'shape'

---------------------------------------------------------------------------SystemError Traceback (most recent call last) in
13 save_interval_epochs=1,
14 lr_decay_epochs=[216, 243],
---> 15 save_dir='output/yolov3_mobilenet')
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/detector.py in train(self, num_epochs, train_dataset, train_batch_size, eval_dataset, optimizer, save_interval_epochs, log_interval_steps, save_dir, pretrain_weights, learning_rate, warmup_steps, warmup_start_lr, lr_decay_epochs, lr_decay_gamma, metric, early_stop, early_stop_patience, use_vdl)
272 early_stop=early_stop,
273 early_stop_patience=early_stop_patience,
--> 274 use_vdl=use_vdl)
275
276 def evaluate(self,
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/base.py in train_loop(self, num_epochs, train_dataset, train_batch_size, eval_dataset, save_interval_epochs, log_interval_steps, save_dir, early_stop, early_stop_patience, use_vdl)
264 step_time_tic = time.time()
265
--> 266 for step, data in enumerate(self.train_data_loader()):
267 if nranks > 1:
268 outputs = self.run(ddp_net, data, mode='train')
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddlex/cv/models/utils/det_dataloader.py in __next__(self)
43 def __next__(self):
44 try:
---> 45 return next(self.loader)
46 except StopIteration:
47 self.loader = iter(self.dataloader)
/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/dataloader/dataloader_iter.py in __next__(self)
563
564 if in_dygraph_mode():
--> 565 data = self._reader.read_next_var_list()
566 data = _restore_batch(data, self._structure_infos.pop(0))
567 else:
SystemError: (Fatal) Blocking queue is killed because the data reader raises an exception.
[Hint: Expected killed_ != true, but received killed_:1 == true:1.] (at /paddle/paddle/fluid/operators/reader/blocking_queue.h:166)