Failed on one or more cases.

Failed on one or more cases.  

  By: Foil on March 1, 2022, 6:56 p.m.

Hi, Thanks for organizing this international challenge!

I have a submission problem during final test phase: "The algorithm failed on one or more cases." Could you post my submission log please?

Thank you!

Re: Failed on one or more cases.  

  By: coendevente on March 1, 2022, 8:16 p.m.

Hi,

This is the stderr of one of the failed jobs:

2022-03-01T19:27:12+00:00 0%| | 0/300 [00:00<?, ?it/s]/opt/conda/lib/python3.7/site-packages/torch/nn/functional.py:718: UserWarning: Named tensors and all their associated APIs are an experimental feature and subject to change. Please do not use them for anything important until they are released as stable. (Triggered internally at /opt/conda/conda-bld/pytorch_1623448265233/work/c10/core/TensorImpl.h:1156.) 2022-03-01T19:27:12+00:00 return torch.max_pool2d(input, kernel_size, stride, padding, dilation, ceil_mode) 2022-03-01T19:27:38+00:00 0%| | 1/300 [00:00<04:02, 1.23it/s] 1%| | 2/300 [00:01<03:19, 1.49it/s] 1%| | 3/300 [00:01<02:24, 2.06it/s] 1%|▏ | 4/300 [00:02<02:34, 1.92it/s] 2%|▏ | 5/300 [00:02<02:14, 2.19it/s] 2%|▏ | 6/300 [00:03<02:16, 2.15it/s] 2%|▏ | 7/300 [00:03<02:04, 2.35it/s] 3%|▎ | 8/300 [00:03<01:54, 2.55it/s] 3%|▎ | 9/300 [00:04<01:50, 2.64it/s] 3%|▎ | 10/300 [00:04<01:51, 2.59it/s] 4%|▎ | 11/300 [00:04<01:53, 2.55it/s] 4%|▍ | 12/300 [00:05<02:06, 2.28it/s] 4%|▍ | 13/300 [00:05<02:05, 2.29it/s] 5%|▍ | 14/300 [00:06<02:15, 2.11it/s] 5%|▌ | 15/300 [00:06<02:06, 2.26it/s] 5%|▌ | 16/300 [00:07<02:07, 2.23it/s] 6%|▌ | 17/300 [00:07<01:53, 2.49it/s] 6%|▌ | 18/300 [00:07<01:48, 2.61it/s] 6%|▋ | 19/300 [00:08<01:48, 2.58it/s] 7%|▋ | 20/300 [00:08<01:41, 2.75it/s] 7%|▋ | 21/300 [00:09<01:54, 2.44it/s] 7%|▋ | 22/300 [00:09<01:43, 2.69it/s] 8%|▊ | 23/300 [00:09<01:44, 2.66it/s] 8%|▊ | 24/300 [00:10<01:33, 2.96it/s] 8%|▊ | 25/300 [00:10<01:33, 2.93it/s] 9%|▊ | 26/300 [00:10<01:29, 3.07it/s] 9%|▉ | 27/300 [00:10<01:27, 3.10it/s] 9%|▉ | 28/300 [00:11<01:31, 2.98it/s] 10%|▉ | 29/300 [00:11<01:47, 2.52it/s] 10%|█ | 30/300 [00:12<01:40, 2.69it/s] 10%|█ | 31/300 [00:12<01:34, 2.84it/s] 11%|█ | 32/300 [00:12<01:36, 2.78it/s] 11%|█ | 33/300 [00:13<01:35, 2.81it/s] 11%|█▏ | 34/300 [00:13<01:33, 2.86it/s] 12%|█▏ | 35/300 [00:13<01:29, 2.96it/s] 12%|█▏ | 36/300 [00:14<01:26, 3.04it/s] 12%|█▏ | 37/300 [00:14<01:22, 3.17it/s] 13%|█▎ | 38/300 [00:15<01:40, 2.60it/s] 13%|█▎ | 39/300 [00:15<01:34, 2.77it/s] 13%|█▎ | 40/300 [00:15<01:31, 2.85it/s] 14%|█▎ | 41/300 [00:16<01:33, 2.77it/s] 14%|█▍ | 42/300 [00:16<01:29, 2.90it/s] 14%|█▍ | 43/300 [00:16<01:24, 3.05it/s] 15%|█▍ | 44/300 [00:16<01:24, 3.04it/s] 15%|█▌ | 45/300 [00:17<01:22, 3.10it/s] 15%|█▌ | 46/300 [00:17<01:18, 3.22it/s] 16%|█▌ | 47/300 [00:18<01:36, 2.63it/s] 16%|█▌ | 48/300 [00:18<01:29, 2.83it/s] 16%|█▋ | 49/300 [00:18<01:41, 2.47it/s] 17%|█▋ | 50/300 [00:19<01:33, 2.68it/s] 17%|█▋ | 51/300 [00:19<01:33, 2.66it/s] 17%|█▋ | 52/300 [00:20<01:45, 2.35it/s] 18%|█▊ | 53/300 [00:20<01:55, 2.14it/s] 18%|█▊ | 54/300 [00:20<01:41, 2.41it/s] 18%|█▊ | 55/300 [00:21<01:41, 2.41it/s] 19%|█▊ | 56/300 [00:21<01:31, 2.68it/s] 19%|█▉ | 57/300 [00:22<01:30, 2.68it/s] 19%|█▉ | 58/300 [00:22<01:23, 2.90it/s] 20%|█▉ | 59/300 [00:22<01:37, 2.47it/s] 20%|██ | 60/300 [00:23<01:26, 2.77it/s] 20%|██ | 61/300 [00:23<01:16, 3.11it/s] 21%|██ | 62/300 [00:23<01:27, 2.73it/s] 21%|██ | 63/300 [00:24<01:21, 2.90it/s] 21%|██▏ | 64/300 [00:24<01:21, 2.90it/s] 22%|██▏ | 65/300 [00:24<01:19, 2.97it/s] 22%|██▏ | 66/300 [00:25<01:19, 2.94it/s] 22%|██▏ | 67/300 [00:25<01:17, 2.99it/s] 23%|██▎ | 68/300 [00:25<01:32, 2.52it/s] 23%|██▎ | 69/300 [00:26<01:24, 2.75it/s] 23%|██▎ | 70/300 [00:26<01:17, 2.97it/s] 23%|██▎ | 70/300 [00:26<01:27, 2.63it/s] 2022-03-01T19:27:38+00:00 Traceback (most recent call last): 2022-03-01T19:27:38+00:00 File "/opt/conda/lib/python3.7/runpy.py", line 193, in _run_module_as_main 2022-03-01T19:27:38+00:00 "__main__", mod_spec) 2022-03-01T19:27:38+00:00 File "/opt/conda/lib/python3.7/runpy.py", line 85, in _run_code 2022-03-01T19:27:38+00:00 exec(code, run_globals) 2022-03-01T19:27:38+00:00 File "/opt/algorithm/process.py", line 128, in <module> 2022-03-01T19:27:38+00:00 airogs_algorithm().process() 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/evalutils/evalutils.py", line 183, in process 2022-03-01T19:27:38+00:00 self.process_cases() 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/evalutils/evalutils.py", line 191, in process_cases 2022-03-01T19:27:38+00:00 self._case_results.append(self.process_case(idx=idx, case=case)) 2022-03-01T19:27:38+00:00 File "/opt/algorithm/process.py", line 79, in process_case 2022-03-01T19:27:38+00:00 input_image_array=input_image_array)) 2022-03-01T19:27:38+00:00 File "/opt/algorithm/process.py", line 99, in predict 2022-03-01T19:27:38+00:00 score = self.model.inference_referable(input_image_array) 2022-03-01T19:27:38+00:00 File "/opt/algorithm/model.py", line 27, in inference_referable 2022-03-01T19:27:38+00:00 images = self.preprocess(images) 2022-03-01T19:27:38+00:00 File "/opt/algorithm/model.py", line 34, in preprocess 2022-03-01T19:27:38+00:00 images = Image.fromarray(images) 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/PIL/Image.py", line 2834, in fromarray 2022-03-01T19:27:38+00:00 return frombuffer(mode, size, obj, "raw", rawmode, 0, 1) 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/PIL/Image.py", line 2761, in frombuffer 2022-03-01T19:27:38+00:00 return frombytes(mode, size, data, decoder_name, args) 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/PIL/Image.py", line 2707, in frombytes 2022-03-01T19:27:38+00:00 im.frombytes(data, decoder_name, args) 2022-03-01T19:27:38+00:00 File "/home/algorithm/.local/lib/python3.7/site-packages/PIL/Image.py", line 780, in frombytes 2022-03-01T19:27:38+00:00 d.setimage(self.im) 2022-03-01T19:27:38+00:00 ValueError: tile cannot extend outside image

Best regards, Coen de Vente

Re: Failed on one or more cases.  

  By: Foil on March 2, 2022, 5:05 a.m.

Dear Coen, Thank you so much for your reply. Best regards, Yann