submission failed or under review

submission failed or under review  

  By: FBehrendt on Dec. 11, 2021, 8:47 a.m.

Hey :)

I have submitted three algorithms the last week. The first one succeeded und results are shown. The second one failed for some reason and the third one succeeded but it says "Evaluation is under review by the challenge admins". If i click on the result directly it says " Forbidden. You do not have permission to access this content." Can you help me with that? Why did the second submission fail and what is the problem with the third one?

Thank you in advance Finn

Re: submission failed or under review  

  By: ecemsogancioglu on Dec. 12, 2021, 12:53 p.m.

Hi Finn,

Two of your submissions are shown in the leaderboard now. I have configured it so that the results will be shown automatically from now on, and you will not get "Evaluation is under review by the challenge admins" notification anymore.

One of your submission failed because your algorithm failed on one of the images. The error was as follows:

2021-12-09T20:06:52+00:00 /home/algorithm/.local/lib/python3.9/site-packages/torch/functional.py:445: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:2157.) 2021-12-09T20:06:52+00:00 return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined] 2021-12-09T20:19:29+00:00 Traceback (most recent call last): 2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 264, in 2021-12-09T20:19:29+00:00 Noduledetection(parsed_args.input_dir, parsed_args.output_dir, retest=parsed_args.retest).process() 2021-12-09T20:19:29+00:00 File "/home/algorithm/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 183, in process 2021-12-09T20:19:29+00:00 self.process_cases() 2021-12-09T20:19:29+00:00 File "/home/algorithm/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 191, in process_cases 2021-12-09T20:19:29+00:00 self._case_results.append(self.process_case(idx=idx, case=case)) 2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 121, in process_case 2021-12-09T20:19:29+00:00 scored_candidates = self.predict(input_image=input_image) 2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 239, in predict 2021-12-09T20:19:29+00:00 ens_results = ensemble_boxes(agg_results) 2021-12-09T20:19:29+00:00 File "/opt/algorithm/src/utils/ensemble_boxes_weighted.py", line 36, in ensemble_boxes 2021-12-09T20:19:29+00:00 boxes_list = [list(x) for x in list(boxes_pred[:,k])] 2021-12-09T20:19:29+00:00 IndexError: index 0 is out of bounds for axis 1 with size 0

Best, Ecem