Hi Finn,
Two of your submissions are shown in the leaderboard now. I have configured it so that the results will be shown automatically from now on, and you will not get "Evaluation is under review by the challenge admins" notification anymore.
One of your submission failed because your algorithm failed on one of the images. The error was as follows:
2021-12-09T20:06:52+00:00 /home/algorithm/.local/lib/python3.9/site-packages/torch/functional.py:445: UserWarning: torch.meshgrid: in an upcoming release, it will be required to pass the indexing argument. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:2157.)
2021-12-09T20:06:52+00:00 return _VF.meshgrid(tensors, **kwargs) # type: ignore[attr-defined]
2021-12-09T20:19:29+00:00 Traceback (most recent call last):
2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 264, in
2021-12-09T20:19:29+00:00 Noduledetection(parsed_args.input_dir, parsed_args.output_dir, retest=parsed_args.retest).process()
2021-12-09T20:19:29+00:00 File "/home/algorithm/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 183, in process
2021-12-09T20:19:29+00:00 self.process_cases()
2021-12-09T20:19:29+00:00 File "/home/algorithm/.local/lib/python3.9/site-packages/evalutils/evalutils.py", line 191, in process_cases
2021-12-09T20:19:29+00:00 self._case_results.append(self.process_case(idx=idx, case=case))
2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 121, in process_case
2021-12-09T20:19:29+00:00 scored_candidates = self.predict(input_image=input_image)
2021-12-09T20:19:29+00:00 File "/opt/algorithm/process.py", line 239, in predict
2021-12-09T20:19:29+00:00 ens_results = ensemble_boxes(agg_results)
2021-12-09T20:19:29+00:00 File "/opt/algorithm/src/utils/ensemble_boxes_weighted.py", line 36, in ensemble_boxes
2021-12-09T20:19:29+00:00 boxes_list = [list(x) for x in list(boxes_pred[:,k])]
2021-12-09T20:19:29+00:00 IndexError: index 0 is out of bounds for axis 1 with size 0
Best, Ecem