MONKEY challenge: Detection of inflammation in kidney biopsies Banner
Join

live leaderboard failed after updating the model

live leaderboard failed after updating the model  

  By: AustinChen on Dec. 20, 2024, 3:34 a.m.

Hi, I was wondering if there have been any changes to the test cases since the recent update (12/06). I successfully passed the time limit last week after optimizing my container, but I failed today using the same code, only with an updated version of my model.

The time shown during the debug phase was the same (5 minutes) as the successful case last week, so Iā€™m curious if the time limit is still the issue, or if something else might be causing the failure.

Thank you.

AustinChen
AustinChen
Posts: 5

Re: live leaderboard failed after updating the model  

  By: LindaSt on Dec. 20, 2024, 10:02 a.m.

Hi! I see two results with the exact same time stamps, both with the same error but slightly different logs (from what I see, it started processing two images, that's why there are two).

Log for bf329a1e-a410-4628-96c4-4aac0db6ec71: AttributeError: bn

STOUT:

2024-12-20T02:11:12.909000+00:00 Creating new Ultralytics Settings v0.0.6 file āœ… 
2024-12-20T02:11:12.909000+00:00 View Ultralytics Settings with 'yolo settings' or at '/home/user/.config/Ultralytics/settings.json'
2024-12-20T02:11:12.909000+00:00 Update Settings with 'yolo settings key=value', i.e. 'yolo settings runs_dir=path/to/dir'. For help see https://docs.ultralytics.com/quickstart/#ultralytics-settings.
2024-12-20T02:17:12.950000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs
2024-12-20T02:17:12.950000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs
2024-12-20T02:17:12.950000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs
2024-12-20T02:17:12.950000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs

STERR:

2024-12-20T02:36:42.841000+00:00 Traceback (most recent call last):
2024-12-20T02:36:42.841000+00:00   File "/opt/app/inference.py", line 436, in <module>
2024-12-20T02:36:42.841000+00:00     raise SystemExit(run())
2024-12-20T02:36:42.841000+00:00   File "/opt/app/inference.py", line 427, in run
2024-12-20T02:36:42.841000+00:00     run_yolo_multiclass(image_path, mask_path, OUTPUT_PATH,
2024-12-20T02:36:42.841000+00:00   File "/opt/app/inference.py", line 398, in run_yolo_multiclass
2024-12-20T02:36:42.841000+00:00     result = future.result()
2024-12-20T02:36:42.841000+00:00   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
2024-12-20T02:36:42.841000+00:00     return self.__get_result()
2024-12-20T02:36:42.841000+00:00   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
2024-12-20T02:36:42.841000+00:00     raise self._exception
2024-12-20T02:36:42.841000+00:00   File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
2024-12-20T02:36:42.841000+00:00     result = self.fn(*self.args, **self.kwargs)
2024-12-20T02:36:42.841000+00:00   File "/opt/app/inference.py", line 107, in process_patch
2024-12-20T02:36:42.841000+00:00     results = model.predict(masked_img, device=device, verbose=False)
2024-12-20T02:36:42.841000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/engine/model.py", line 551, in predict
2024-12-20T02:36:42.841000+00:00     self.predictor.setup_model(model=self.model, verbose=is_cli)
2024-12-20T02:36:42.841000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/engine/predictor.py", line 308, in setup_model
2024-12-20T02:36:42.841000+00:00     self.model = AutoBackend(
2024-12-20T02:36:42.841000+00:00   File "/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
2024-12-20T02:36:42.841000+00:00     return func(*args, **kwargs)
2024-12-20T02:36:42.841000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/nn/autobackend.py", line 148, in __init__
2024-12-20T02:36:42.841000+00:00     model = model.fuse(verbose=verbose)
2024-12-20T02:36:42.841000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/nn/tasks.py", line 208, in fuse
2024-12-20T02:36:42.841000+00:00     delattr(m, "bn")  # remove batchnorm
2024-12-20T02:36:42.842000+00:00   File "/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2043, in __delattr__
2024-12-20T02:36:42.842000+00:00     super().__delattr__(name)
2024-12-20T02:36:42.842000+00:00 AttributeError: bn

7bfdec43-016e-4a90-bc27-9e587dfeb65e: AttributeError: bn

STOUT:

2024-12-20T02:10:44.152000+00:00 Creating new Ultralytics Settings v0.0.6 file āœ… 
2024-12-20T02:10:44.152000+00:00 View Ultralytics Settings with 'yolo settings' or at '/home/user/.config/Ultralytics/settings.json'
2024-12-20T02:10:44.152000+00:00 Update Settings with 'yolo settings key=value', i.e. 'yolo settings runs_dir=path/to/dir'. For help see https://docs.ultralytics.com/quickstart/#ultralytics-settings.
2024-12-20T02:15:27.391000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs
2024-12-20T02:15:27.391000+00:00 YOLO11n summary (fused): 238 layers, 2,582,737 parameters, 0 gradients, 6.3 GFLOPs

STERR:

2024-12-20T02:36:24.665000+00:00 Traceback (most recent call last):
2024-12-20T02:36:24.665000+00:00   File "/opt/app/inference.py", line 436, in <module>
2024-12-20T02:36:24.665000+00:00     raise SystemExit(run())
2024-12-20T02:36:24.665000+00:00   File "/opt/app/inference.py", line 427, in run
2024-12-20T02:36:24.665000+00:00     run_yolo_multiclass(image_path, mask_path, OUTPUT_PATH,
2024-12-20T02:36:24.666000+00:00   File "/opt/app/inference.py", line 398, in run_yolo_multiclass
2024-12-20T02:36:24.666000+00:00     result = future.result()
2024-12-20T02:36:24.666000+00:00   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
2024-12-20T02:36:24.666000+00:00     return self.__get_result()
2024-12-20T02:36:24.666000+00:00   File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
2024-12-20T02:36:24.666000+00:00     raise self._exception
2024-12-20T02:36:24.666000+00:00   File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
2024-12-20T02:36:24.666000+00:00     result = self.fn(*self.args, **self.kwargs)
2024-12-20T02:36:24.666000+00:00   File "/opt/app/inference.py", line 107, in process_patch
2024-12-20T02:36:24.666000+00:00     results = model.predict(masked_img, device=device, verbose=False)
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/engine/model.py", line 551, in predict
2024-12-20T02:36:24.666000+00:00     self.predictor.setup_model(model=self.model, verbose=is_cli)
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/engine/predictor.py", line 308, in setup_model
2024-12-20T02:36:24.666000+00:00     self.model = AutoBackend(
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
2024-12-20T02:36:24.666000+00:00     return func(*args, **kwargs)
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/nn/autobackend.py", line 148, in __init__
2024-12-20T02:36:24.666000+00:00     model = model.fuse(verbose=verbose)
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/ultralytics/nn/tasks.py", line 208, in fuse
2024-12-20T02:36:24.666000+00:00     delattr(m, "bn")  # remove batchnorm
2024-12-20T02:36:24.666000+00:00   File "/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2043, in __delattr__
2024-12-20T02:36:24.666000+00:00     super().__delattr__(name)
2024-12-20T02:36:24.666000+00:00 AttributeError: bn

Your resource usage:

LindaSt
LindaSt
Posts: 78