Runtime Environment¶

A container will be created from the container image whenever you create a job for your algorithm. You can use the "Try Out Algorithm" button to test your container on the platform with your own data.

Any output for both stdout and stderr is captured. The output for stderr gets marked as a warning in the job's result. If an algorithm does not properly run, it should exit with a non zero exit code. The job for the algorithm then gets marked as failed. Runtime metrics are available on the logs page of your job.

Restrictions¶

Your container will be executed on one case at a time and is subject to a number of restrictions.

No Network Access¶

Your container will be executed without access to any network resources. This is to prevent exfiltration of private data uploaded by users or used in the challenge. Your container therefore must include everything it needs to run at build time.

/tmp Will Be Empty¶

The /tmp directory will be completely empty at runtime. This is scratch space that you can use for transient files, and will usually have a fast NVMe device attached. Any files that you included in /tmp in your Dockerfile will not be present at runtime. It is best practice to add these somewhere else, for example in a subdirectory of /opt.

/input Is Read Only¶

The input directory is read only. /tmp and /output are fully writable by your process.

50% Of System Memory Is Shared¶

The Shared Memory available to your container at /dev/shm is 50% of the System Memory. For example, for a 16 GiB instance, /dev/shm will be 8 GiB. The percentage is not modifiable.

1 GiB Of System Memory Is Reserved¶

1 GiB of memory will be reserved for system processes, so if you request a 32 GiB system 31 GiB will be available for your processes.

The Time Limit Is Set By The Phase¶

The maximum runtime is set by the phase of the challenge that you are submitting to. Ensure that your container can produce its output in that time.

Instance Types¶

You can specify the GPU and Memory options in your Algorithm settings. Depending on the GPU and amount of memory you requested, one of the following instances will be selected for your algorithms runtime environment:

• ml.m5.large: 2 vCPUs, 8 GiB of Memory
• ml.m5.xlarge: 4 vCPUs, 16 GiB of Memory
• ml.m5.2xlarge: 8 vCPUs, 32 GiB of Memory
• ml.g4dn.xlarge: 1x NVIDIA T4 GPU, 4 vCPUs, 16GiB of Memory, 1 x 125 GB NVMe SSD mounted at /tmp.
• ml.g4dn.2xlarge: 1x NVIDIA T4 GPU, 8 vCPUs, 32GiB of Memory, 1 x 225 GB NVMe SSD mounted at /tmp.
• ml.g5.xlarge: 1x NVIDIA A10G GPU, 4 vCPUs, 16GiB of Memory, 1 x 250 GB NVMe SSD mounted at /tmp.
• ml.g5.2xlarge: 1x NVIDIA A10G GPU, 8 vCPUs, 32GiB of Memory, 1 x 450 GB NVMe SSD mounted at /tmp.

M5 instances use Intel Xeon Scalable processors. These M5 instances have at least 30GB of EBS (non-NVMe) storage mounted at /tmp, the size of this volume will scale with the size of your model/ground truth and input data.

G4dn instances feature 1x NVIDIA T4 GPUs with 16 GB GDDR6 300 GB/sec GPU Memory and custom Intel Cascade Lake CPUs.

G5 instances feature 1x NVIDIA A10G GPUs with 24 GB GDDR6 600 GB/sec GPU Memory and second generation AMD EPYC processors.
Please note that you can only request an A10G GPU if that is set up for (1) your organization or (2) a challenge you participate in and your algorithm can be submitted to (i.e., has the correct interfaces for).

Currently NVIDIA Driver Version 535 and CUDA Version 12.0 are used.

You can see the specifications of the instance that was used for the Algorithm Job on the Jobs log page, on the chart where the resource usage is displayed.

FAQ¶

Output overlay not visible or incorrectly placed on input image¶

It is important to specify the correct voxel spacing, origin, and direction for image outputs that should be shown as overlays on the input images. When using output_sitk_img = SimpleITK.GetImageFromArray(numpy_array) SimpleITK will set default values that might not correspond with the input image resulting in an incorrectly placed overlay. Use output_sitk_img.CopyInformation(input_sitk_img) to copy the origin, spacing and direction values from the input image to the output image to ensure they correspond.