Docker Parameters for Training

Hello,

the template on GitHub runs the docker container for training with these parameters:

--memory=16g --memory-swap=16g --shm-size=128m --pids-limit 256

This conflicts with the information from the Challenge Overview page, which states that each container has a total of 128GB of RAM available.

We also noticed, that we require more shared memory and a higher pids limit than the template uses.

Can you please confirm that the following parameters will work when executing the training container or if we can have even more shared memory and higher pids limit?

--memory=128g --memory-swap=128g --shm-size=64g --pids-limit 1024

Having a representative environment for testing would be very useful to us.

Thanks, lorenjul

Hi lorenjul,

Thank you for raising this point. The memory and shared memory were indeed not correctly updated in the GitHub repo. The shm gets added to the assigned memory, so 64gb of additional shm might be stretching the system capacity. The test scripts have now been updated with:

--memory=128g --memory-swap=128g --shm-size=32g --pids-limit 1024

If this balance does not satisfy your needs, please let us know.

Best, Luuk