The most costly Entry Point

I just realized the most time consuming aspect of the submission module is the Entry Point.
ie. In script, conda command kick starts the execution.
conda run -n py python

However, it takes eons to enter into the main function. Same observed from the logs of Docker environment and actual submission logs.

ie. Initiating the conda environment takes most of the time compared to the actual submission file creation.

Can anyone confirm my observation, Is my understanding wrong… Please help.


I think it is Docker taking about 1 min to create&start container from the downloded image each time. We can just replace for already runing container for each test. It can be done with running container in interactive mode and local directory mounted.

@MineshJ1291 Thanks for the reply. I just realized, its not live logger after reading your reply in one another post. Sorted.