QUEUED: There are currently 12 submissions ahead of yours

[Max_Schaefer]

hey @jsensio.

The reason for long queues might be that most participants use the code provided in the benchmark notebook, which does inference on CPU, instead of GPU. I just wrote about the issues:

IMPORTANT: How to speed up Inference & Queue time

Hey fellow participants. I think i found the reason for long queue waiting time. I noticed that the code provided in the benchmark notebook doesn´t leverage GPU, but instead lets your model do inference on CPU. Since probably most participants start with that notebook, i´m guessing that most didn´t adjust the code in main.py to let their model do inference on GPU. I adjusted the code and tested the difference: CPU: 1h 44 minutes GPU: 0h 23 minutes Here is a little hard coded solution to spee…

Please make sure that your code leverages GPU for inference.