Extremely long wait times because of Queues

Competition hosts,

I see that the execution environment is stuck on 4 submissions/jobs queued since the last 2 hours. My previous submission was stuck on 1 job for 2+ hours after which I cancelled assuming there might be some glitch/bug. On re-submission, it’s much worse. Both were smoke tests.

Can this be made easier for us? Such wait times don’t allow us to utilize the max submissions/week and iterate faster.

It’s been 3 hours since my last submission. There’s still 4 jobs queued. @cszc

I think it’s my fault. I did a submission lat night but woke up this morning and it’s still running. Very strange.

@cszc request you to look into this!

Looks like they cancelled it, you should be good. Although there are 10 people now.

@oknaitik @ooousay Thanks for bringing this to our attention. We experience a back-up due to a service outage. It is now resolved, and jobs are working their way through the queue. We will continue to monitor throughout the challenge.

1 Like

@cszc @hannahmoro Kindly check if there’s any issues with job queues on your end. Pending Job ID: 307647

@oknaitik No issues that I can see. There are jobs currently running ahead of yours. We’ll keep an eye on it.

1 Like

Kindly recheck the job queues. My current submission (308779) again awaits for 18 jobs to clear after cancelling last one (308770) that was stuck on the same count for 2+ hrs.

Queed for 5 hours, still pending and showing 10 jobs ahead of me always… I wanna to submit another one today but seems impossible(will lose one submission due to 3 subs in 7 days limitation..)

So bad experience, why not adding some resouce when the game towards the end.

A job must be stuck. Currently at 32 jobs in queue :sob: on smoke test.

@cszc Could there be an issue in the processing? Been waiting in the queue for 2HRs+ for a smoke test execution, 22 jobs ahead, only three have been completed in the 2HR wait time.

@cszc @hannahmoro We’ve been waiting for too long now. It’s been 7+ hrs and the queue, for me, moved from 18 to only 13. Given that we’re nearing the competition end, kindly resolve these issues at the earliest.

Hi All - Sorry about the long wait times! We’re currently looking into it and will post when things are moving again.

@oknaitik Confirming that submissions are unblocked. Thank you for flagging this!

1 Like

Hi @cszc @hannahmoro, could you please check whether there’s an issue on your side with the execution environment?
My submission seems to have been stuck in the queue with “6 submissions queued ahead of yours” for over 3 hours now. Thanks in advance!

Hi @Khartoum - Thanks for flagging - submissions seem to be running normally!