# Submission Limit

**URL:** <https://community.drivendata.org/t/submission-limit/3873>\
**Category:** Hakuna Ma-data\
**Created:** [November 23, 2019, 7:27am UTC](https://community.drivendata.org/t/submission-limit/3873 "2019-11-23T07:27:25Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![cbinners](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/cbinners/32/875_2.png) [@cbinners](https://community.drivendata.org/u/cbinners)\
**Post date:** [November 23, 2019, 7:27am UTC](https://community.drivendata.org/t/submission-limit/3873/1 "2019-11-23T07:27:25Z")

</div>

I realize there is probably a limit of 1 submission per 5 days due to compute resource constraint concerns, but it would be super helpful to be allowed to submit more frequently, especially at the beginning of the competition as we get used to the new environment.

Are there any plans to increase it?

---

<div class="post-metadata">

**Author:** ![johnowhitaker](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/johnowhitaker/32/874_2.png) [@johnowhitaker](https://community.drivendata.org/u/johnowhitaker)\
**Post date:** [November 25, 2019, 7:26am UTC](https://community.drivendata.org/t/submission-limit/3873/2 "2019-11-25T07:26:39Z")

</div>

I noticed they do let you re-submit immediately if your code fails to make predictions due to an error. So that at least lets you get inference working.  
If the limit isn’t increased, the next best thing is to replicate their scoring and keep one season for evaluation. I get a pretty good estimate scoring with `np.mean([sklearn.metrics.log_loss(test[c], preds[c]) for c in classes])` - seemed to match up with the leaderboard score.

---

<div class="post-metadata">

**Author:** ![jigsaw](https://avatars.discourse-cdn.com/v4/letter/j/e47774/32.png) [@jigsaw](https://community.drivendata.org/u/jigsaw)\
**Post date:** [December 9, 2019, 8:51pm UTC](https://community.drivendata.org/t/submission-limit/3873/3 "2019-12-09T20:51:49Z")

</div>

All of my submissions failed, and then I am not able to submit anymore. It should be one successful submission right?

---

<div class="post-metadata">

**Author:** ![brismith](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/brismith/32/884_2.png) [@brismith](https://community.drivendata.org/u/brismith)\
**Post date:** [December 10, 2019, 2:34am UTC](https://community.drivendata.org/t/submission-limit/3873/4 "2019-12-10T02:34:31Z")

</div>

That was certainly the case for me - I had two failures where my zip file didn’t have the correct structure - then 1 success.

---

<div class="post-metadata">

**Author:** ![bull](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bull/32/8_2.png) [@bull](https://community.drivendata.org/u/bull)\
**Post date:** [December 12, 2019, 5:31am UTC](https://community.drivendata.org/t/submission-limit/3873/5 "2019-12-12T05:31:20Z")

</div>

@jigsaw @brismith It sounds like you may have encountered the same issue as in a different thread. Here’s that thread and the fix:

> [@Job status 'created'](http://community.drivendata.org/t/job-status-created/3945/2):
>
> After a further 12 hours I canceled the job and started a new one. The status is now ‘Pending’ as I’d expect. I think my internet must have cut out part way through the last upload.

If you have steps you took where you saw the issue, let us know.

---

<div class="post-metadata">

**Author:** ![jigsaw](https://avatars.discourse-cdn.com/v4/letter/j/e47774/32.png) [@jigsaw](https://community.drivendata.org/u/jigsaw)\
**Post date:** [December 12, 2019, 9:22am UTC](https://community.drivendata.org/t/submission-limit/3873/6 "2019-12-12T09:22:03Z")

</div>

Can we increase the submission limit to at least 1 in 3 days? 1 in 5 days would leave us with very less submissions.

---

<div class="post-metadata">

**Author:** ![brismith](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/brismith/32/884_2.png) [@brismith](https://community.drivendata.org/u/brismith)\
**Post date:** [December 13, 2019, 8:48pm UTC](https://community.drivendata.org/t/submission-limit/3873/7 "2019-12-13T20:48:30Z")

</div>

Thanks @bull, but my issues were entirely user error 🙂 my zip file didn’t have the right structure.

---

<div class="post-metadata">

**Author:** ![bafonso](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bafonso/32/901_2.png) [@bafonso](https://community.drivendata.org/u/bafonso)\
**Post date:** [January 7, 2020, 1:15pm UTC](https://community.drivendata.org/t/submission-limit/3873/8 "2020-01-07T13:15:56Z")

</div>

> [@jigsaw](#):
>
> Can we increase the submission limit to at least 1 in 3 days? 1 in 5 days would leave us with very less submissions.

Yeah I’m late to this and now have little chance of submitting more than a couple jobs…

---

<div class="post-metadata">

**Author:** ![bull](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bull/32/8_2.png) [@bull](https://community.drivendata.org/u/bull)\
**Post date:** [January 8, 2020, 8:46pm UTC](https://community.drivendata.org/t/submission-limit/3873/9 "2020-01-08T20:46:45Z")

</div>

We have just increased the submission limit to one submission every day for the rest of the competition. Enjoy!

---

<div class="post-metadata">

**Author:** ![johnowhitaker](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/johnowhitaker/32/874_2.png) [@johnowhitaker](https://community.drivendata.org/u/johnowhitaker)\
**Post date:** [January 20, 2020, 10:34am UTC](https://community.drivendata.org/t/submission-limit/3873/10 "2020-01-20T10:34:04Z")

</div>

Missed this! Ah well 🙂 Very kind of you to have given folks a chance to get some final tweaking done. Will we be able to make submissions after the competition closes?
