# Private testset evaluation questions **URL:** \ **Category:** Hakuna Ma-data\ **Created:** [January 19, 2020, 9:53am UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130 "2020-01-19T09:53:12Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![bragin](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bragin/32/873_2.png) [@bragin](https://community.drivendata.org/u/bragin)\ **Post date:** [January 19, 2020, 9:53am UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/1 "2020-01-19T09:53:12Z")
I’m new on drivendata and have several common questions: 1. Which submission will be evaluated on private data? Last one or the best by LB or we will be able to choose. 2. How many submissions will be evaluated? One or two? 3. The container must complete execution within a timeout of **8 hours**. Is it only regarding public leaderboard or there is a limitation for testset evaluation? If yes, could you please provide timeout and size of testset? Thank you in advance. ---
**Author:** ![bragin](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bragin/32/873_2.png) [@bragin](https://community.drivendata.org/u/bragin)\ **Post date:** [January 20, 2020, 6:42pm UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/2 "2020-01-20T18:42:08Z")
@bull Could you please help with the questions, the most interesting now about time limitation because it may significantly affect the algorithm. ---
**Author:** ![bull](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bull/32/8_2.png) [@bull](https://community.drivendata.org/u/bull)\ **Post date:** [January 20, 2020, 10:49pm UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/3 "2020-01-20T22:49:21Z")
> Which submission will be evaluated on private data? Last one or the best by LB or we will be able to choose. > How many submissions will be evaluated? One or two? We will run the one submission that has the best score on the private leaderboard (season 11). Just one submission will be executed. > The container must complete execution within a timeout of 8 hours. Is it only regarding public leaderboard or there is a limitation for testset evaluation? If yes, could you please provide timeout and size of testset? We only will execute the _best_ submission (according to the private leaderboard), which had to complete within the time limit for the subset (8 hours). The runtime limit for the final evaluation will be proportional to the change in the number of files evaluated, so as long as the original submission respected the submission time limit for the current subset then you should be fine. Thanks! ---
**Author:** ![Val\_An](https://avatars.discourse-cdn.com/v4/letter/v/ad7895/32.png) [@Val\_An](https://community.drivendata.org/u/Val_An)\ **Post date:** [January 21, 2020, 12:12am UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/4 "2020-01-21T00:12:49Z")
@bull Does the submission need to be submitted and evaluated before the deadline or only submitted. If later, evaluation would finish a few hours after the deadline. ---
**Author:** ![Val\_An](https://avatars.discourse-cdn.com/v4/letter/v/ad7895/32.png) [@Val\_An](https://community.drivendata.org/u/Val_An)\ **Post date:** [January 21, 2020, 3:59pm UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/5 "2020-01-21T15:59:21Z")
@isms @bull I hope someone can address my question (see above) before the deadline. ---
**Author:** ![bull](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bull/32/8_2.png) [@bull](https://community.drivendata.org/u/bull)\ **Post date:** [January 21, 2020, 4:37pm UTC](https://community.drivendata.org/t/private-testset-evaluation-questions/4130/6 "2020-01-21T16:37:45Z")
Submissions must be made before the deadline. Execution can happen after the deadline.