# Submission(s) for private LB

**URL:** <https://community.drivendata.org/t/submission-s-for-private-lb/7208>\
**Category:** On Cloud N\
**Created:** [January 30, 2022, 5:36pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208 "2022-01-30T17:36:36Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![MPWARE](https://avatars.discourse-cdn.com/v4/letter/m/7c8e57/32.png) [@MPWARE](https://community.drivendata.org/u/MPWARE)\
**Post date:** [January 30, 2022, 5:36pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208/1 "2022-01-30T17:36:37Z")

</div>

Hi,

As it’s my first time here, I’m wondering if we need to select final submission(s) for private LB or if all submissions are scored in both public and private LB?  
According to the official rules, I also understand that private LB is 100% with unseen data, correct?

Finally, are we allowed to download data used for public LB for pseudo labelling?

Thanks.

---

<div class="post-metadata">

**Author:** ![rbgb](https://avatars.discourse-cdn.com/v4/letter/r/898d66/32.png) [@rbgb](https://community.drivendata.org/u/rbgb)\
**Post date:** [January 31, 2022, 2:47pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208/2 "2022-01-31T14:47:03Z")

</div>

Good questions:

1. No need to select a final submission.
2. Correct, private leaderboard is 100% unseen data.
3. No, we do not allow access to the public leaderboard data.

---

<div class="post-metadata">

**Author:** ![georgestein](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@georgestein](https://community.drivendata.org/u/georgestein)\
**Post date:** [February 2, 2022, 10:19pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208/3 "2022-02-02T22:19:42Z")

</div>

Thanks for clarifying! The private leaderboard is not just some fraction of the 10980 chips we’re testing on when we submit our models… is it?

> [@rbgb](#):
>
> 3.) No, we do not allow access to the public leaderboard data.

This includes logging any and all metadata attached to the chips for further examination, correct? Especially in the case where the private leaderboard is some of the 10980 chips people can extract metadata from…

i.e. are there checks to make sure people are not writing out longitude/latitude to their log files, and submitting models that they know will do good on those biomes?

---

<div class="post-metadata">

**Author:** ![rbgb](https://avatars.discourse-cdn.com/v4/letter/r/898d66/32.png) [@rbgb](https://community.drivendata.org/u/rbgb)\
**Post date:** [February 3, 2022, 7:50pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208/4 "2022-02-03T19:50:10Z")

</div>

Thanks for raising your concerns; as a practice, we don’t disclose all of our anti-cheating measures, but I will say that we monitor strictly for violating the rules of the competition both during the competition and when validating the prize-winning solutions. Competitors that violate the rules will be disqualified. You can rest assured that the best honest submissions will win!

---

<div class="post-metadata">

**Author:** ![georgestein](https://avatars.discourse-cdn.com/v4/letter/g/e99b99/32.png) [@georgestein](https://community.drivendata.org/u/georgestein)\
**Post date:** [February 3, 2022, 10:54pm UTC](https://community.drivendata.org/t/submission-s-for-private-lb/7208/5 "2022-02-03T22:54:23Z")

</div>

Great, thanks for clarifying!

> [@rbgb](#):
>
> No, we do not allow access to the public leaderboard data.

Just made me think the chips themselves were off limits, but made me worry about the rest of the info… Glad to know nothing at all from the 10980 chips but the public IoU can be used!