# Number of cases

**URL:** <https://community.drivendata.org/t/number-of-cases/8767>\
**Category:** VisioMel Challenge\
**Created:** [March 30, 2023, 9:13am UTC](https://community.drivendata.org/t/number-of-cases/8767 "2023-03-30T09:13:58Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![ali.mammadov](https://avatars.discourse-cdn.com/v4/letter/a/3ec8ea/32.png) [@ali.mammadov](https://community.drivendata.org/u/ali.mammadov)\
**Post date:** [March 30, 2023, 9:13am UTC](https://community.drivendata.org/t/number-of-cases/8767/1 "2023-03-30T09:13:58Z")

</div>

Could you please specify the number of test cases for being able to predict inference time and be able to fit it to 8 hours(rule given by authors)?

---

<div class="post-metadata">

**Author:** ![ishashah](https://avatars.discourse-cdn.com/v4/letter/i/f475e1/32.png) [@ishashah](https://community.drivendata.org/u/ishashah)\
**Post date:** [March 30, 2023, 1:07pm UTC](https://community.drivendata.org/t/number-of-cases/8767/2 "2023-03-30T13:07:04Z")

</div>

Hi @ali.mammadov, the number of test cases is between 500 and 600 images.

Good luck!

---

<div class="post-metadata">

**Author:** ![ishashah](https://avatars.discourse-cdn.com/v4/letter/i/f475e1/32.png) [@ishashah](https://community.drivendata.org/u/ishashah)\
**Post date:** [March 30, 2023, 4:54pm UTC](https://community.drivendata.org/t/number-of-cases/8767/3 "2023-03-30T16:54:51Z")

</div>

Hi @ali.mammadov - I forgot to mention that you can also find the exact number of cases (541) using the `submission_format.csv` file on the [Data Download page](https://www.drivendata.org/competitions/148/visiomel-melanoma/data/).

Good luck!

---

<div class="post-metadata">

**Author:** ![Optimo](https://avatars.discourse-cdn.com/v4/letter/o/97f17d/32.png) [@Optimo](https://community.drivendata.org/u/Optimo)\
**Post date:** [April 1, 2023, 3:17pm UTC](https://community.drivendata.org/t/number-of-cases/8767/4 "2023-04-01T15:17:41Z")

</div>

Hello,

Can you confirm that there is a public leaderboard (the one we see on the website) AND a private leader board (the one that will matter for the final ranking) ?

If so, can we know the number of cases in public and private set ?

Thank you very much.

---

<div class="post-metadata">

**Author:** ![emily](https://avatars.discourse-cdn.com/v4/letter/e/8c91f0/32.png) [@emily](https://community.drivendata.org/u/emily)\
**Post date:** [April 3, 2023, 10:38pm UTC](https://community.drivendata.org/t/number-of-cases/8767/5 "2023-04-03T22:38:46Z")

</div>

Hi @Optimo, yes there is a public and private leaderboard. The public leaderboard is what you see during the competition and the private leaderboard is what you’ll see when the competition closes. We do not release the sample sizes for these.

---

<div class="post-metadata">

**Author:** ![Optimo](https://avatars.discourse-cdn.com/v4/letter/o/97f17d/32.png) [@Optimo](https://community.drivendata.org/u/Optimo)\
**Post date:** [April 9, 2023, 3:46pm UTC](https://community.drivendata.org/t/number-of-cases/8767/6 "2023-04-09T15:46:51Z")

</div>

Hi,

Could you clarify how the final score is computed: do we have to pick our final submission or the final score is our best score in the private LB based on all our submissions ?

Thanks in advance

---

<div class="post-metadata">

**Author:** ![ishashah](https://avatars.discourse-cdn.com/v4/letter/i/f475e1/32.png) [@ishashah](https://community.drivendata.org/u/ishashah)\
**Post date:** [April 10, 2023, 1:17am UTC](https://community.drivendata.org/t/number-of-cases/8767/7 "2023-04-10T01:17:46Z")

</div>

Hi @Optimo ,

The final score is based on your best score on the private leaderboard over all your submissions; you do not have to pick your final submission.

---

<div class="post-metadata">

**Author:** ![agaldran](https://avatars.discourse-cdn.com/v4/letter/a/8edcca/32.png) [@agaldran](https://community.drivendata.org/u/agaldran)\
**Post date:** [May 4, 2023, 4:16pm UTC](https://community.drivendata.org/t/number-of-cases/8767/8 "2023-05-04T16:16:53Z")

</div>

Hello!

I was wondering, is there any way in which I can select a submission other than the one with highest leaderboard score?

Like, I think I got lucky with the top-scored one, but I don’t trust it too much, is there a way to ignore it and submit another one, even if it has a lower LB score?

Cheers,

---

<div class="post-metadata">

**Author:** ![Optimo](https://avatars.discourse-cdn.com/v4/letter/o/97f17d/32.png) [@Optimo](https://community.drivendata.org/u/Optimo)\
**Post date:** [May 4, 2023, 4:39pm UTC](https://community.drivendata.org/t/number-of-cases/8767/9 "2023-05-04T16:39:26Z")

</div>

@agaldran you do not need to pick your final submission as all your submissions are taken into account in the final LB.

---

<div class="post-metadata">

**Author:** ![agaldran](https://avatars.discourse-cdn.com/v4/letter/a/8edcca/32.png) [@agaldran](https://community.drivendata.org/u/agaldran)\
**Post date:** [May 4, 2023, 4:56pm UTC](https://community.drivendata.org/t/number-of-cases/8767/10 "2023-05-04T16:56:03Z")

</div>

Ah now I am reading it more slowly; so all submissions are scored and the one with highest score is automatically selected?

[That sounds like a bit of an advantage for people with lots of submissions, but ok]

---

<div class="post-metadata">

**Author:** ![emily](https://avatars.discourse-cdn.com/v4/letter/e/8c91f0/32.png) [@emily](https://community.drivendata.org/u/emily)\
**Post date:** [May 4, 2023, 7:19pm UTC](https://community.drivendata.org/t/number-of-cases/8767/11 "2023-05-04T19:19:47Z")

</div>

> So all submissions are scored and the one with highest score is automatically selected

Yep, your best score on the private test set is what will be used for the final leaderboard.

> hat sounds like a bit of an advantage for people with lots of submission

Everyone has the same limit of 3 submissions per week.
