Please clarify what the test set size is

Youth Mental Health: Automated Abstraction
1

Could the organizers please clarify that the test set size is? This is important for us to properly budget the 8 hour inference time limit.

Thanks,

2

The test set has 1000 samples as per this blog.

image
image977×151 26.9 KB

3

Hi @wdong , @mananjhaveri is correct - the full test set is 1000 samples. The smoke test is 25 samples, so you can estimate the length your submission will take on the full test set based on how long it takes to run on the smoke test set.

Good luck!