Current test targets

Hi @mchahhou @motoki - Thanks for the question. There will be more information about this in the Evaluation Stage which will be released this week. You can check there and see if that clears up your questions.

Keep in mind that regardless of the year, only the SWE ground measures from the approved feature cells can be used as input during inference. These cells are distinct from the test cells in the submission format. You can see this thread for additional context. So @motoki if I understand that question then the answer would be no.

1 Like