Final Submissions Due Sunday

Our solution requires an extra dependency, we made a pull request on GitHub yesterday, but when can we expect that to be accepted/allow us to submit a valid submission to prescreened arena?

1 Like

We have a similar situation for our solution.
I believe the Github repository instructions were for local testing only and does not have anything to do with the final contest code submission.
However, the prescreened code .zip does not ask for the py-cpu.yml file, and it is confusing how our codes will run in their environment.

@rmckenna The pull request has been accepted.

The Docker environment that your code runs in is identical to that created from the master branch of the repo. That means if a certain Python requirement needs to be installed in the environment but is not in the .yml file, you will need to submit a pull request to get it changed.

Let’s assume you need package “statsmodels” but it’s not already in the .yml file. Obviously you can just make changes locally and rebuild your local version of the Docker container to get things working on your machine. But when your code tries to import statsmodels in the actual evaluation environment that we are running, it will fail because that isn’t in our official image yet. To get it into our official image you would submit a PR like this one on GitHub.

Does that make sense?

Yup. That makes sense.
I have added a pull request to the repository.

@mshubhankar Hm, I don’t see any open pull requests – https://github.com/drivendataorg/deid2-runtime/pulls

The submission portal is currently closed. Will it reopen until 8 PM EST?

Where are we supposed to make our final submissions? The prescreened leaderboard says that it’s closed.

Hey all, apologies on that, we’ll get it sorted promptly!

@yuchaotao @zschutzman Check now - should be fixed!

Hi, we’re wondering how we would submit our proof of privacy, would it be separate from the containerized source code or would everything just be submitted through the prescreened arena?

@joiewu Please check the instructions. Everything should be submitted through the Prescreened Arena.

And don’t forget to include a code guide along with your updated privacy proof (see the overview of final submission contents here: Preparing for the Nov 9th Sprint #1 Final Scoring Invitation )

It didn’t go through the last time. You should see it now.

Should the code guide be inside the privacy write up, or should it be separate file? Asking because the final submission instructions listed here, it states the former. But in the instructions posted on the forum, it states the later.

Either one is just fine, as long as you get the required information covered someplace and we can find it easily.

@mshubhankar PR has been accepted. The updated environment should be live in a few minutes.

1 Like

Hello, we have submitted our codes but it says timed out even we just runs in 16 minutes
image
How can we deal with this problem for submission

@cuongk14 We retriggered your last submission with a 30 minute timeout.

Many thanks for your help, bull.