Runtime environment

PETs Prize Challenge
1

Hi,
Our solution requires pyspark and whilst pyspark itself can be downloaded via conda, it requires a Java installation which cannot be managed with conda. Will Java be available in the runtime environment or how should we request this in a PR to the runtime requirements repository?

Also, is there any update on when we will get time to test our solutions through the hosted infrastructure?

Thanks,

2

Hi @domdathan,

I don’t believe Java is currently available but we’d potentially accept a PR adding it to the Docker image.

I’d like to better understand your solution’s use of pyspark, however. The evaluation runs entirely within a single container, and the handling of different parties in the federated solution is handled by the evaluation harness. What role does pyspark play in your solution? Are you expected to be able to do distributed computing?

3

Hi @jayqi

Thank you for the response, I have sent you an email with more details.

Thanks!