Hi,
Would it be possible to add a language like rust to the submission runtime? This would decrease the time it takes to run inference.
Kind regards
If you compile a binary using Rust in an environment that matches the runtime it should work fine when uploaded as part of the submission.
That said, most of the inference number crunching should be in the numeric pieces, which in Python are usually implemented compiled languages.