Benchmark Analaysis

Hello,
I came up with some benchmark results on the leaderboard.
Are the codes of those benchmark results are publicly available?
Thanks.

Yes, the code is available https://github.com/facebookresearch/mmf/. Still on the way to figure it out how to actually re-produced the outcome. There is no step-by-step instructions.

1 Like

@motoki @Tashin Exact reproduction details are present here: https://mmf.sh/docs/challenges/hateful_memes_challenge

2 Likes

Thanks @amanpreet The main issue is that my server does not have internet access. There is no clear error message.

It would be great if there is a guideline how to manually download pre-trained weights … and where to put them…