# Benchmark Analaysis

**URL:** <https://community.drivendata.org/t/benchmark-analaysis/4804>\
**Category:** Hateful Memes\
**Created:** [July 20, 2020, 2:16am UTC](https://community.drivendata.org/t/benchmark-analaysis/4804 "2020-07-20T02:16:15Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Tashin](https://avatars.discourse-cdn.com/v4/letter/t/e79b87/32.png) [@Tashin](https://community.drivendata.org/u/Tashin)\
**Post date:** [July 20, 2020, 2:16am UTC](https://community.drivendata.org/t/benchmark-analaysis/4804/1 "2020-07-20T02:16:15Z")

</div>

Hello,  
I came up with some benchmark results on the leaderboard.  
Are the codes of those benchmark results are publicly available?  
Thanks.

---

<div class="post-metadata">

**Author:** ![motoki](https://avatars.discourse-cdn.com/v4/letter/m/e99b99/32.png) [@motoki](https://community.drivendata.org/u/motoki)\
**Post date:** [July 20, 2020, 9:05pm UTC](https://community.drivendata.org/t/benchmark-analaysis/4804/2 "2020-07-20T21:05:52Z")

</div>

Yes, the code is available [https://github.com/facebookresearch/mmf/](https://github.com/facebookresearch/mmf/). Still on the way to figure it out how to actually re-produced the outcome. There is no step-by-step instructions.

---

<div class="post-metadata">

**Author:** ![amanpreet](https://avatars.discourse-cdn.com/v4/letter/a/49beb7/32.png) [@amanpreet](https://community.drivendata.org/u/amanpreet)\
**Post date:** [July 20, 2020, 9:14pm UTC](https://community.drivendata.org/t/benchmark-analaysis/4804/3 "2020-07-20T21:14:13Z")

</div>

@motoki @Tashin Exact reproduction details are present here: [https://mmf.sh/docs/challenges/hateful\_memes\_challenge](https://mmf.sh/docs/challenges/hateful_memes_challenge)

---

<div class="post-metadata">

**Author:** ![motoki](https://avatars.discourse-cdn.com/v4/letter/m/e99b99/32.png) [@motoki](https://community.drivendata.org/u/motoki)\
**Post date:** [July 21, 2020, 11:41am UTC](https://community.drivendata.org/t/benchmark-analaysis/4804/4 "2020-07-21T11:41:40Z")

</div>

Thanks @amanpreet The main issue is that my server does not have internet access. There is no clear error message.

It would be great if there is a guideline how to manually download pre-trained weights … and where to put them…