# Duplicate rows in 5 minute microclimate data

**URL:** <https://community.drivendata.org/t/duplicate-rows-in-5-minute-microclimate-data/565>\
**Category:** From Fog Nets to Neural Nets\
**Created:** [April 26, 2016, 8:23pm UTC](https://community.drivendata.org/t/duplicate-rows-in-5-minute-microclimate-data/565 "2016-04-26T20:23:43Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![david.foster](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/david.foster/32/375_2.png) [@david.foster](https://community.drivendata.org/u/david.foster)\
**Post date:** [April 26, 2016, 8:23pm UTC](https://community.drivendata.org/t/duplicate-rows-in-5-minute-microclimate-data/565/1 "2016-04-26T20:23:43Z")

</div>

Hi,

There seem to be some duplicate times in the 5 minutes microclimate data.

For example 12:00 on 20th Jan 2014 (5 minute training dataset) appears twice, with different values for the gusts, and wind features. I’ve checked and the 2 hour dataset is an average of the 5 minute dataset, including the duplicates. Should we therefore assume that two readings were taken in some 5 minutes intervals?

Thanks,

David

---

<div class="post-metadata">

**Author:** ![bull](https://yyz2.discourse-cdn.com/flex028/user_avatar/community.drivendata.org/bull/32/8_2.png) [@bull](https://community.drivendata.org/u/bull)\
**Post date:** [May 1, 2016, 2:49am UTC](https://community.drivendata.org/t/duplicate-rows-in-5-minute-microclimate-data/565/2 "2016-05-01T02:49:36Z")

</div>

Hi @david.foster, yep there are some duplicates–a hazard or working with real data! We heard yet why that might be from the case from the net management team, but thanks for bringing it up. For the competition, you’ll have to decide what’s best to do with the duplicate measurements.