It seems to me that the data downloaded and processed for the forecast is wiped after the forecast is produced, meaning that each weeks forecast needs to redownload and process anything relevant that was used the previous week, is that correct?
@robby Yes and no. If you don’t use any data that isn’t included on the mounted data drive (i.e. the data downloaded and made available, prior to your solution even being run), then not really. If you do use other data sources though, then yes, I believe it is discarded. Anything you write to the preprocessed directory should be available throughout the lifetime of the process though (i.e. until your program exits).
1 Like