Developing Own Submission

The predictions format files are always named predictions_format.csv and will be located in the test/ directory within the centralized case, or within each test/{partition_name}/ directory for the federated case.

Here is a file tree that should be instructive for how to set things up locally in the runtime repository:

Click here to expand:
❯ tree data/ -F
data/
├── fincrime/
│   ├── centralized/
│   │   ├── test/
│   │   │   ├── bank_dataset.csv
│   │   │   ├── data.json
│   │   │   ├── predictions_format.csv
│   │   │   └── swift_transaction_test_dataset.csv
│   │   └── train/
│   │       ├── bank_dataset.csv
│   │       ├── data.json
│   │       └── swift_transaction_train_dataset.csv
│   ├── scenario01/
│   │   ├── test/
│   │   │   ├── bank01/
│   │   │   │   └── bank_dataset.csv
│   │   │   ├── bank02/
│   │   │   │   └── bank_dataset.csv
│   │   │   ├── partitions.json
│   │   │   └── swift/
│   │   │       ├── predictions_format.csv
│   │   │       └── swift_transaction_test_dataset.csv
│   │   └── train/
│   │       ├── bank01/
│   │       │   └── bank_dataset.csv
│   │       ├── bank02/
│   │       │   └── bank_dataset.csv
│   │       ├── partitions.json
│   │       └── swift/
│   │           └── swift_transaction_train_dataset.csv
│   └── scenarios.txt
└── pandemic/
    ├── centralized/
    │   ├── test/
    │   │   ├── data.json
    │   │   ├── predictions_format.csv
    │   │   ├── va_activity_location_assignment.csv.gz
    │   │   ├── va_activity_locations.csv.gz
    │   │   ├── va_disease_outcome_training.csv.gz
    │   │   ├── va_household.csv.gz
    │   │   ├── va_person.csv.gz
    │   │   ├── va_population_network.csv.gz
    │   │   └── va_residence_locations.csv.gz
    │   └── train/
    │       ├── data.json
    │       ├── predictions_format.csv
    │       ├── va_activity_location_assignment.csv.gz
    │       ├── va_activity_locations.csv.gz
    │       ├── va_disease_outcome_training.csv.gz
    │       ├── va_household.csv.gz
    │       ├── va_person.csv.gz
    │       ├── va_population_network.csv.gz
    │       └── va_residence_locations.csv.gz
    ├── scenario01/
    │   ├── test/
    │   │   ├── client01/
    │   │   │   ├── predictions_format.csv
    │   │   │   ├── va_activity_location_assignment.csv.gz
    │   │   │   ├── va_activity_locations.csv.gz
    │   │   │   ├── va_disease_outcome_training.csv.gz
    │   │   │   ├── va_household.csv.gz
    │   │   │   ├── va_person.csv.gz
    │   │   │   ├── va_population_network.csv.gz
    │   │   │   └── va_residence_locations.csv.gz
    │   │   ├── client02/
    │   │   │   ├── predictions_format.csv
    │   │   │   ├── va_activity_location_assignment.csv.gz
    │   │   │   ├── va_activity_locations.csv.gz
    │   │   │   ├── va_disease_outcome_training.csv.gz
    │   │   │   ├── va_household.csv.gz
    │   │   │   ├── va_person.csv.gz
    │   │   │   ├── va_population_network.csv.gz
    │   │   │   └── va_residence_locations.csv.gz
    │   │   ├── client03/
    │   │   │   ├── predictions_format.csv
    │   │   │   ├── va_activity_location_assignment.csv.gz
    │   │   │   ├── va_activity_locations.csv.gz
    │   │   │   ├── va_disease_outcome_training.csv.gz
    │   │   │   ├── va_household.csv.gz
    │   │   │   ├── va_person.csv.gz
    │   │   │   ├── va_population_network.csv.gz
    │   │   │   └── va_residence_locations.csv.gz
    │   │   └── partitions.json
    │   └── train/
    │       ├── client01/
    │       │   ├── predictions_format.csv
    │       │   ├── va_activity_location_assignment.csv.gz
    │       │   ├── va_activity_locations.csv.gz
    │       │   ├── va_disease_outcome_training.csv.gz
    │       │   ├── va_household.csv.gz
    │       │   ├── va_person.csv.gz
    │       │   ├── va_population_network.csv.gz
    │       │   └── va_residence_locations.csv.gz
    │       ├── client02/
    │       │   ├── predictions_format.csv
    │       │   ├── va_activity_location_assignment.csv.gz
    │       │   ├── va_activity_locations.csv.gz
    │       │   ├── va_disease_outcome_training.csv.gz
    │       │   ├── va_household.csv.gz
    │       │   ├── va_person.csv.gz
    │       │   ├── va_population_network.csv.gz
    │       │   └── va_residence_locations.csv.gz
    │       ├── client03/
    │       │   ├── predictions_format.csv
    │       │   ├── va_activity_location_assignment.csv.gz
    │       │   ├── va_activity_locations.csv.gz
    │       │   ├── va_disease_outcome_training.csv.gz
    │       │   ├── va_household.csv.gz
    │       │   ├── va_person.csv.gz
    │       │   ├── va_population_network.csv.gz
    │       │   └── va_residence_locations.csv.gz
    │       └── partitions.json
    └── scenarios.txt

Submissions made through the provided infrastructure will always use the latest official image, so you won’t be able to run those with any dependencies that are still in open pull requests. Thanks for your patience—we’ll try to get your pull request reviewed soon.