The counterfactuals extracted for each dataset and methods are located in research_paper/experiments/{dataset}/{cv}/{method}/sample_{observation_id}
Setup:
- Paper enviroment: research_paper.yml
- LORE environment: lore.yml (python 2)
- Activate paper-env and compile rf-ocse: python setup.py build_ext --inplace
Add new datasets for in experiments:
- Add the dataset in research_paper/dataset_reader
- Create the folder structure for the dataset with: python -m research_paper.create_experiments
- Launch the experiments
Add new methods:
- Add the method in research_paper/launch_experiments (method run)
Launch the experiments:
- Add the desired methods in research_paper/launch_experiments
- Notice that LORE uses a distinct environment than the other methods
- python -m research_paper.launch_experiments
To reproduce the tables in the paper (using the provided environment):
- Table 1: python -m research_paper.create_paper_datasets_table
- Table 2: python -m research_paper.create_paper_counterfactual_distances_table
- Table 3: python -m research_paper.create_paper_counterfactual_example_table
- Table 5: python -m research_paper.create_paper_counterfactual_sets_table
- Table 6: python -m research_paper.create_paper_counterfactual_sets_example_table
- Table 7: python -m research_paper.create_paper_rf_ocse_pseudo_counterfactuals_table