Skip to content

Commit 9ad5990

Browse files
committed
Update README.md
1 parent c102bb3 commit 9ad5990

1 file changed

Lines changed: 11 additions & 6 deletions

File tree

README.md

Lines changed: 11 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,18 @@
1-
# PyKEEN Experimental Results
1+
# PyKEEN Benchmarking Results
22

3-
This repository contains two main experiments:
3+
This repository contains the results from the reproducibility and benchmarking studies
4+
described in
5+
6+
[**Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Framework**](http://arxiv.org/abs/2006.13365).
7+
<br /> Ali, M., Berrendorf, M., Hoyt, C. T., Vermue, L., Galkin, M., Sharifzadeh, S., Fischer, A., Tresp, V., & Lehmann, J. (2020).
8+
<br /> *arXiv*, 2006.13365.
49

510
## Reproducibility Study
611

712
In this study, we use the KGEMs reimplemented in PyKEEN and the authors' best
8-
reported hyperparameters to make reproductions of past experiments.
13+
reported hyper-parameters to make reproductions of past experiments.
914

10-
## Ablation Study
15+
## Benchmarking Study
1116

1217
In this study, we conduct a large number of hyper-parameter optimizations to
1318
investigate the effects of certain aspects of models (training assumption,
@@ -24,8 +29,8 @@ A summary of the results can be found [here](/ablation/results/_results/README.m
2429
## Regeneration of Charts
2530

2631
```sh
27-
git clone https://github.com/mali-git/pykeen_experimental_results.git
28-
cd pykeen_experimental_results
32+
git clone https://github.com/pykeen/benchmarking.git pykeen_benchmarking
33+
cd pykeen_benchmarking
2934
pip install -e .
3035
# ABLATION
3136
python ablation/collate.py

0 commit comments

Comments
 (0)