You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Leaderboards** are automatically generated and can be found in the [DeepInverse benchmarks documentation](https://deepinv.github.io/deepinv/benchmarks.html).
9
+
**Leaderboards** are automatically generated and can be found in the [DeepInverse benchmarks documentation](https://deepinv.org/deepinv/benchmarks.html).
10
10
11
11
Benchmark results are stored in a HuggingFace repository: https://huggingface.co/datasets/deepinv/benchmarks/tree/main
12
12
13
13
### Evaluating Your Reconstruction Methods
14
14
15
15
To evaluate your own reconstruction methods on these benchmarks,
where `benchmark_name` is the name of the benchmark and `my_solver` is your reconstruction method which receives `(y, physics)` where
37
+
where `benchmark_name` is the name of the benchmark and `my_solver` is your out-of-the-box reconstruction method which receives `(y, physics)` where
38
38
39
39
-`y` is a `torch.Tensor` containing the measurements,
40
-
-`physics` is the forward operator, see more details in the [DeepInverse physics documentation](https://deepinv.github.io/deepinv/user_guide/physics/intro.html).
40
+
-`physics` is the forward operator, see more details in the [DeepInverse physics documentation](https://deepinv.org/deepinv/user_guide/physics/intro.html).
41
41
42
42
### Adding New Solvers
43
43
44
44
To add a new solver to an existing benchmark, open a new pull request on this repository, adding a new `your_solver_name.py` file
45
45
in the corresponding benchmark folder. Follow the structure of the existing solver files.
46
46
The new solver will be automatically run once the pull request is merged, and the results will be added to the leaderboard.
47
47
48
+
Also consider adding your solver to the collection of [existing solvers in DeepInverse](https://deepinv.org/user_guide/reconstruction/pretrained-models.html)!
49
+
48
50
### Adding New Benchmarks
49
51
50
52
To create a new benchmark, open a new pull request adding a new folder following
51
53
the structure given in the existing [benchmark_template](https://github.com/deepinv/benchmarks) folder.
52
54
53
55
A new benchmark requires:
54
56
55
-
- A **dataset** from the [DeepInverse datasets](https://deepinv.github.io/deepinv/user_guide/training/datasets.html).
56
-
- A **forward operator** from the [DeepInverse operators](https://deepinv.github.io/deepinv/user_guide/physics/physics.html).
57
-
- A set of **reconstruction methods** from the [DeepInverse reconstructors](https://deepinv.github.io/deepinv/user_guide/reconstruction/introduction.html) and potentially other custom solvers.
58
-
- A set of **metrics** from the [DeepInverse metrics](https://deepinv.github.io/deepinv/user_guide/training/metric.html).
57
+
- A **dataset** from the [DeepInverse datasets](https://deepinv.org/deepinv/user_guide/training/datasets.html).
58
+
- A **forward operator** from the [DeepInverse operators](https://deepinv.org/deepinv/user_guide/physics/physics.html).
59
+
- A set of out-of-the-box **reconstruction methods** from the [DeepInverse reconstructors](https://deepinv.org/deepinv/user_guide/reconstruction/introduction.html) and potentially other custom solvers.
60
+
- A set of **metrics** from the [DeepInverse metrics](https://deepinv.org/deepinv/user_guide/training/metric.html).
59
61
60
-
If you would like to propose a new dataset, metric or forward operator, please [open an issue](https://github.com/deepinv/benchmarks/issues/new/choose).
62
+
If you would like to propose a new dataset, metric or forward operator, please [open an issue](https://github.com/deepinv/benchmarks/issues/new/choose).
0 commit comments