Skip to content

Commit 36381b7

Browse files
committed
fix(evaluation): restructure eval submodule and data for fail-safe clones
- move submodule modules/eval -> evaluation/framework - use HTTPS URL and update=none so clones (incl. --recursive) never fail on the UZH-private framework repo; internal opt-in init documented - move ground-truth data under evaluation/data/ - add evaluation/README.md describing the layout
1 parent 7a7e431 commit 36381b7

11 files changed

Lines changed: 26 additions & 3 deletions

.gitmodules

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1-
[submodule "modules/eval"]
2-
path = modules/eval
3-
url = git@gitlab.uzh.ch:ai-infrastructure/evaluation.git
1+
[submodule "evaluation/framework"]
2+
path = evaluation/framework
3+
url = https://gitlab.uzh.ch/ai-infrastructure/evaluation.git
4+
update = none

evaluation/README.md

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
# Evaluation
2+
3+
AI-quality evaluation assets for KlickerUZH.
4+
5+
- `framework/` — git submodule pointing at the UZH-internal
6+
[`ai-infrastructure/evaluation`](https://gitlab.uzh.ch/ai-infrastructure/evaluation)
7+
harness (transport-neutral DeepEval runner). The repository is **private to
8+
UZH**: the submodule is declared with `update = none`, so regular clones —
9+
including `git clone --recursive` — skip it and nothing in the build, dev
10+
stack, or CI depends on it being present.
11+
- `data/` — committed evaluation datasets (e.g. ground-truth QA cases under
12+
`data/ground_truth/`). Synthetic examples only; no production or personal
13+
data.
14+
15+
UZH-internal users with GitLab access can materialize the framework explicitly:
16+
17+
```bash
18+
git submodule update --init --checkout evaluation/framework
19+
```
20+
21+
How the framework consumes the datasets in `data/` (ground-truth roots, tool
22+
profiles, metric suites) is still being wired up and documented.

data/ground_truth/klicker_fineco/gt_001_cml_sharpe_ratio.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_001_cml_sharpe_ratio.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_002_tangency_portfolio_risk_aversion.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_002_tangency_portfolio_risk_aversion.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_003_weighted_alpha_zero_sum.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_003_weighted_alpha_zero_sum.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_004_ex_ante_alpha_heterogeneous_expectations.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_004_ex_ante_alpha_heterogeneous_expectations.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_005_ex_post_alpha_same_measure.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_005_ex_post_alpha_same_measure.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_006_lambda_portfolio_weights.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_006_lambda_portfolio_weights.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_007_third_investor_alpha.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_007_third_investor_alpha.md

File renamed without changes.

data/ground_truth/klicker_fineco/gt_008_covariance_matrix_conditions.md renamed to evaluation/data/ground_truth/klicker_fineco/gt_008_covariance_matrix_conditions.md

File renamed without changes.

0 commit comments

Comments
 (0)