Skip to content

Refactor data sources for leaderboard#1746

Merged
ph-kev merged 1 commit into
mainfrom
kp/data-loader
May 30, 2026
Merged

Refactor data sources for leaderboard#1746
ph-kev merged 1 commit into
mainfrom
kp/data-loader

Conversation

@ph-kev

@ph-kev ph-kev commented May 13, 2026

Copy link
Copy Markdown
Member

This PR refactors the data sources for the leaderboard to use the struct DataLoaders. This replaces the dictionary that map names to functions which then takes a start date to materialize the OutputVar. This is currently being used for the coupler calibration (see https://github.com/CliMA/ClimaCoupler.jl/blob/main/src/CalibrationTools.jl).

This PR is one step towards attempting to keep the interface for the coupler and land calibration pipelines roughly the same.

The PR reverts the downgrade test to use v1 instead of v2 since it is simpler to understand and debug. There were also problems with the Project.toml.

TODO

  • Update documentation

@ph-kev ph-kev force-pushed the kp/data-loader branch 9 times, most recently from 5c9079e to d089a25 Compare May 15, 2026 19:13
@ph-kev ph-kev force-pushed the kp/data-loader branch 2 times, most recently from 2bd1d57 to f8831c4 Compare May 19, 2026 20:53

@AlexisRenchon AlexisRenchon left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! I will adapt my future calibration PRs to this design. Thank you Kevin!

@nefrathenrici nefrathenrici left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just nits!

Comment thread ext/land_sim_vis/leaderboard/leaderboard.jl
Comment thread ext/land_sim_vis/leaderboard/data_sources.jl Outdated
Comment thread ext/land_sim_vis/leaderboard/data_sources.jl Outdated
@ph-kev ph-kev force-pushed the kp/data-loader branch 4 times, most recently from 4666f04 to e79e8af Compare May 27, 2026 21:44
@ph-kev ph-kev enabled auto-merge (rebase) May 30, 2026 00:01
@ph-kev ph-kev merged commit f727f61 into main May 30, 2026
17 of 18 checks passed
@ph-kev ph-kev deleted the kp/data-loader branch May 30, 2026 01:11
@ph-kev ph-kev mentioned this pull request Jun 1, 2026
ph-kev added a commit that referenced this pull request Jun 1, 2026
This was missed when #1746
was merged in.
ph-kev added a commit that referenced this pull request Jun 2, 2026
This was missed when #1746
was merged in.
ph-kev added a commit that referenced this pull request Jun 2, 2026
This was missed when #1746
was merged in.
ph-kev added a commit that referenced this pull request Jun 2, 2026
This was missed when #1746
was merged in.
imreddyTeja pushed a commit that referenced this pull request Jun 3, 2026
This was missed when #1746
was merged in.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants