Skip to content

feat: work on annotations #341

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
kjappelbaum wants to merge 6 commits into
base: dev
Choose a base branch
from
Draft

feat: work on annotations #341

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
32490c4
feat: add guidelines plus the app
MrtinoRG Apr 10, 2026
32ef822
chore: remove useless comments
MrtinoRG Apr 10, 2026
6698627
fix: solve logging
MrtinoRG Apr 10, 2026
669c1af
fix: solve multi-file issues
MrtinoRG Apr 10, 2026
0080e9e
feat: work on annotations
kjappelbaum Apr 12, 2026
aaa284b
one more file
kjappelbaum Apr 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file modified analysis/epist.pdf
View file
Open in desktop
Binary file not shown.
279 changes: 279 additions & 0 deletions reasoning_reports/human_annotation/annotations_Kevin.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,279 @@
{
"annotator": "Kevin",
"created": "2026-04-12T20:37:24.290Z",
"modified": "2026-04-12T20:42:00.144Z",
"provenance": {
"window": 16,
"overlap": 4
},
"current_file": "claude_sonnet_45__afm__level_2__afm_experiment_level_2-8.annotated.json",
"files": {
"claude_sonnet_45__afm__level_2__afm_experiment_level_2-8.annotated.json": {
"nodes": {
"N1": {
"decision": "correct",
"note": "Hypothesis is clearly widely phrased to also include statements that we assume to be true. I guess in many cases, I would not be able to assign nodes to a clear type. "
},
"N2": {
"decision": "correct",
"note": ""
},
"N3": {
"decision": "correct",
"note": ""
},
"N4": {
"decision": "correct",
"note": ""
},
"N5": {
"decision": "correct",
"note": ""
},
"N6": {
"decision": "correct",
"note": ""
},
"N7": {
"decision": "correct",
"note": ""
},
"N8": {
"decision": "correct",
"note": ""
},
"N9": {
"decision": "correct",
"note": ""
},
"N10": {
"decision": "correct",
"note": ""
},
"N11": {
"decision": "correct",
"note": ""
},
"N12": {
"decision": "correct",
"note": ""
},
"N13": {
"decision": "correct",
"note": ""
},
"N14": {
"decision": "correct",
"note": "The use of hypothesis in this loose way might have an impact on our conclusions"
},
"N15": {
"decision": "correct",
"note": ""
},
"N16": {
"decision": "correct",
"note": ""
},
"N17": {
"decision": "correct",
"note": ""
},
"N18": {
"decision": "correct",
"note": ""
},
"N19": {
"decision": "correct",
"note": ""
},
"N20": {
"decision": "correct",
"note": ""
},
"N21": {
"decision": "correct",
"note": ""
},
"N22": {
"decision": "correct",
"note": ""
},
"N23": {
"decision": "correct",
"note": ""
},
"N24": {
"decision": "correct",
"note": ""
},
"N25": {
"decision": "correct",
"note": ""
},
"N26": {
"decision": "correct",
"note": ""
},
"N27": {
"decision": "correct",
"note": ""
},
"N28": {
"decision": "correct",
"note": ""
},
"N29": {
"decision": "correct",
"note": ""
},
"N30": {
"decision": "correct",
"note": ""
},
"N31": {
"decision": "correct",
"note": ""
}
},
"edges": {
"0": {
"decision": "correct",
"note": ""
},
"1": {
"decision": "correct",
"note": ""
},
"2": {
"decision": "correct",
"note": ""
},
"3": {
"decision": "correct",
"note": ""
},
"4": {
"decision": "correct",
"note": ""
},
"5": {
"decision": "incorrect",
"note": "not sure what the link is"
},
"6": {
"decision": "correct",
"note": ""
},
"7": {
"decision": "correct",
"note": ""
},
"8": {
"decision": "correct",
"note": ""
},
"9": {
"decision": "correct",
"note": ""
},
"10": {
"decision": "correct",
"note": ""
},
"11": {
"decision": "correct",
"note": ""
},
"12": {
"decision": "correct",
"note": ""
},
"13": {
"decision": "correct",
"note": "this seems to just be repetition? "
},
"14": {
"decision": "correct",
"note": ""
},
"15": {
"decision": "correct",
"note": ""
},
"16": {
"decision": "correct",
"note": ""
},
"17": {
"decision": "correct",
"note": ""
},
"18": {
"decision": "correct",
"note": ""
},
"19": {
"decision": "correct",
"note": ""
},
"20": {
"decision": "correct",
"note": ""
},
"21": {
"decision": "correct",
"note": ""
},
"22": {
"decision": "correct",
"note": ""
},
"23": {
"decision": "correct",
"note": "\"Test\", too, is used in a very broad way"
},
"24": {
"decision": "correct",
"note": ""
},
"25": {
"decision": "correct",
"note": ""
},
"26": {
"decision": "incorrect",
"note": ""
},
"27": {
"decision": "incorrect",
"note": ""
},
"28": {
"decision": "incorrect",
"note": ""
},
"29": {
"decision": "correct",
"note": ""
},
"30": {
"decision": "correct",
"note": ""
},
"31": {
"decision": "correct",
"note": ""
},
"32": {
"decision": "correct",
"note": ""
},
"33": {
"decision": "correct",
"note": ""
}
},
"last_window": 2
}
}
}
Loading
Loading