Skip to content

Commit da13abd

Browse files
authored
Fix graphwalks eval metric (#1457)
Signed-off-by: Cheng-Ping Hsieh <chsieh@nvidia.com>
1 parent 03b9b06 commit da13abd

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

nemo_skills/evaluation/evaluator/graphwalks.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,9 @@ def eval_graphwalks(cfg):
6767
except (json.JSONDecodeError, TypeError):
6868
expected_nodes = set()
6969

70-
if not expected_nodes and not predicted_nodes:
70+
if parse_failed:
71+
f1 = 0.0
72+
elif not expected_nodes and not predicted_nodes:
7173
f1 = 1.0
7274
elif not predicted_nodes or not expected_nodes:
7375
f1 = 0.0

0 commit comments

Comments
 (0)