There was an error while loading. Please reload this page.
1 parent d615a9c commit 597c021Copy full SHA for 597c021
1 file changed
reproduction-results/gptmodel/results/README.md
@@ -56,7 +56,7 @@ The table below compares this frontier-model run against the FLAMES-CodeLlama
56
57
| Metric | FLAMES-CodeLlama | GPT-4o (this run) |
58
|---|---|---|
59
-| Exact match (syntactic, FLAMES rules) | 2/28 — **7.1%** | 10/30 — **33.3%** |
+| Exact match (syntactic, FLAMES rules) | 2/28 — **7.1%** | 9/28 — **32.1%** |
60
| Garbage output (context truncation) | 24/28 — **85.7%** | 0 |
61
| Empty (token limit) | 0 | 1/31 |
62
0 commit comments