In project/starter/gen_ai_fundamentals_project_starter.ipynb, function spelling_reward_func didn't call extract_spelling, which is made for this reward function.
responses = [completion[0]["content"] for completion in completions] brings unexpected rewards since the reward function.
The correct code should be responses = [extract_spelling(completion[0]["content"]) for completion in completions]
In
project/starter/gen_ai_fundamentals_project_starter.ipynb, functionspelling_reward_funcdidn't callextract_spelling, which is made for this reward function.responses = [completion[0]["content"] for completion in completions]brings unexpected rewards since the reward function.The correct code should be
responses = [extract_spelling(completion[0]["content"]) for completion in completions]