Fix generate for OpenVino backend. (#2638)

hertschuh · web-flow · commit c02002923e10 · 2026-03-19T19:15:41.000-07:00
The `generate` function was using `ops.array` to convert to NumPy. However, that is not what `ops.array` does, and the OpenVino behavior of `ops.array` was fixed to return an `OpenVINOKerasTensor`.

Use `ops.convert_to_numpy` instead.
diff --git a/keras_hub/src/models/causal_lm.py b/keras_hub/src/models/causal_lm.py
@@ -137,7 +137,7 @@ def make_generate_function(self):
 
             def wrapped_generate_function(inputs, stop_token_ids=None):
                 # Convert to numpy for OpenVINO backend
-                inputs = tree.map_structure(ops.array, inputs)
+                inputs = tree.map_structure(ops.convert_to_numpy, inputs)
                 return ov_infer(
                     self, inputs, stop_token_ids, self.generate_step
                 )

Original file line number	Diff line number	Diff line change
`@@ -137,7 +137,7 @@ def make_generate_function(self):`
`137`	`137`
`138`	`138`	`def wrapped_generate_function(inputs, stop_token_ids=None):`
`139`	`139`	`# Convert to numpy for OpenVINO backend`
`140`		`- inputs = tree.map_structure(ops.array, inputs)`
	`140`	`+ inputs = tree.map_structure(ops.convert_to_numpy, inputs)`
`141`	`141`	`return ov_infer(`
`142`	`142`	`self, inputs, stop_token_ids, self.generate_step`
`143`	`143`	`)`