Skip to content
This repository was archived by the owner on Dec 2, 2025. It is now read-only.

Commit 3610d82

Browse files
Removed add_prefix_space parameter for now
This is a temporary change that must be reverted once the issue huggingface/transformers#32682 is solved for me. This quick fix allow an experimental release to test llama models and assisted generation
1 parent d50da72 commit 3610d82

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

server/model.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -351,8 +351,9 @@ def _load(self):
351351
def _load_tokens(self):
352352
try:
353353
self._Tokenizer = AutoTokenizer.from_pretrained(
354-
self._model_path,
355-
add_prefix_space=True
354+
self._model_path
355+
#add_prefix_space=True #TODO Uncomment it. Parameter needed for banned word list.
356+
# TODO This problem must be fixed before stable release. See error https://github.com/huggingface/transformers/issues/32682
356357
)
357358
except Exception as e:
358359
logger.log.error("Error loading tokens in " + self._model_path)

0 commit comments

Comments
 (0)