How big the difference is for qwen 2.5 between 7B coder and 7B instruct ? Why is coder not available anymore ? #1257
Unanswered
ilan-schemoul
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
For some reasons it seems it's impossible to find any service providing qwen 2.5 7B coder online. i search everywhere for a long time and it puzzles me that even alibaba doesn't provide coder version anymore. Is it deprecated ?
Do instruct officially supports FIM ? I followed doc for autocompletion in my editor (nvim editor, minuet AI plugin) and it explains that to use fill in the middle I need to create a prompt with <fim_prefix> <fim_suffix> etc. ? I know this applies to coder LLM but does it apply to Instruct ?
I just tested and surprisingly it seems like it's working with FIM (/v1/completions endpoint) .... so I'm even more confused. Is FIM officially supported or I'm using it wrong and it works by accident ?
I'm new to this and struggle a ton to find current information.
All reactions