Hi
I would like to ask if you can provide this format too
We will deploy the normal version in production but, if you are developing this with docker, the gpu isn't used
To allow docker to use it, it is necessary to use docker model runner which uses GGuf format
Is it possible?
I would look for a conversion process but I'm new on this field so I don't know how to do it but I'll try
Thanks
Hi
I would like to ask if you can provide this format too
We will deploy the normal version in production but, if you are developing this with docker, the gpu isn't used
To allow docker to use it, it is necessary to use docker model runner which uses GGuf format
Is it possible?
I would look for a conversion process but I'm new on this field so I don't know how to do it but I'll try
Thanks