I am using the transformer version, windows, cuda 13.0 5060 16gb vram. vram usage is 15.4gb when I am running it. But the GPU is only at 25% usage.
I am using the transformer version, windows, cuda 13.0
5060 16gb vram. vram usage is 15.4gb when I am running it. But the GPU is only at 25% usage.