Skip to content

README.md

Latest commit

 

History

History
44 lines (33 loc) · 1.17 KB

README.md

File metadata and controls

44 lines (33 loc) · 1.17 KB

bsf_docker

Usage

1. Set up

We recommend using this app with uv as package manager

pip install uv
uv sync

Download the RAG GGUF model you want and place it in the models folder (we recommend the 350m version):

Launching the app

python -m src.main

CLI arguments: You can add an argument to choose if you want to use only the French, English or both versions (default is both). You can also set up debug mode and stream mode, and control the host and port from there (see --help for more)

python -m src.main -t both --debug --stream --p 8081

Docker Image

You can run the app using our pre-built image on Docker Hub:

# Pull the image
docker pull mdelsart/redline_app_350m:latest

# Run it, mapping port 8081
docker run -p 8081:8081 \
  --name red-line-app \
  mdelsart/redline_app_350m:latest

You can then access the app at: http://localhost:8081

Note: A version of the app with the 1B is also accessible - it is heavier and slower but slightly more accurate. You can access it at mdelsart/redline_app_1b:latest