Skip to content

Releases: bnosac/localllm

0.3.0

11 Jun 07:18

Choose a tag to compare

0.3.0

  • Added textmodel_gepa_classify and a predict and summary function for it
  • import localllm_connect as connect making sure you can do
    import localllm
    localllm.connect("localllm/modelxyz")
  • Move converters to localllm.utilities.converters
  • model_name in LocalLLM objects use now the name passed on to localllm_download_model, not the gguf filename
  • localllm_download_model, added:
    • LFM2.5-8B-A1B-Q4_0
    • gemma-4-E4B-it-qat-UD-Q4_K_XL
    • gemma-4-12B-it-Q4_K_M
    • gemma-4-12B-it-qat-UD-Q4_K_XL

0.2.2

13 Apr 10:18

Choose a tag to compare

0.2.2

  • Added optional converters
    • from localllm.converters import tif, convert_dspy_example
    • added dependency on s3generics
    • added optional dependency on pandas for the converters
  • Bump dependency to Python >=3.10
  • LocalChatAdapter: more lenient parsing of the output fields [## value# ] and variants
  • localllm_download_model, added:
    • gemma-4-E4B-it-Q8_0
    • gemma-4-E4B-it-Q4_K_M
    • translategemma-12b-it-Q4_K_M
    • gemma-3-4b-it-qat-Q4_0
  • localllm_download_model, renamed
    • gemma-4-e2b-it-Q8_0 to gemma-4-E2B-it-Q8_0
  • localllm_download_model - reorder by bigger to smaller
  • Add localllm_list_models to list up the models which you can download easily

0.2.1

09 Apr 10:55

Choose a tag to compare

0.2.1

  • Exported localllm_connect
  • localllm_download_model, added:
    • Qwen3.5-9B-Q4_K_M
    • Qwen3.5-4B-Q4_K_M
    • Qwen3.5-2B-Q4_K_M
    • Qwen3.5-0.8B-Q8_0
    • LFM2.5-350M-Q8_0
    • gemma-4-e2b-it-Q8_0
    • gemma-4-E2B-it-Q4_K_M
  • LocalLLM
    • put call in try-catch block and return [None] in case of an error (e.g. context to big for the model) + log the error in case of trace
    • in call trace more arguments if requested

0.2.0

27 Mar 10:19

Choose a tag to compare

0.2.0

  • Added LocalChatAdapter (extending BAMLAdapator) to parse out the LLM response which are wrongly formatted more gracefully defaulting to dspy_signature_defaults in case of complete failure
  • Added dspy_signature_defaults
  • localllm_download_model, added:
    • gemma-3-12b-it-qat-Q4_0
    • Qwen3-8B-Q4_K_M
    • Qwen3-4B-Instruct-Q4_K_M
    • LFM2.5-1.2B-Instruct-Q4_K_M
    • LFM2.5-1.2B-Instruct-Q8_0
  • Added localllm.config.localllm_connect
  • Bump dependencies to llama-cpp-python>=0.3.8 and dspy>=3.0.0

0.1.0

29 Jan 13:49

Choose a tag to compare

0.1.0

  • Added functionality to download a model: localllm_download_model
  • Added functionality run a local model (with llama-cpp) alongside dspy: LocalLLM
  • localllm_download_model:
    • gemma-3-270m-it-Q8_0
    • gemma-3-270m-it-qat-Q4_0
    • gemma-3-1b-it-Q8_0
    • gemma-3-4b-it-Q4_K_M
    • GLM-4.6V-Flash-Q4_K_M
    • translategemma-4b-it-q8_0