Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions pyproject.toml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[build-system]
requires = ["setuptools==80.9.0", "setuptools-scm==9.2.0"]
requires = ["setuptools==82.0.1", "setuptools-scm==9.2.2"]
build-backend = "setuptools.build_meta"

[project]
Expand Down Expand Up @@ -76,7 +76,7 @@ huggingfacenotorch = [
"tyro",
"protobuf",
"sentencepiece>=0.2.0",
"datasets>=3.4.1,!=4.0.*,!=4.1.0,<4.4.0",
"datasets>=4.0,<4.6",
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Reinstate datasets 4.1.0 exclusion in extras constraints

This change removes the previous !=4.1.0 guard from the package extras, even though the Studio runtime requirements still explicitly exclude 4.1.0 (studio/backend/requirements/no-torch-runtime.txt). That inconsistency re-allows a known-bad dataset version for unsloth[huggingfacenotorch] / colab-new installs, so constrained environments can resolve to datasets==4.1.0 and hit the same incompatibility the runtime file is still protecting against.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Re-block datasets versions that crash at import time

This new specifier (datasets>=4.0,<4.6) now allows datasets 4.4.x and 4.5.0, but unsloth/import_fixes.py::patch_datasets() explicitly raises NotImplementedError for 4.4.0 <= datasets <= 4.5.0, and that patch runs during import unsloth (unsloth/__init__.py). In practice, installs via unsloth[huggingfacenotorch] (and the mirrored colab-new extra) can now resolve to a version that immediately breaks import, so these known-bad versions need to stay excluded in the extras bounds.

Useful? React with 👍 / 👎.

"accelerate>=0.34.1",
"peft>=0.18.0,!=0.11.0",
"huggingface_hub>=0.34.0",
Expand Down Expand Up @@ -582,7 +582,7 @@ colab-new = [
"packaging",
"tyro",
"transformers>=4.51.3,!=4.52.0,!=4.52.1,!=4.52.2,!=4.52.3,!=4.53.0,!=4.54.0,!=4.55.0,!=4.55.1,!=4.57.0,!=4.57.4,!=4.57.5,!=5.0.0,!=5.1.0,<=5.5.0",
"datasets>=3.4.1,!=4.0.*,!=4.1.0,<4.4.0",
"datasets>=4.0,<4.6",
"sentencepiece>=0.2.0",
"tqdm",
"psutil",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ description = "Local Data Designer unstructured seed reader plugin"
requires-python = ">=3.11"
dependencies = [
"data-designer-engine>=0.5.4,<0.6",
"pandas>=2,<3",
"pandas>=2,<4",
"pymupdf>=1.24.0",
"pymupdf4llm>=0.0.17",
"mammoth>=1.8.0",
Expand Down
6 changes: 3 additions & 3 deletions studio/backend/requirements/extras.txt
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,12 @@ hydra-core
hypothesis
kgb
parameterized
pytest<9.0
pytest<10.0
pytest-json-report
pytest-rerunfailures==15.1
pytest-rerunfailures==16.1
pytest-xdist
# Also needed by sentence_transformers (installed with --no-deps in extras-no-deps.txt)
scikit-learn==1.7.1
scikit-learn==1.8.0
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Keep extras compatible with Python 3.10 environments

Pinning scikit-learn==1.8.0 in extras.txt can break Studio dependency installation on Python 3.10 environments (for example when users run Linux setup with a --python 3.10 venv), because this major bump narrows interpreter support compared with the previous 1.7.x line. Since install_python_stack.py installs this requirements file as part of normal setup, the install can fail before Studio starts.

Useful? React with 👍 / 👎.


# Additional extras
pybind11
Expand Down
6 changes: 3 additions & 3 deletions studio/backend/requirements/no-torch-runtime.txt
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ tyro
protobuf
sentencepiece>=0.2.0
safetensors>=0.4.3
datasets>=3.4.1,!=4.0.*,!=4.1.0,<4.4.0
datasets>=3.4.1,!=4.0.0.dev,!=4.1.0,<4.9.0
accelerate>=0.34.1
peft>=0.18.0,!=0.11.0
huggingface_hub>=0.34.0
Expand All @@ -43,8 +43,8 @@ sniffio
h11

tokenizers
transformers>=4.51.3,!=4.52.0,!=4.52.1,!=4.52.2,!=4.52.3,!=4.53.0,!=4.54.0,!=4.55.0,!=4.55.1,!=4.57.0,!=4.57.4,!=4.57.5,!=5.0.0,!=5.1.0,<=5.3.0
trl>=0.18.2,!=0.19.0,<=0.24.0
transformers>=4.51.3,!=4.52.0,!=4.52.1,!=4.52.2,!=4.52.3,!=4.53.0,!=4.54.0,!=4.55.0,!=4.55.1,!=4.57.0,!=4.57.4,!=4.57.5,!=5.0.0,!=5.1.0,<=5.5.0
trl>=0.18.2,!=0.19.0,<=1.0.0
sentence-transformers
cut_cross_entropy
pillow
2 changes: 1 addition & 1 deletion studio/backend/requirements/overrides.txt
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# Torch AO overrides (installed with --force-reinstall --no-cache-dir)
torchao==0.14.0
torchao==0.17.0
10 changes: 5 additions & 5 deletions studio/backend/requirements/single-env/constraints.txt
Original file line number Diff line number Diff line change
@@ -1,16 +1,16 @@
# Single-env pins for unsloth + studio + data-designer
# Keep compatible with unsloth transformers bounds.
transformers==4.57.6
trl==0.23.1
huggingface-hub==0.36.2
transformers==5.5.0
trl==1.0.0
Comment on lines +3 to +4
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Keep constraints consistent with extras-no-deps pins

install_python_stack.py installs extras-no-deps.txt with -c single-env/constraints.txt (the pip_install(..., req=..., constrain=True) default), so these new pins must remain compatible with that file. Pinning transformers==5.5.0 and trl==1.0.0 here conflicts with extras-no-deps.txt still requiring transformers==4.57.6 and trl==0.23.1, which makes pip/uv fail with ResolutionImpossible and abort dependency setup.

Useful? React with 👍 / 👎.

huggingface-hub==1.9.0

# Studio stack
datasets==4.3.0
datasets==4.8.4
pyarrow==23.0.1

# FastMCP/OpenEnv compat
fastmcp>=3.0.2
mcp>=1.24,<2
websockets>=15.0.1

pandas==2.3.3
pandas==3.0.2
10 changes: 5 additions & 5 deletions studio/backend/requirements/single-env/data-designer-deps.txt
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
# Data Designer runtime deps installed explicitly (single-env mode).
# Synced with data-designer-engine==0.5.4 requirements.
anyascii<1,>=0.3.3
chardet<6,>=3.0.2
chardet>=3.0.2,<8
duckdb<2,>=1.5.0
faker<21,>=20.1.0
fsspec<2026,>=2025.3.0
faker>=20.1.0,<41
fsspec>=2025.3.0,<2027
httpx<1,>=0.27.2
httpx-retries<1,>=0.4.2
json-repair<1,>=0.48.0
Expand All @@ -14,10 +14,10 @@ lxml<7,>=6.0.2
marko<3,>=2.1.2
mcp<2,>=1.26.0
networkx<4,>=3.0
python-json-logger>=3,<4
python-json-logger>=3,<5
ruff<1,>=0.14.10
scipy<2,>=1.11.0
sqlfluff<4,>=3.2.0
sqlfluff>=3.2.0,<5
tiktoken<1,>=0.8.0
# Unstructured-seed plugin deps (plugin installed with --no-deps)
pymupdf>=1.24.0
Expand Down
6 changes: 3 additions & 3 deletions studio/backend/requirements/single-env/data-designer.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Install Data Designer in same env as Unsloth.
data-designer==0.5.4
data-designer-config==0.5.4
data-designer-engine==0.5.4
data-designer==0.5.5
data-designer-config==0.5.5
data-designer-engine==0.5.5
prompt-toolkit>=3,<4
4 changes: 2 additions & 2 deletions studio/backend/requirements/studio.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,12 @@ pydantic
matplotlib
pandas
nest_asyncio
datasets==4.3.0
datasets==4.8.4
pyjwt
easydict
addict
# gradio>=4.0.0 # 148 MB - Studio uses React + FastAPI, not Gradio
huggingface-hub==0.36.2
huggingface-hub==1.9.0
structlog>=24.1.0
diceware
ddgs