#530: Migrated notebook deployment to Notebook Connector 3.0.0 by tkilias · Pull Request #529 · exasol/ai-lab

tkilias · 2026-06-17T10:55:17Z

Summary

Replace the repo-local notebook copy step with Notebook Connectors ai-lab deploy-notebooks during Docker image builds.
Remove the work_in_progress_notebooks build path so the image build has one notebook source of truth.
Update docs and tests to match the new single-path deployment flow.

Validation

poetry run pytest test/unit/test_dss_docker_image.py test/unit/test_run_install_dependencies.py test/unit/test_release_build.py
limactl shell default poetry run pytest test/integration/test_create_dss_docker_image.py -k test_install_notebooks -q

Closes #530

review-notebook-app · 2026-06-17T10:55:23Z

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

ArBridgeman · 2026-06-18T13:41:04Z

 You can use the command shown below with some limitations:
 * Does not support Integrated Exasol Docker-DB.
-* Does not allow creating Script Language Containers (SLCs), as is done in the examples in the notebooks [Exporting a flavor](https://github.com/exasol/ai-lab/blob/main/exasol/ds/sandbox/runtime/ansible/roles/jupyter/files/notebook/script_languages_container/export_as_is.ipynb) and [Customizing a flavor](https://github.com/exasol/ai-lab/blob/main/exasol/ds/sandbox/runtime/ansible/roles/jupyter/files/notebook/script_languages_container/customize.ipynb).
+* Does not allow creating Script Language Containers (SLCs), as shown in the notebooks "Exporting a flavor" and "Customizing a flavor".


Would it be better to have the notebook names? It sounds like these might be sections in them.

The files were export_as_is.ipynb and customize.ipynb

Hm, the notebook file names are not really relevant for most users, these are the titles of the notebooks and these are more likely to stay. But maybe we remove the reference to specific notebooks and keep it general.

Co-authored-by: Ariel Schulz <43442541+ArBridgeman@users.noreply.github.com>

tomuben · 2026-06-18T16:00:42Z

      - name: First Steps notebook
        test_file: nbtest_first_steps.py
        test_backend: onprem
        wip: no-wip


Here we still have the wip flag.
Can it be removed?

tomuben · 2026-06-18T16:00:53Z

      - name: SLC notebook
        test_file: nbtest_script_languages_container.py
        test_backend: onprem
        wip: no-wip


Here we still have the wip flag.
Can it be removed?

tomuben · 2026-06-18T16:00:56Z

      - name: short notebook tests
        test_file: "\"nbtest_environment_test.py nbtest_itde.py\""
        test_backend: ''
        wip: no-wip


Here we still have the wip flag.
Can it be removed?

deploy notebooks via connector

b2eae85

tkilias temporarily deployed to approve-test-execution June 17, 2026 10:55 — with GitHub Actions Inactive

tkilias requested a deployment to approve-gpu-test-execution June 17, 2026 10:55 — with GitHub Actions Waiting

tkilias temporarily deployed to approve-aws-ci-execution June 17, 2026 10:56 — with GitHub Actions Inactive

fix notebook ci workflow

e2d6ea3

tkilias temporarily deployed to approve-test-execution June 17, 2026 11:28 — with GitHub Actions Inactive

tkilias requested a deployment to approve-gpu-test-execution June 17, 2026 11:28 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 17, 2026 11:30 — with GitHub Actions Waiting

tkilias added 2 commits June 17, 2026 13:38

remove hyperlink workflow

d3138dd

fix notebook artifact naming

a02ba62

tkilias temporarily deployed to approve-test-execution June 17, 2026 11:52 — with GitHub Actions Inactive

tkilias temporarily deployed to approve-gpu-test-execution June 17, 2026 11:52 — with GitHub Actions Inactive

tkilias requested a deployment to approve-aws-ci-execution June 17, 2026 11:53 — with GitHub Actions Waiting

restore selected notebook tests

6265148

tkilias requested a deployment to approve-gpu-test-execution June 17, 2026 12:54 — with GitHub Actions Waiting

tkilias requested a deployment to approve-test-execution June 17, 2026 12:54 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 17, 2026 12:55 — with GitHub Actions Waiting

pin ansible apt dependencies

2aa8b16

tkilias requested a deployment to approve-test-execution June 17, 2026 13:22 — with GitHub Actions Waiting

tkilias requested a deployment to approve-gpu-test-execution June 17, 2026 13:22 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 17, 2026 13:23 — with GitHub Actions Waiting

unpin docker-ce

b2b6574

tkilias temporarily deployed to approve-test-execution June 17, 2026 14:52 — with GitHub Actions Inactive

tkilias temporarily deployed to approve-gpu-test-execution June 17, 2026 14:52 — with GitHub Actions Inactive

tkilias temporarily deployed to approve-aws-ci-execution June 17, 2026 14:53 — with GitHub Actions Inactive

tkilias mentioned this pull request Jun 17, 2026

Notebook deployment migration #530

Open

add changelog entry

1862606

tkilias requested a deployment to approve-test-execution June 18, 2026 07:14 — with GitHub Actions Waiting

tkilias requested a deployment to approve-gpu-test-execution June 18, 2026 07:14 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 18, 2026 07:15 — with GitHub Actions Waiting

pin notebook connector 3.0.0

57134ac

tkilias requested a deployment to approve-test-execution June 18, 2026 07:30 — with GitHub Actions Waiting

tkilias requested a deployment to approve-gpu-test-execution June 18, 2026 07:30 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 18, 2026 07:30 — with GitHub Actions Waiting

remove unstable notebooks tests job from github workflow

eb21cf1

tkilias deployed to approve-test-execution June 18, 2026 07:44 — with GitHub Actions Active

tkilias deployed to approve-gpu-test-execution June 18, 2026 07:44 — with GitHub Actions Active

tkilias deployed to approve-aws-ci-execution June 18, 2026 07:45 — with GitHub Actions Active

tkilias commented Jun 18, 2026

View reviewed changes

Comment thread doc/developer_guide/hyperlink-checking.md Outdated

tkilias commented Jun 18, 2026

View reviewed changes

Comment thread doc/developer_guide/notebooks.md Outdated

restore hyperlink workflow

6a4b15c

tkilias requested a deployment to approve-test-execution June 18, 2026 11:34 — with GitHub Actions Waiting

tkilias requested a deployment to approve-gpu-test-execution June 18, 2026 11:34 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 18, 2026 11:35 — with GitHub Actions Waiting

tkilias marked this pull request as ready for review June 18, 2026 11:35

tkilias changed the title ~~[codex] deploy notebooks via connector~~ #530: Migrated notebook deployment to Notebook Connector 3.0.0 from PyPI Jun 18, 2026

tkilias changed the title ~~#530: Migrated notebook deployment to Notebook Connector 3.0.0 from PyPI~~ #530: Migrated notebook deployment to Notebook Connector 3.0.0 Jun 18, 2026

ArBridgeman reviewed Jun 18, 2026

View reviewed changes

Comment thread doc/developer_guide/notebooks.md Outdated

ArBridgeman reviewed Jun 18, 2026

View reviewed changes

Comment thread nb_tests.yaml

Update doc/developer_guide/notebooks.md

48641c7

Co-authored-by: Ariel Schulz <43442541+ArBridgeman@users.noreply.github.com>

tkilias requested a deployment to approve-gpu-test-execution June 18, 2026 14:32 — with GitHub Actions Waiting

tkilias requested a deployment to approve-test-execution June 18, 2026 14:32 — with GitHub Actions Waiting

tkilias requested a deployment to approve-aws-ci-execution June 18, 2026 14:33 — with GitHub Actions Waiting

tomuben reviewed Jun 18, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

#530: Migrated notebook deployment to Notebook Connector 3.0.0#529

#530: Migrated notebook deployment to Notebook Connector 3.0.0#529
tkilias wants to merge 12 commits into
mainfrom
refactoring/use_new_notebook_connector

tkilias commented Jun 17, 2026 •

edited

Loading

Uh oh!

review-notebook-app Bot commented Jun 17, 2026

Uh oh!

Uh oh!

Uh oh!

ArBridgeman Jun 18, 2026

Uh oh!

tkilias Jun 18, 2026

Uh oh!

Uh oh!

Uh oh!

tomuben Jun 18, 2026

Uh oh!

tomuben Jun 18, 2026

Uh oh!

tomuben Jun 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

tkilias commented Jun 17, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Uh oh!

review-notebook-app Bot commented Jun 17, 2026

Uh oh!

Uh oh!

Uh oh!

ArBridgeman Jun 18, 2026

Choose a reason for hiding this comment

Uh oh!

tkilias Jun 18, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

tomuben Jun 18, 2026

Choose a reason for hiding this comment

Uh oh!

tomuben Jun 18, 2026

Choose a reason for hiding this comment

Uh oh!

tomuben Jun 18, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

tkilias commented Jun 17, 2026 •

edited

Loading