Skip to content

Commit 9ed5613

Browse files
docs: add todo.md tracking completed, in-progress, and upcoming work
1 parent cf68ba6 commit 9ed5613

1 file changed

Lines changed: 20 additions & 0 deletions

File tree

todo.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
# ValidateX Development Todo List
2+
3+
This file tracks the status of the ValidateX development tasks and upcoming roadmap features.
4+
5+
## Completed Tasks
6+
- [x] **v1.2.0 Release & Distribution**: Setup package dependencies, pyproject.toml, and twine distribution to PyPI.
7+
- [x] **Airflow Integration Fixes**: Update `ValidateXOperator` logic and write unit tests.
8+
- [x] **PySpark Windows Auto-Config**: Create `conftest.py` to auto-detect `JAVA_HOME` and download Spark `winutils.exe` dynamically.
9+
- [x] **GitHub Action Template**: Build composite `action.yml` for CI/CD integration and write template workflow.
10+
- [x] **Polars Engine Support (Core)**: Add routing for Polars engine and implement `_validate_polars` for core expectations (`ExpectColumnToExist`, `ExpectColumnToNotBeNull`, `ExpectColumnValuesToBeUnique`, `ExpectColumnValuesToBeBetween`).
11+
12+
## In Progress
13+
- [/] **Polars Engine Support (Expansion)**: Port the remaining 40+ column, table, and aggregate expectations to Polars.
14+
- [/] **Slack & Teams Notifications**: Implement webhook-based failure alerts in the reporting layer.
15+
16+
## Upcoming Work
17+
- [ ] **Baseline History Tracking & Trend Charts**: Save validation history locally and render trend lines inside HTML reports.
18+
- [ ] **Great Expectations Migrator**: Implement CLI parser to import Great Expectations JSON suites.
19+
- [ ] **Web Dashboard**: Create a lightweight Streamlit/React web dashboard for multi-dataset monitoring.
20+
- [ ] **dbt Integration**: Write a wrapper to invoke ValidateX checks during `dbt test` runs.

0 commit comments

Comments
 (0)