Update github workflows: add testing for new data mart, add release workflow, remove old workflow by sarahmcmorgan · Pull Request #878 · tuva-health/tuva-core

sarahmcmorgan · 2025-05-29T00:15:35Z

Describe your changes

Please include a summary of any changes.

Removes old workflow add_issues_to_project since this automation is now being handled by the default workflow in the project settings. This never worked for outside contributors anyway.
Adds new data mart var (fhir_preprocessing_enabled) to CI workflows
Adds new workflow to create release draft if there is a push to main/ that changes "version" in /dbt_project.yml (resolves Create CI for Tuva Release Process: new action to run CI and create release #835)

How has this been tested?

Please describe the tests you ran to verify your changes. Provide instructions or code to reproduce output.

Tested as much as possible locally with Act. Could not test the final steps that require GitHub’s infrastructure and live repo data.

Reviewer focus

Please summarize the specific items you’d like the reviewer(s) to look into.

Checklist before requesting a review

I have added at least one Github label to this PR (bug, enhancement, breaking change,...)
My code follows style guidelines
(New models) YAML files are categorized by sub folder and models listed in alphabetical order
(New models) I have added a config to each new model to enable it for claims and/or clinical data
(New models) I have added the variable tuva_last_run to the final output
(Optional) I have recorded a Loom to explain this PR

Package release checklist

I have updated dbt docs
I have updated the version number in the dbt_project.yml

(Optional) Gif of how this PR makes you feel

Loom link

sarahmcmorgan · 2025-06-02T23:00:26Z

CI tests are failing due to the new bug in eligibility. Waiting on fix in #885.

github-actions · 2025-06-05T23:21:25Z

Workflow has finished with the following statuses:

Linter: success

BigQuery Clinical and Claims: success

BigQuery Claims: success

BigQuery Clinical: success

Fabric Clinical and Claims: success

Fabric Claims: success

Fabric Clinical: success

Redshift Clinical and Claims: success

Redshift Claims: success

Redshift Clinical: success

Snowflake Clinical and Claims: success

Snowflake Claims: success

Snowflake Clinical: success

lucas-tuva

The release workflow looks good to me. Just one comment

lucas-tuva · 2025-06-11T15:37:46Z

+on:
+  push:
+    branches:
+      - 'main/*'


Won't this match branches starting with main/. Don't you want to match on pushing to main?

@lucas-tuva that's a good point. For now, we should probably only have this on "main". I was thinking "main/*" would support release branches. We can always adjust this if we switch to that workflow in the future.

lucas-tuva

I can approve it from the github workflow perspective, but don't know enough about the DBT stuff

…orkflow, remove old workflow (#878) * update workflow to assign owners to new issues added to project board * add new data mart var to CI workflows * update token * update token comments * add release workflow * fix secret name * remove old workflow * add new workflow * remove assign issues workflow * update branch trigger

@chase-jones

* update data type for death_flag * Fix column typings in medical claim seed (tuva-health#767) * update medical claim data type * add typing for rendering tin * type for billing tin * unnecessary change * Patch 0.14.7 Release (tuva-health#768) * update package version and seed paths * update dbt docs * Added check for readmissions enabled for mart review * Patch release v0.14.8 (tuva-health#779) updated docs and dbt_project.yml for patch release * update it readme, varname * Updated contributing instructions for running and linting * swapping coalesce for case * Move member_month_key calculation to norm_input_elig. Adjust claims_e… (tuva-health#784) * Move member_month_key calculation to norm_input_elig. Adjust claims_enrollment off core models. Optimize core mem_months. * linting * linting --------- Co-authored-by: tom-tuva <159959263+tom-tuva@users.noreply.github.com> * Provider terminology fields addition (tuva-health#789) * feat: added three fields in provider terminology * feat: update seed path to 0.15.0 * fix: revert 0.15.0 to 0.14.9 * 0.14.9 release (tuva-health#790) * Updated error message to be more informative * Ci updates compile (tuva-health#823) * updated different jobs in CI/CD to compile dbt to save processing time * updated different jobs in CI/CD to compile dbt to save processing time * update encounter_type seed to include new column * updating length of discharge disposition description column * updating length of discharge disposition description column * update poa length * update ci to include seed with compile. needed when there is a terminology change. * fixed/changed outside contributor dbt commands * Terminology Update: revenue_center (tuva-health#822) feat: revenue center terminology seed update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Fix redshift actions to compile instead of build (tuva-health#824) fix redshift actions to compile instead of build * Terminology Update: place_of_service (tuva-health#820) feat: place of service terminology seed update * Terminology Update: 'Encounter type' (tuva-health#804) feat: new column added on 'encounter_type' terminology Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Release patch 0.14.11 (tuva-health#827) * update package version and seed paths * update dbt docs * fix * Fix join clause in `data_quality__encounters_cost_and_utilization` (tuva-health#852) fix join alias * Provider attribution should have patient_id column when disabled https://thetuvaproject.slack.com/archives/C03DET9ETK3/p1746831452558529 * Update Icd10 column descriptions (tuva-health#853) Edit of icd-10-cm header_flag column description in terminology seed file * Terminology Update: NDC, RXNORM_TO_ATC, RXNORM_BRAND_GENERIC, Valueset: RXNORM_GENERIC_AVAILABLE (tuva-health#859) feat: new data from 5/21/25 * Terminology Update: Provider and Other Provider Taxonomy - May 2025 (tuva-health#860) feat: new data from May 2025 * Terminology Update: APR-DRG, MS-DRG, ICD10CM, ICD10PCS, HCPCS Level 2 (tuva-health#861) feat: new terminologies update * Allow claims preprocessing to handle multiple data sources in a connector (tuva-health#803) * Add data_source to table joins and unique checks in service category models * update test * Regex for icd-10-cd modes now includes special code sets (tuva-health#865) * Revert "Fix redshift actions to compile instead of build (tuva-health#824)" (tuva-health#870) This reverts commit a285c9f. * Add tuva invocations (tuva-health#843) * Add tuva_invocations. Organize macros. * Clean up * Fix schema generation. Revert some config changes. * Fixed for multi-platform support and custom_tuva_prefix. * Make adjustments for Fabric and BigQuery * Fix create table bug * Adjusted for bigquery * Fixed dropping old tuva invocations for bigquery * Add tuva_invocations. Organize macros. * Clean up * Fix schema generation. Revert some config changes. * Fixed for multi-platform support and custom_tuva_prefix. * Make adjustments for Fabric and BigQuery * Fix create table bug * Adjusted for bigquery * Fixed dropping old tuva invocations for bigquery * Merge tuva_invocation code to single macro file. Add metadata retention var. * Address PR comments * Correct package version for elementary fork * Updating multiple values tests to have a floor of 0 as not null tests should check for nulls (tuva-health#872) * remove distinct from encounter stage as it is redundant * additional unnecessary distinct * linter * Release Patch 0.14.12 (tuva-health#875) * update package version and seed paths * update dbt docs * Add fhir_preprocessing data mart (tuva-health#863) * add fhir_preprocessing mart * Add amount to adjudication status * Add logic to fix duplicate issues * add data source to models * add data source to models and filter claims from clinical resources * add data source to models * add data source to models and hash coverage id * add data source to models * rename add prefix to intermediate aliases * rename fields * fix required fields * add hash for observation ids * add benefit type to coverage * add coverage type list * fix aliases * add macro to create_json_objects * add data types * add bigquery logic to create_json_object macro * fix data types and length function * add redshift logic to create_json_object macro * update bigquery logic * add syntax support for fabric * add quote macro for plan * add length macro for adapter support * add fabric logic to create_json_object macro * update data type for fabric logic * fix column name for patient resource * clarify mapping comments for coverage type * add variable for fhir_preprocessing_enabled * update config for enabled logic * add missing models to yml * clean up fabric logic for placeholder tables * add fhir_preprocessing_enabled variable to integration_tests * move macros to new folder * add tuva package version to final tables * add documentation to yml * add package name to tuva macros * add package name to tuva macros * add enrollment_end_date to coverage window logic in eob models * fix macro name * add fhir_preprocessing var to docs_generate and update dbt docs for knowledge base * Update dbt docs (tuva-health#882) * update dbt docs * update dbt docs * fix: "header_flag" field in terminology__icd_10_cm renamed to "billable_code_flag" * Revert "Merge pull request tuva-health#883 from BijayaShres/icd_10_cm_field_rena… (tuva-health#886) Revert "Merge pull request tuva-health#883 from BijayaShres/icd_10_cm_field_renaming" This reverts commit cb5cfb5, reversing changes made to 3215af9. * Add duckdb support to create_json_object macro (tuva-health#890) add macro for duckdb * update regex * Fix enrollment being exploded to row per member-month. Adjust testing on PK. (tuva-health#885) * Fix enrollment being exploded to row per member-month. Adjusted unique value check on enrollment and member_month. * Linting * Revert testing changes * Added member_months to models.yml * Add stg core member months to models yml * Release patch v0.14.13 (tuva-health#894) * update package version and seed paths * update dbt docs * Update description to match the databases we support * service category and encounter enhancement added long-term acute care encounter and service categories refined inpatient service category logic and integrated lower-priority institutional claims into grouping logic applied DBT union_relations macro and custom macro fixes to resolve datetime and Fabric syntax issues * split sql files to reduce memory load * Split SQL files to reduce memory load (tuva-health#909) split sql files to reduce memory load * Updating another file with dense rank * Update elementary version (tuva-health#908) * Fix uniqueness check on input_layer__eligibility to include member_id (tuva-health#905) * fix 3 additional broken slack links (tuva-health#902) * Make sure we only get ICD-10-PCS codes in CCSR long procedure category (tuva-health#897) * Bill type code multiple not sev 1 (tuva-health#922) * HCPCS/CPT value set update for CMS HCC data mart (tuva-health#906) feat: cpt data for 2025 [CMS_HCC valueset] * Update github workflows: add testing for new data mart, add release workflow, remove old workflow (tuva-health#878) * update workflow to assign owners to new issues added to project board * add new data mart var to CI workflows * update token * update token comments * add release workflow * fix secret name * remove old workflow * add new workflow * remove assign issues workflow * update branch trigger * Patch release v0.14.14 (tuva-health#924) * update package version and seed paths * update dbt docs * Fixing MDC value bug (tuva-health#931) * Change line level claim date to header level (tuva-health#928) * 932 if encounters between claims and clinical datasets overlap ie adt both encounter get thrown out in readmissions (tuva-health#933) * Make updates to readmissions log to pick one out of the bunch of overlapping instances. Choose the medical claim over the encounter. Prefer longer duration * Rename columns to match * Pulling through encounter source type * adding column name * Encounter type is not needed * Adding distinct to fix logic on mapping * database compatibility * Add enhancements for CI Testing data (tuva-health#929) * update seed and model config * update dbt_project.yml to use synthetic data by default * fix redshift config to match vCPU in cluster * move fabric host to github secrets * update github workflows to use synthetic data seeds * update env vars for redshift profile * remove outdated env vars for redshift and clean up formatting * update github workflows to use synthetic data seeds * Provider Terminology data update - June (tuva-health#939) feat: provider terminology data - june Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Revert "Change line level claim date to header level" (tuva-health#942) Revert "Change line level claim date to header level (tuva-health#928)" This reverts commit 7c5631c. * Patch 0.14.15 (tuva-health#940) * update package version and seed version paths * update dbt docs * update dbt docs * Coderx weekly data (tuva-health#934) feat: new coderx terminology data * Adding risk adjusted benchmark mart (tuva-health#938) Adding mart used for training models and bringing predictions back into the tuva project * Fix redshift CI tests (tuva-health#949) * change redshift ci workflows to be consistent with other jobs * change redshift test back to build * Change where exists to join criteria (tuva-health#950) Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Add action to automate updating and publishing dbt docs (tuva-health#945) * Add workflow for deploying dbt docs on main push * Fix PMPM Prep pk (tuva-health#952) add payer to pk * Adjust metadata schema to account for target schema config. (tuva-health#955) Adjust metadata schema to account for target schema config. Remove invocation log message for deletion. * Quick CI update for redshift (tuva-health#956) increase dbt threads for redshift * Updated descriptions for Input Layer Data Dictionary * New terminologies data (tuva-health#944) feat: new terminologies data Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Patch release v0.14.16 (tuva-health#958) * update package version and seed paths * remove old release steps from pull request template * Remove old docs folder (tuva-health#959) remove old docs folder * Load SVI Seed Data from S3 (tuva-health#935) * feat: reference data SVI seed file added * fix: Consolidate 2020 and 2022 SVI Data into Single Table --------- Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Update LOINC terminology (tuva-health#961) update seed path * Fix apr_drg terminology (tuva-health#962) fix: apr_drg 3 digits with padded 0 Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Benchmarking fix * remove actual location from discharge prediction * adding lower to adjust for capitalization differences between warehouses * updating placeholders * Release patch 0.14.17 (tuva-health#964) bump package version and seed paths * DRAFT: added try cast to prevent conversion errors (tuva-health#968) * added try cast to prevent conversion errors. * edited syntax to safe_cast for BQ * Inpatient merge logic (tuva-health#965) * adding case for same day start merge * updating other inpatient encounter types * Removing trailing whitespaces for linter --------- Co-authored-by: Tom Sherwood <tom@tuvahealth.com> * Fixing data type inconsistency * Fix duckdb seed loads to include the first row. (tuva-health#979) * Add HTML data quality dashboard (tuva-health#977) * Add data quality dashboard. * Update ui/data_quality_dashboard.html Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * Fixing typo * Update GitHub action: adding release branches to internal workflow (tuva-health#980) * add release branches to internal workflow * rename create release workflow * Fixup internal workflow triggers (tuva-health#986) * fix workflow * fix workflow * Fixup internal workflow triggers - add branches back (tuva-health#988) fix workflow * 970 | Creating de-duplication logic for patients in both claims and clinical (tuva-health#971) * 970 | Creating de-duplication logic for patients in both claims and clinical Made decision to choose claims over clinical for datasets. Patient table has an expectation of PK on the person_id column. * Specify only wanting columns from clinical patient * Update accepted values on procedure code type (tuva-health#997) update accepted values on procedure code type * Add testing to check for overlap between medical claim / pharmacy claim and eligibility (tuva-health#943) * first pass at overlap checks * update checks * linting * gitkeep * refactor testing, update severity level * lint * database compatibility * swap coalesce for case when * fix join * Add missing provider fields to dbt docs (tuva-health#999) add missing fields * Add missing input layer fields (tuva-health#1005) update yml * Update pull_request_template.md * Update github workflows: add better concurrency and remove push trigger (tuva-health#1003) * remove push trigger * add logic to concurrency group * fix concurrency logic * Provider update for July 2025 (tuva-health#1011) update seed path version * Patch release v0.14.18 (tuva-health#1012) update package version and seed paths * Update HCPCS code test, add threshold for PMPM (tuva-health#1008) * update hcpcs code test, add threshold for PMPM * update test and severity level * update test config * fabric * Point terminology meta configs to docs instead of GitHub (tuva-health#1014) * fix links * trim whitespace * Fixes inconsistent datatype for integration tests pharmacy_claim_seed (tuva-health#1025) Fixes inconsistent datatype for integration tests pharmacy_claim_seed columns. * Removes date/datetime as options for "amount" field data types. (tuva-health#1027) * Add file date to core claims input layer (tuva-health#1019) * Add claim type distribution check (tuva-health#1028) * add test * case when * Updating claim types + adding test to check for claim type (tuva-health#994) * Setting severity level to warn hcpcs_code input test (tuva-health#1033) * Add fabric support new DQI & Move testing from older dqi into newer dqi (tuva-health#966) * Adding plan overlap test (tuva-health#1006) * [Breaking Change] Minor release v0.15 (tuva-health#1000) ### Major Features: - Appointment data - Immunization/vaccine tracking (CVX codes) - Lab Order/Component mapping - Enhanced patient demographics - Improved data quality framework (especially for Fabric) - State normalization improvements ### Important Clarifications: - **Fabric**: Already supported, but now has comprehensive data quality tests enabled - **Bug fixes**: Missing codes now properly flow to core tables ### Migration Steps: 1. Update packages.yml to version `0.15.0` (or add a range `version: [">=0.15.0","<0.16.0"]`) 2. Run `dbt clean` then `dbt deps` 3. If using `clinical_enabled: true`: i. Create new input models `appointment` and `immunization` and map your data or create empty tables ii. Update existing models `lab_result` and `patient` 4. If using `claims_enabled: true`, update existing model `eligibility` 5. Run `dbt build --full-refresh` 6. Review `data_quality__testing_summary` table 7. Fix/disable tests as needed 8. Verify downstream dependencies ### Pull requests included: Bug fixes: * tuva-health#990 * tuva-health#1035 Data model changes * tuva-health#973, tuva-health#1034 * tuva-health#981 * tuva-health#1030 * tuva-health#1032 Enhancements * tuva-health#975 * tuva-health#1018 * tuva-health#1036 * tuva-health#1031 Terminology updates * tuva-health#895 * tuva-health#896 --------- Co-authored-by: Bijaya <bijaya.shrestha@maitriservices.com> Co-authored-by: bradmontierth <72261515+bradmontierth@users.noreply.github.com> Co-authored-by: Andreas Martinson <32916663+amartinson193@users.noreply.github.com> Co-authored-by: krishyfishy <53307963+krishyfishy@users.noreply.github.com> Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> Co-authored-by: David Shimamoto <david@tuvahealth.com> Co-authored-by: Utsav Paudel <utsavpaudel111@gmail.com> Co-authored-by: NabinHyanmikha-Maitri <nabin.hyanmikha@maitriservices.com> * Update seed paths v0.15 & fix doc-generate workflow (tuva-health#1038) * update seed paths * fix dbt version * fix dbt build in docs workflow * fix path for immuniation ci_testing seed * [Bug] Add missing eligibility fields for docs (tuva-health#1039) * add missing eligibility fields * add missing eligibility fields * fix: renamed the seed column names (tuva-health#1048) * Removing tests and duplicate file_date definitions (tuva-health#1052) * Prospective benchmarks (tuva-health#1049) * adding prospective benchmark tables as inputs from models * bringing in output of models as sources into tuva project and transforming to member month grain * Provider Terminology data update - September (tuva-health#1054) feat: provider terminology data update - Sept * Patch v0.15.1 (tuva-health#1059) update package version and seed paths * Removing diagnosis_code_voting (tuva-health#1055) removing normalized_input__int_diagnosis_code_normalize.sql and normalized_input__int_diagnosis_code_voting.sql Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Adding coalesce to benchmark chronic condition features (tuva-health#1062) adding colaesce to features now that that they're brought in with a left join * Providing correct variable on column type list wrapper (tuva-health#1072) * Data type should be sev 2 error level (tuva-health#1070) * [Feature] add optional source input for quality measures mart (tuva-health#1060) * add new doc blocks * add new optional mart input * add new optional mart variable * add tags and update col names for cql engine log * fix hedis seed * add optional hedis input to ci_testing * add fhir_preprocessing var to ci_testing * add hedis input staging models to quality measures mart * add new cross-database macro to extract text from string * move hedis to sub-datamart * fix load_seed to handle quoted empty strings * add hedis models * update input models * update input models * update input models * update input models * update quality measure seed * fix load_seed macro * add measure_id and clean measure names * add columns to docs * add snapshots * remove unused macro * fix snapshot keys and input_layer docs * fix sources in testing folders * Bug/undocumented fields in encounter table (tuva-health#1050) * fix: missing field of encounter model documented * Apply suggestion from @chase-jones --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * Coderx weekly data (tuva-health#1078) feat: CodeRx Weekly Data Update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Databricks VARCHAR Data Type issue fix (tuva-health#1061) * fix: databricks issue fix * fix: unwanted line erased --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * updating ccs to latest year and updating joins to use year to join to… (tuva-health#1069) * updating ccs to latest year and updating joins to use year to join to correct version * linting * Terminology/update HCPCS_Level_II terminology (tuva-health#1074) feat: HCPCS_Level_II terminology update for September Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Patch v0.15.2 (tuva-health#1079) update package version * update input_layer__medical_claim.yml unique value count test so null… (tuva-health#1081) * Removal of icd10_pcs_cms_ontology duplicate header row (tuva-health#1085) duplicate header issue fixed * FIPS code missing for District of Columbia (tuva-health#1084) ANSI FIPS Terminology update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Terminology/update icd 10 cm terminology set (tuva-health#1092) feat: ICD_10_CM terminology updated * Terminology/update icd 10 pcs terminology set (tuva-health#1093) feat: ICD_10_PCS terminology updated Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Bug/person id crosswalk missing tuva last run (tuva-health#1090) tuva_last_run column added in core__patient_id_crosswalk table * Update medical and pharmacy claim allowed amount checks (tuva-health#1083) update medical and pharmacy claim allowed amount checks * MDC and MS_DRG terminology data update (tuva-health#1094) feat: mdc and ms-drg terminology data update * Added new terminology and value sets * Coderx weekly data update (tuva-health#1095) feat: Coderx weekly data update * Adding new terminology files * Remove unsupported data type (databricks) (tuva-health#1100) remove unsupported data type * fix: deduplicate source tables before joins in adhras_long (tuva-health#1087) * fix: deduplicate source tables before joins in adhras_long Prevents Cartesian explosion by deduplicating denominator, numerator, and exclusions tables before joining. Reduces runtime from 1+ hours to minutes on datasets with multiple pharmacy claims per person. * linting * Patch v0.15.3 (tuva-health#1102) update package version and seed paths * Updating terminology to support other dbs * Fixing CSV whitespace * Added descriptions * Removing hcpcs file * Adding back CSV * Fixing schemas * Performance improvements for `claims_preprocessing.member_months` (tuva-health#1088) * first pass at performance improvement * PR feedback * feat(provider_attribution): add generic provider attribution mart (yearly/current) and provider ranking using input_layer and terminology seeds\n\n- Yearly and current (rolling 12) assignment by plurality of allowed charges\n- Provider bucket via taxonomy→Medicare specialty→PCP/Specialist/NPP\n- Primary care HCPCS filter\n- Ranking table with full provider candidates and joinable attribution_key\n- Hard-coded fallback to paid_amount when allowed_amount is null or zero\n\nModels:\n- intermediate: int_person_years, provider_classification, int_primary_care_claims, int_yearly_steps, int_current_steps\n- final: assigned_beneficiaries_yearly, assigned_beneficiaries_current, provider_ranking\n- yml: generic_provider_attribution_models.yml * updating yml * reserved keyword * syntax error * column name standardization * syntax fix * adding in row for all members to output table * Only run tuva hooks when tuva nodes selected (tuva-health#1108) * Add granular control over on-run-start and on-run-end hooks via dbt variables * adding stage, calendar joins for date builds, input var * rename and organize * chang wording on not assigned * linting * fixing linting version mismatch differences * yml ordering, model renaming, removing expanded var * fix claims mart gating and bq error * fixing clinical gating * fixing var for this mart * adding last run var * adding fallback steps, fixing bad terminology join * fixing bad term join * matching logic across current vs historical * fix null providers * adding step descriptions * fixing multiple assignement steps * bad terminology values * limiting steps to individuals * fixing yearly bug * rebuild ranking to show all providers * fix missing cte * fixing recon between current and yearly * linting * union distinct fabric fix * moving refs to use core instead of input layer * linting * Update terminology Add provider_taxonomy_unpivot + update to 0.15.4 (tuva-health#1115) * Add missing CSV * Adding terminology seeds * Adding descriptions * Create new semantic layer datamart (tuva-health#1103) * Update regex in revenue center code test (tuva-health#1119) * Revert "Performance improvements for `claims_preprocessing.member_mon… (tuva-health#1123) Revert "Performance improvements for `claims_preprocessing.member_months` (tuva-health#1088)" This reverts commit ccf6a06. * 0.15.4 release patch (tuva-health#1124) * Redshift Serverless ci testing (tuva-health#1125) * Update CI to use Redshift Serverless (tuva-health#1130) * Check disable dbt invocation elementary variable (tuva-health#1132) * 829 officially support databricks (tuva-health#1141) * 1126 official support of duckdb (tuva-health#1142) * Add file name to core.medical_claim, core.pharmacy_claim, core.eligibility (tuva-health#1144) * add file name to core med pharm elig * qualify * lint * AWS Athena Compatibility Updates (tuva-health#1146) * updates to outside contributor CI (tuva-health#1148) * Redshift Error Fix | Change dbt-data-reliability revision to v0.18.4 (tuva-health#1155) Updated the revision of dbt-data-reliability package. * Release 0.15.5 * Updates to Input Layer and Core YML Files and CI Updates(tuva-health#1149) * Add payer column to cms hcc (tuva-health#1121) * Added payer to staging layer for cms_hcc * Adding payer to intermediate models * Add payer to final models * Adding payer to HCC suspecting * Fixing core models typo * Add new model grouping by factor type * Adding missing curly braces * Updating pk check * Add hcc_suspecting__list_all * Fixing typo * Fixing primary key * Updating pk * Fixing pk * Updating pk * Adding distinct to condition * Adding claim ID to eligible conditions * Updating elig conditions w/claim_line_num * fixing bug * fixing bug * updating pk * Fixing payer in patient table * Fixing payer in patient table * Adding distinct to fix pk * Removing plan * Fixing typos * fixing typo * Adding missing payer * Adding missing payer * Fixing factor type * fixing enrollment interaction factors * Adding factor type to yml * fixing sqlfluff errors * Updating condition to support claim ID * Updating stg_core__conditions * Adding distinct * fixing hcc suspecting payer + adding model version to int all cond * Adding v24 to hcc suspecting * removing payer from clinical tables * Fixes bugs for CI/CD * Removing payer from patient * Fixing age calc * reverting age change * Fixing sqlfluff linting * Fixing trailing whitespace * removing payer from patient * Fix enrollment status * fixing boolean issue for fabric * fixing redshift * fixing redshift * fixing casting inconsistency * Fixing payer * Fixing bug * Fixing bug * fixing joins * Adding documentation * Adding documentation + updating aggregation from sum to max * fixing institutional status * Adding documentation * Adding missing V24 seed mapping * Adding documentation * Adding fixes * fixing syntax error * restore test * fixing tests * fixing sql fluff * fixing whitespace * fixing enrollment status --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> * 1165 redshift error failed to find conversion function from unknown to character varying (tuva-health#1166) * Coderabbit config for open source (tuva-health#1167) * Performance improvements for claims_enrollment__member_months (tuva-health#1163) add first pass at improvements Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * CMS-HCC Mart Accuracy Improvement (tuva-health#1173) * removed claims_expanded and renamed provider_attribution (tuva-health#1176) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Add data_source to key tables of interest (tuva-health#1157) * Update test criteria for warn_if_null_percentage_above_zero (tuva-health#1178) * Pull through patient ID on core__medication (tuva-health#1182) pull through patient id * added hedis measures output mart (tuva-health#1180) * added hedis measures output mart * updates for hedis measures and release prep * retrigger ci --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Refactor encounters__combined_claim_line_crosswalk (tuva-health#1169) * break out institutional claims, do not repeat join * add model config * update yml, final select, etc --------- Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Update project to require dbt version >=1.10.0 (tuva-health#1183) * fix deprecations * autofix integration_tests * update require dbt version * fix vars * coderabbit feedback * fixes * fix alignment --------- Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Minor fixes (tuva-health#1188) * minor updates to date fields on claims tables * moved pr template --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Duckdb semantic layer (tuva-health#1171) * Updated Tuva Package Version Number to 0.16.0 (tuva-health#1189) updated tuva version number Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Create the HCC Recapture Mart (tuva-health#1190) * Add HCC recapture mart * Adding configs * Update naming * Updating chronic conditions + fixing linting issues * fixing linting errors * linting fixes * fixing linting issues * fixing linting * fixing linting * Updating code to fix CI/CD errors * Moving flattened hierarchy to dbt_project as a value set * removing hierarchy * Adding cms_hcc_seed info * Adding file for seed * Fixing mispelling in seed * Updating dbt_project.yml * fixing datatype * Updating comment * updated hcc_recapture to work w/ fabric * fixed linting issue * fixed linting issue * fixed linting issue --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated version number to 0.16.1 (tuva-health#1192) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated ci for snowflake (tuva-health#1193) * updated ci for snowflake * updated ci vars * added profiles * updated all other ci workflows & profiles * updated working directories * fixed ci workflow errors * updates for cross-database issues in semantic layer * updates for semantic layer to work on DWs * removed old ci related stuff * removed unused doc blocks and helper scripts * restored dbt doc blocks folder for now --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Update conditions to capture previously missing diagnosis (tuva-health#1175) * updating conditions to include all diagnosis since some were excluded * Adding a missing filter * Adding split part * Adding missing underscore * Adding more documentation * linting fixes * fixing ambigious join error * update fabric * fixing bug with reversed conditions * Adding customization for fabric * Updating split_part carveout for fabric * small doc update --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * BUG FIX: numeric min for hierarchy top-level (tuva-health#1194) fix(cms_hcc): numeric min for hierarchy top-level Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Fixed Redshift / Snowflake Discrepancy (tuva-health#1197) fixed issue where adh quality measures were getting different results on redshift/snowflake due to LEAST() function Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated version for release (tuva-health#1198) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Fix observation staging for claims-only logic (tuva-health#1199) fix observation staging for claims-only --------- Co-authored-by: Krish Maypole <krish@tuvahealth.com> Co-authored-by: krishyfishy <53307963+krishyfishy@users.noreply.github.com> Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> Co-authored-by: David Shimamoto <david.shimamoto@gmail.com> Co-authored-by: thutuva <101137626+thutuva@users.noreply.github.com> Co-authored-by: bradmontierth <72261515+bradmontierth@users.noreply.github.com> Co-authored-by: tom-tuva <159959263+tom-tuva@users.noreply.github.com> Co-authored-by: Utsav Paudel <utsavpaudel111@gmail.com> Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> Co-authored-by: Bijaya <bijaya.shrestha@maitriservices.com> Co-authored-by: David Shimamoto <david@tuvahealth.com> Co-authored-by: sah129 <55058535+sah129@users.noreply.github.com> Co-authored-by: jansenpa <jansenpa@gmail.com> Co-authored-by: Lucas Leblow <lucas@tuvahealth.com> Co-authored-by: Andreas Martinson <andreas@tuvahealth.com> Co-authored-by: Andreas Martinson <32916663+amartinson193@users.noreply.github.com> Co-authored-by: Ivy Hjornevik <ivyhjornevik@mac.mynetworksettings.com> Co-authored-by: ivy-tuva <ivy.hjornevik@tuvahealth.com> Co-authored-by: Tom Sherwood <tom@tuvahealth.com> Co-authored-by: Gabe Cano <70255816+gabecano4308@users.noreply.github.com> Co-authored-by: NabinHyanmikha-Maitri <nabin.hyanmikha@maitriservices.com> Co-authored-by: Aaron Stern <aaron.stern@tuvahealth.com> Co-authored-by: bradmontierth <bradmontierth@gmail.com> Co-authored-by: Seamus McKinsey <seamus-mckinsey@users.noreply.github.com> Co-authored-by: mkrahu-tuva <mike.krahulec@tuvahealth.com> Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local>

github-project-automation Bot added this to The Tuva Project May 29, 2025

github-project-automation Bot moved this to 👀 Ready for Review in The Tuva Project May 29, 2025

sarahmcmorgan changed the title ~~Update github workflows~~ Update github workflows: add assignees and new optional data mart May 29, 2025

sarahmcmorgan changed the title ~~Update github workflows: add assignees and new optional data mart~~ Update github workflows: add assignees to new issues, add testing for new data mart, add release workflow May 29, 2025

sarahmcmorgan added the ignore-for-release Do not include in release notes label May 29, 2025

sarahmcmorgan moved this from 👀 Ready for Review to 🏗 In Progress in The Tuva Project May 29, 2025

sarahmcmorgan marked this pull request as ready for review May 29, 2025 22:59

sarahmcmorgan force-pushed the add-workflows branch 2 times, most recently from 7cf5612 to dc8837a Compare June 2, 2025 22:43

sarahmcmorgan force-pushed the add-workflows branch from dc8837a to dcf3ab4 Compare June 3, 2025 16:12

sarahmcmorgan self-assigned this Jun 3, 2025

sarahmcmorgan added the 0.14.14 label Jun 5, 2025

sarahmcmorgan changed the title ~~Update github workflows: add assignees to new issues, add testing for new data mart, add release workflow~~ Update github workflows: add testing for new data mart, add release workflow, remove old workflows Jun 5, 2025

sarahmcmorgan changed the title ~~Update github workflows: add testing for new data mart, add release workflow, remove old workflows~~ Update github workflows: add testing for new data mart, add release workflow, remove old workflow Jun 5, 2025

sarahmcmorgan force-pushed the add-workflows branch from 2e004d4 to 85b6939 Compare June 5, 2025 18:28

lucas-tuva reviewed Jun 11, 2025

View reviewed changes

sarah-tuva added 10 commits June 16, 2025 13:53

update workflow to assign owners to new issues added to project board

59a2d9e

add new data mart var to CI workflows

ceea9d1

update token

bab6f73

update token comments

207bcdc

add release workflow

805e3cc

fix secret name

7a749cc

remove old workflow

085707a

add new workflow

ef40f23

remove assign issues workflow

56fe918

update branch trigger

a52b733

sarahmcmorgan force-pushed the add-workflows branch from 4c053bd to a52b733 Compare June 16, 2025 19:53

lucas-tuva approved these changes Jun 17, 2025

View reviewed changes

Merge branch 'main' into add-workflows

a552d65

sarahmcmorgan merged commit db7058d into main Jun 17, 2025
9 checks passed

sarahmcmorgan deleted the add-workflows branch June 17, 2025 17:58

github-project-automation Bot moved this from 🏗 In Progress to 🚀 Ready to Release in The Tuva Project Jun 17, 2025

sarahmcmorgan moved this from 🚀 Ready to Release to ✅ Done in The Tuva Project Jun 17, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Update github workflows: add testing for new data mart, add release workflow, remove old workflow#878

Update github workflows: add testing for new data mart, add release workflow, remove old workflow#878
sarahmcmorgan merged 11 commits into
mainfrom
add-workflows

sarahmcmorgan commented May 29, 2025 •

edited

Loading

Uh oh!

sarahmcmorgan commented Jun 2, 2025

Uh oh!

github-actions Bot commented Jun 5, 2025

Uh oh!

lucas-tuva left a comment

Uh oh!

lucas-tuva Jun 11, 2025

Uh oh!

sarahmcmorgan Jun 16, 2025

Uh oh!

lucas-tuva left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

sarahmcmorgan commented May 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Describe your changes

How has this been tested?

Reviewer focus

Checklist before requesting a review

Package release checklist

(Optional) Gif of how this PR makes you feel

Loom link

Uh oh!

sarahmcmorgan commented Jun 2, 2025

Uh oh!

github-actions Bot commented Jun 5, 2025

Uh oh!

lucas-tuva left a comment

Choose a reason for hiding this comment

Uh oh!

lucas-tuva Jun 11, 2025

Choose a reason for hiding this comment

Uh oh!

sarahmcmorgan Jun 16, 2025

Choose a reason for hiding this comment

Uh oh!

lucas-tuva left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

sarahmcmorgan commented May 29, 2025 •

edited

Loading