Coderx weekly data#934
Conversation
This comment was marked as outdated.
This comment was marked as outdated.
|
@utsavpaudel I'm getting an error with this data when trying to sync it to Azure. I think the ndc file is not being quoted. You may want to check the other files as well.
|
|
@sarah-tuva yes, the data were not quoted and hence the errors. I have updated the files in our bucket that reflects the changes. |
8fd8a12 to
9b7c225
Compare
|
@utsavpaudel I'm not sure what happened to your PR. I just hit rebase and it closed it. Can you try to reopen? That option is grayed out for me. I am syncing the seeds now and can re-run the CI tests when this is reopend. |
|
Workflow has finished with the following statuses:
|
|
Ignoring Redshift failure in CI testing. This error is being caused by a bug introduced in another PR. |
feat: new coderx terminology data
* update data type for death_flag * Fix column typings in medical claim seed (tuva-health#767) * update medical claim data type * add typing for rendering tin * type for billing tin * unnecessary change * Patch 0.14.7 Release (tuva-health#768) * update package version and seed paths * update dbt docs * Added check for readmissions enabled for mart review * Patch release v0.14.8 (tuva-health#779) updated docs and dbt_project.yml for patch release * update it readme, varname * Updated contributing instructions for running and linting * swapping coalesce for case * Move member_month_key calculation to norm_input_elig. Adjust claims_e… (tuva-health#784) * Move member_month_key calculation to norm_input_elig. Adjust claims_enrollment off core models. Optimize core mem_months. * linting * linting --------- Co-authored-by: tom-tuva <159959263+tom-tuva@users.noreply.github.com> * Provider terminology fields addition (tuva-health#789) * feat: added three fields in provider terminology * feat: update seed path to 0.15.0 * fix: revert 0.15.0 to 0.14.9 * 0.14.9 release (tuva-health#790) * Updated error message to be more informative * Ci updates compile (tuva-health#823) * updated different jobs in CI/CD to compile dbt to save processing time * updated different jobs in CI/CD to compile dbt to save processing time * update encounter_type seed to include new column * updating length of discharge disposition description column * updating length of discharge disposition description column * update poa length * update ci to include seed with compile. needed when there is a terminology change. * fixed/changed outside contributor dbt commands * Terminology Update: revenue_center (tuva-health#822) feat: revenue center terminology seed update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Fix redshift actions to compile instead of build (tuva-health#824) fix redshift actions to compile instead of build * Terminology Update: place_of_service (tuva-health#820) feat: place of service terminology seed update * Terminology Update: 'Encounter type' (tuva-health#804) feat: new column added on 'encounter_type' terminology Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Release patch 0.14.11 (tuva-health#827) * update package version and seed paths * update dbt docs * fix * Fix join clause in `data_quality__encounters_cost_and_utilization` (tuva-health#852) fix join alias * Provider attribution should have patient_id column when disabled https://thetuvaproject.slack.com/archives/C03DET9ETK3/p1746831452558529 * Update Icd10 column descriptions (tuva-health#853) Edit of icd-10-cm header_flag column description in terminology seed file * Terminology Update: NDC, RXNORM_TO_ATC, RXNORM_BRAND_GENERIC, Valueset: RXNORM_GENERIC_AVAILABLE (tuva-health#859) feat: new data from 5/21/25 * Terminology Update: Provider and Other Provider Taxonomy - May 2025 (tuva-health#860) feat: new data from May 2025 * Terminology Update: APR-DRG, MS-DRG, ICD10CM, ICD10PCS, HCPCS Level 2 (tuva-health#861) feat: new terminologies update * Allow claims preprocessing to handle multiple data sources in a connector (tuva-health#803) * Add data_source to table joins and unique checks in service category models * update test * Regex for icd-10-cd modes now includes special code sets (tuva-health#865) * Revert "Fix redshift actions to compile instead of build (tuva-health#824)" (tuva-health#870) This reverts commit a285c9f. * Add tuva invocations (tuva-health#843) * Add tuva_invocations. Organize macros. * Clean up * Fix schema generation. Revert some config changes. * Fixed for multi-platform support and custom_tuva_prefix. * Make adjustments for Fabric and BigQuery * Fix create table bug * Adjusted for bigquery * Fixed dropping old tuva invocations for bigquery * Add tuva_invocations. Organize macros. * Clean up * Fix schema generation. Revert some config changes. * Fixed for multi-platform support and custom_tuva_prefix. * Make adjustments for Fabric and BigQuery * Fix create table bug * Adjusted for bigquery * Fixed dropping old tuva invocations for bigquery * Merge tuva_invocation code to single macro file. Add metadata retention var. * Address PR comments * Correct package version for elementary fork * Updating multiple values tests to have a floor of 0 as not null tests should check for nulls (tuva-health#872) * remove distinct from encounter stage as it is redundant * additional unnecessary distinct * linter * Release Patch 0.14.12 (tuva-health#875) * update package version and seed paths * update dbt docs * Add fhir_preprocessing data mart (tuva-health#863) * add fhir_preprocessing mart * Add amount to adjudication status * Add logic to fix duplicate issues * add data source to models * add data source to models and filter claims from clinical resources * add data source to models * add data source to models and hash coverage id * add data source to models * rename add prefix to intermediate aliases * rename fields * fix required fields * add hash for observation ids * add benefit type to coverage * add coverage type list * fix aliases * add macro to create_json_objects * add data types * add bigquery logic to create_json_object macro * fix data types and length function * add redshift logic to create_json_object macro * update bigquery logic * add syntax support for fabric * add quote macro for plan * add length macro for adapter support * add fabric logic to create_json_object macro * update data type for fabric logic * fix column name for patient resource * clarify mapping comments for coverage type * add variable for fhir_preprocessing_enabled * update config for enabled logic * add missing models to yml * clean up fabric logic for placeholder tables * add fhir_preprocessing_enabled variable to integration_tests * move macros to new folder * add tuva package version to final tables * add documentation to yml * add package name to tuva macros * add package name to tuva macros * add enrollment_end_date to coverage window logic in eob models * fix macro name * add fhir_preprocessing var to docs_generate and update dbt docs for knowledge base * Update dbt docs (tuva-health#882) * update dbt docs * update dbt docs * fix: "header_flag" field in terminology__icd_10_cm renamed to "billable_code_flag" * Revert "Merge pull request tuva-health#883 from BijayaShres/icd_10_cm_field_rena… (tuva-health#886) Revert "Merge pull request tuva-health#883 from BijayaShres/icd_10_cm_field_renaming" This reverts commit cb5cfb5, reversing changes made to 3215af9. * Add duckdb support to create_json_object macro (tuva-health#890) add macro for duckdb * update regex * Fix enrollment being exploded to row per member-month. Adjust testing on PK. (tuva-health#885) * Fix enrollment being exploded to row per member-month. Adjusted unique value check on enrollment and member_month. * Linting * Revert testing changes * Added member_months to models.yml * Add stg core member months to models yml * Release patch v0.14.13 (tuva-health#894) * update package version and seed paths * update dbt docs * Update description to match the databases we support * service category and encounter enhancement added long-term acute care encounter and service categories refined inpatient service category logic and integrated lower-priority institutional claims into grouping logic applied DBT union_relations macro and custom macro fixes to resolve datetime and Fabric syntax issues * split sql files to reduce memory load * Split SQL files to reduce memory load (tuva-health#909) split sql files to reduce memory load * Updating another file with dense rank * Update elementary version (tuva-health#908) * Fix uniqueness check on input_layer__eligibility to include member_id (tuva-health#905) * fix 3 additional broken slack links (tuva-health#902) * Make sure we only get ICD-10-PCS codes in CCSR long procedure category (tuva-health#897) * Bill type code multiple not sev 1 (tuva-health#922) * HCPCS/CPT value set update for CMS HCC data mart (tuva-health#906) feat: cpt data for 2025 [CMS_HCC valueset] * Update github workflows: add testing for new data mart, add release workflow, remove old workflow (tuva-health#878) * update workflow to assign owners to new issues added to project board * add new data mart var to CI workflows * update token * update token comments * add release workflow * fix secret name * remove old workflow * add new workflow * remove assign issues workflow * update branch trigger * Patch release v0.14.14 (tuva-health#924) * update package version and seed paths * update dbt docs * Fixing MDC value bug (tuva-health#931) * Change line level claim date to header level (tuva-health#928) * 932 if encounters between claims and clinical datasets overlap ie adt both encounter get thrown out in readmissions (tuva-health#933) * Make updates to readmissions log to pick one out of the bunch of overlapping instances. Choose the medical claim over the encounter. Prefer longer duration * Rename columns to match * Pulling through encounter source type * adding column name * Encounter type is not needed * Adding distinct to fix logic on mapping * database compatibility * Add enhancements for CI Testing data (tuva-health#929) * update seed and model config * update dbt_project.yml to use synthetic data by default * fix redshift config to match vCPU in cluster * move fabric host to github secrets * update github workflows to use synthetic data seeds * update env vars for redshift profile * remove outdated env vars for redshift and clean up formatting * update github workflows to use synthetic data seeds * Provider Terminology data update - June (tuva-health#939) feat: provider terminology data - june Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Revert "Change line level claim date to header level" (tuva-health#942) Revert "Change line level claim date to header level (tuva-health#928)" This reverts commit 7c5631c. * Patch 0.14.15 (tuva-health#940) * update package version and seed version paths * update dbt docs * update dbt docs * Coderx weekly data (tuva-health#934) feat: new coderx terminology data * Adding risk adjusted benchmark mart (tuva-health#938) Adding mart used for training models and bringing predictions back into the tuva project * Fix redshift CI tests (tuva-health#949) * change redshift ci workflows to be consistent with other jobs * change redshift test back to build * Change where exists to join criteria (tuva-health#950) Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Add action to automate updating and publishing dbt docs (tuva-health#945) * Add workflow for deploying dbt docs on main push * Fix PMPM Prep pk (tuva-health#952) add payer to pk * Adjust metadata schema to account for target schema config. (tuva-health#955) Adjust metadata schema to account for target schema config. Remove invocation log message for deletion. * Quick CI update for redshift (tuva-health#956) increase dbt threads for redshift * Updated descriptions for Input Layer Data Dictionary * New terminologies data (tuva-health#944) feat: new terminologies data Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Patch release v0.14.16 (tuva-health#958) * update package version and seed paths * remove old release steps from pull request template * Remove old docs folder (tuva-health#959) remove old docs folder * Load SVI Seed Data from S3 (tuva-health#935) * feat: reference data SVI seed file added * fix: Consolidate 2020 and 2022 SVI Data into Single Table --------- Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Update LOINC terminology (tuva-health#961) update seed path * Fix apr_drg terminology (tuva-health#962) fix: apr_drg 3 digits with padded 0 Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Benchmarking fix * remove actual location from discharge prediction * adding lower to adjust for capitalization differences between warehouses * updating placeholders * Release patch 0.14.17 (tuva-health#964) bump package version and seed paths * DRAFT: added try cast to prevent conversion errors (tuva-health#968) * added try cast to prevent conversion errors. * edited syntax to safe_cast for BQ * Inpatient merge logic (tuva-health#965) * adding case for same day start merge * updating other inpatient encounter types * Removing trailing whitespaces for linter --------- Co-authored-by: Tom Sherwood <tom@tuvahealth.com> * Fixing data type inconsistency * Fix duckdb seed loads to include the first row. (tuva-health#979) * Add HTML data quality dashboard (tuva-health#977) * Add data quality dashboard. * Update ui/data_quality_dashboard.html Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * Fixing typo * Update GitHub action: adding release branches to internal workflow (tuva-health#980) * add release branches to internal workflow * rename create release workflow * Fixup internal workflow triggers (tuva-health#986) * fix workflow * fix workflow * Fixup internal workflow triggers - add branches back (tuva-health#988) fix workflow * 970 | Creating de-duplication logic for patients in both claims and clinical (tuva-health#971) * 970 | Creating de-duplication logic for patients in both claims and clinical Made decision to choose claims over clinical for datasets. Patient table has an expectation of PK on the person_id column. * Specify only wanting columns from clinical patient * Update accepted values on procedure code type (tuva-health#997) update accepted values on procedure code type * Add testing to check for overlap between medical claim / pharmacy claim and eligibility (tuva-health#943) * first pass at overlap checks * update checks * linting * gitkeep * refactor testing, update severity level * lint * database compatibility * swap coalesce for case when * fix join * Add missing provider fields to dbt docs (tuva-health#999) add missing fields * Add missing input layer fields (tuva-health#1005) update yml * Update pull_request_template.md * Update github workflows: add better concurrency and remove push trigger (tuva-health#1003) * remove push trigger * add logic to concurrency group * fix concurrency logic * Provider update for July 2025 (tuva-health#1011) update seed path version * Patch release v0.14.18 (tuva-health#1012) update package version and seed paths * Update HCPCS code test, add threshold for PMPM (tuva-health#1008) * update hcpcs code test, add threshold for PMPM * update test and severity level * update test config * fabric * Point terminology meta configs to docs instead of GitHub (tuva-health#1014) * fix links * trim whitespace * Fixes inconsistent datatype for integration tests pharmacy_claim_seed (tuva-health#1025) Fixes inconsistent datatype for integration tests pharmacy_claim_seed columns. * Removes date/datetime as options for "amount" field data types. (tuva-health#1027) * Add file date to core claims input layer (tuva-health#1019) * Add claim type distribution check (tuva-health#1028) * add test * case when * Updating claim types + adding test to check for claim type (tuva-health#994) * Setting severity level to warn hcpcs_code input test (tuva-health#1033) * Add fabric support new DQI & Move testing from older dqi into newer dqi (tuva-health#966) * Adding plan overlap test (tuva-health#1006) * [Breaking Change] Minor release v0.15 (tuva-health#1000) ### Major Features: - Appointment data - Immunization/vaccine tracking (CVX codes) - Lab Order/Component mapping - Enhanced patient demographics - Improved data quality framework (especially for Fabric) - State normalization improvements ### Important Clarifications: - **Fabric**: Already supported, but now has comprehensive data quality tests enabled - **Bug fixes**: Missing codes now properly flow to core tables ### Migration Steps: 1. Update packages.yml to version `0.15.0` (or add a range `version: [">=0.15.0","<0.16.0"]`) 2. Run `dbt clean` then `dbt deps` 3. If using `clinical_enabled: true`: i. Create new input models `appointment` and `immunization` and map your data or create empty tables ii. Update existing models `lab_result` and `patient` 4. If using `claims_enabled: true`, update existing model `eligibility` 5. Run `dbt build --full-refresh` 6. Review `data_quality__testing_summary` table 7. Fix/disable tests as needed 8. Verify downstream dependencies ### Pull requests included: Bug fixes: * tuva-health#990 * tuva-health#1035 Data model changes * tuva-health#973, tuva-health#1034 * tuva-health#981 * tuva-health#1030 * tuva-health#1032 Enhancements * tuva-health#975 * tuva-health#1018 * tuva-health#1036 * tuva-health#1031 Terminology updates * tuva-health#895 * tuva-health#896 --------- Co-authored-by: Bijaya <bijaya.shrestha@maitriservices.com> Co-authored-by: bradmontierth <72261515+bradmontierth@users.noreply.github.com> Co-authored-by: Andreas Martinson <32916663+amartinson193@users.noreply.github.com> Co-authored-by: krishyfishy <53307963+krishyfishy@users.noreply.github.com> Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> Co-authored-by: David Shimamoto <david@tuvahealth.com> Co-authored-by: Utsav Paudel <utsavpaudel111@gmail.com> Co-authored-by: NabinHyanmikha-Maitri <nabin.hyanmikha@maitriservices.com> * Update seed paths v0.15 & fix doc-generate workflow (tuva-health#1038) * update seed paths * fix dbt version * fix dbt build in docs workflow * fix path for immuniation ci_testing seed * [Bug] Add missing eligibility fields for docs (tuva-health#1039) * add missing eligibility fields * add missing eligibility fields * fix: renamed the seed column names (tuva-health#1048) * Removing tests and duplicate file_date definitions (tuva-health#1052) * Prospective benchmarks (tuva-health#1049) * adding prospective benchmark tables as inputs from models * bringing in output of models as sources into tuva project and transforming to member month grain * Provider Terminology data update - September (tuva-health#1054) feat: provider terminology data update - Sept * Patch v0.15.1 (tuva-health#1059) update package version and seed paths * Removing diagnosis_code_voting (tuva-health#1055) removing normalized_input__int_diagnosis_code_normalize.sql and normalized_input__int_diagnosis_code_voting.sql Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Adding coalesce to benchmark chronic condition features (tuva-health#1062) adding colaesce to features now that that they're brought in with a left join * Providing correct variable on column type list wrapper (tuva-health#1072) * Data type should be sev 2 error level (tuva-health#1070) * [Feature] add optional source input for quality measures mart (tuva-health#1060) * add new doc blocks * add new optional mart input * add new optional mart variable * add tags and update col names for cql engine log * fix hedis seed * add optional hedis input to ci_testing * add fhir_preprocessing var to ci_testing * add hedis input staging models to quality measures mart * add new cross-database macro to extract text from string * move hedis to sub-datamart * fix load_seed to handle quoted empty strings * add hedis models * update input models * update input models * update input models * update input models * update quality measure seed * fix load_seed macro * add measure_id and clean measure names * add columns to docs * add snapshots * remove unused macro * fix snapshot keys and input_layer docs * fix sources in testing folders * Bug/undocumented fields in encounter table (tuva-health#1050) * fix: missing field of encounter model documented * Apply suggestion from @chase-jones --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * Coderx weekly data (tuva-health#1078) feat: CodeRx Weekly Data Update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Databricks VARCHAR Data Type issue fix (tuva-health#1061) * fix: databricks issue fix * fix: unwanted line erased --------- Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * updating ccs to latest year and updating joins to use year to join to… (tuva-health#1069) * updating ccs to latest year and updating joins to use year to join to correct version * linting * Terminology/update HCPCS_Level_II terminology (tuva-health#1074) feat: HCPCS_Level_II terminology update for September Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Patch v0.15.2 (tuva-health#1079) update package version * update input_layer__medical_claim.yml unique value count test so null… (tuva-health#1081) * Removal of icd10_pcs_cms_ontology duplicate header row (tuva-health#1085) duplicate header issue fixed * FIPS code missing for District of Columbia (tuva-health#1084) ANSI FIPS Terminology update Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Terminology/update icd 10 cm terminology set (tuva-health#1092) feat: ICD_10_CM terminology updated * Terminology/update icd 10 pcs terminology set (tuva-health#1093) feat: ICD_10_PCS terminology updated Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> * Bug/person id crosswalk missing tuva last run (tuva-health#1090) tuva_last_run column added in core__patient_id_crosswalk table * Update medical and pharmacy claim allowed amount checks (tuva-health#1083) update medical and pharmacy claim allowed amount checks * MDC and MS_DRG terminology data update (tuva-health#1094) feat: mdc and ms-drg terminology data update * Added new terminology and value sets * Coderx weekly data update (tuva-health#1095) feat: Coderx weekly data update * Adding new terminology files * Remove unsupported data type (databricks) (tuva-health#1100) remove unsupported data type * fix: deduplicate source tables before joins in adhras_long (tuva-health#1087) * fix: deduplicate source tables before joins in adhras_long Prevents Cartesian explosion by deduplicating denominator, numerator, and exclusions tables before joining. Reduces runtime from 1+ hours to minutes on datasets with multiple pharmacy claims per person. * linting * Patch v0.15.3 (tuva-health#1102) update package version and seed paths * Updating terminology to support other dbs * Fixing CSV whitespace * Added descriptions * Removing hcpcs file * Adding back CSV * Fixing schemas * Performance improvements for `claims_preprocessing.member_months` (tuva-health#1088) * first pass at performance improvement * PR feedback * feat(provider_attribution): add generic provider attribution mart (yearly/current) and provider ranking using input_layer and terminology seeds\n\n- Yearly and current (rolling 12) assignment by plurality of allowed charges\n- Provider bucket via taxonomy→Medicare specialty→PCP/Specialist/NPP\n- Primary care HCPCS filter\n- Ranking table with full provider candidates and joinable attribution_key\n- Hard-coded fallback to paid_amount when allowed_amount is null or zero\n\nModels:\n- intermediate: int_person_years, provider_classification, int_primary_care_claims, int_yearly_steps, int_current_steps\n- final: assigned_beneficiaries_yearly, assigned_beneficiaries_current, provider_ranking\n- yml: generic_provider_attribution_models.yml * updating yml * reserved keyword * syntax error * column name standardization * syntax fix * adding in row for all members to output table * Only run tuva hooks when tuva nodes selected (tuva-health#1108) * Add granular control over on-run-start and on-run-end hooks via dbt variables * adding stage, calendar joins for date builds, input var * rename and organize * chang wording on not assigned * linting * fixing linting version mismatch differences * yml ordering, model renaming, removing expanded var * fix claims mart gating and bq error * fixing clinical gating * fixing var for this mart * adding last run var * adding fallback steps, fixing bad terminology join * fixing bad term join * matching logic across current vs historical * fix null providers * adding step descriptions * fixing multiple assignement steps * bad terminology values * limiting steps to individuals * fixing yearly bug * rebuild ranking to show all providers * fix missing cte * fixing recon between current and yearly * linting * union distinct fabric fix * moving refs to use core instead of input layer * linting * Update terminology Add provider_taxonomy_unpivot + update to 0.15.4 (tuva-health#1115) * Add missing CSV * Adding terminology seeds * Adding descriptions * Create new semantic layer datamart (tuva-health#1103) * Update regex in revenue center code test (tuva-health#1119) * Revert "Performance improvements for `claims_preprocessing.member_mon… (tuva-health#1123) Revert "Performance improvements for `claims_preprocessing.member_months` (tuva-health#1088)" This reverts commit ccf6a06. * 0.15.4 release patch (tuva-health#1124) * Redshift Serverless ci testing (tuva-health#1125) * Update CI to use Redshift Serverless (tuva-health#1130) * Check disable dbt invocation elementary variable (tuva-health#1132) * 829 officially support databricks (tuva-health#1141) * 1126 official support of duckdb (tuva-health#1142) * Add file name to core.medical_claim, core.pharmacy_claim, core.eligibility (tuva-health#1144) * add file name to core med pharm elig * qualify * lint * AWS Athena Compatibility Updates (tuva-health#1146) * updates to outside contributor CI (tuva-health#1148) * Redshift Error Fix | Change dbt-data-reliability revision to v0.18.4 (tuva-health#1155) Updated the revision of dbt-data-reliability package. * Release 0.15.5 * Updates to Input Layer and Core YML Files and CI Updates(tuva-health#1149) * Add payer column to cms hcc (tuva-health#1121) * Added payer to staging layer for cms_hcc * Adding payer to intermediate models * Add payer to final models * Adding payer to HCC suspecting * Fixing core models typo * Add new model grouping by factor type * Adding missing curly braces * Updating pk check * Add hcc_suspecting__list_all * Fixing typo * Fixing primary key * Updating pk * Fixing pk * Updating pk * Adding distinct to condition * Adding claim ID to eligible conditions * Updating elig conditions w/claim_line_num * fixing bug * fixing bug * updating pk * Fixing payer in patient table * Fixing payer in patient table * Adding distinct to fix pk * Removing plan * Fixing typos * fixing typo * Adding missing payer * Adding missing payer * Fixing factor type * fixing enrollment interaction factors * Adding factor type to yml * fixing sqlfluff errors * Updating condition to support claim ID * Updating stg_core__conditions * Adding distinct * fixing hcc suspecting payer + adding model version to int all cond * Adding v24 to hcc suspecting * removing payer from clinical tables * Fixes bugs for CI/CD * Removing payer from patient * Fixing age calc * reverting age change * Fixing sqlfluff linting * Fixing trailing whitespace * removing payer from patient * Fix enrollment status * fixing boolean issue for fabric * fixing redshift * fixing redshift * fixing casting inconsistency * Fixing payer * Fixing bug * Fixing bug * fixing joins * Adding documentation * Adding documentation + updating aggregation from sum to max * fixing institutional status * Adding documentation * Adding missing V24 seed mapping * Adding documentation * Adding fixes * fixing syntax error * restore test * fixing tests * fixing sql fluff * fixing whitespace * fixing enrollment status --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> * 1165 redshift error failed to find conversion function from unknown to character varying (tuva-health#1166) * Coderabbit config for open source (tuva-health#1167) * Performance improvements for claims_enrollment__member_months (tuva-health#1163) add first pass at improvements Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> * CMS-HCC Mart Accuracy Improvement (tuva-health#1173) * removed claims_expanded and renamed provider_attribution (tuva-health#1176) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Add data_source to key tables of interest (tuva-health#1157) * Update test criteria for warn_if_null_percentage_above_zero (tuva-health#1178) * Pull through patient ID on core__medication (tuva-health#1182) pull through patient id * added hedis measures output mart (tuva-health#1180) * added hedis measures output mart * updates for hedis measures and release prep * retrigger ci --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Refactor encounters__combined_claim_line_crosswalk (tuva-health#1169) * break out institutional claims, do not repeat join * add model config * update yml, final select, etc --------- Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Update project to require dbt version >=1.10.0 (tuva-health#1183) * fix deprecations * autofix integration_tests * update require dbt version * fix vars * coderabbit feedback * fixes * fix alignment --------- Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Minor fixes (tuva-health#1188) * minor updates to date fields on claims tables * moved pr template --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Duckdb semantic layer (tuva-health#1171) * Updated Tuva Package Version Number to 0.16.0 (tuva-health#1189) updated tuva version number Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Create the HCC Recapture Mart (tuva-health#1190) * Add HCC recapture mart * Adding configs * Update naming * Updating chronic conditions + fixing linting issues * fixing linting errors * linting fixes * fixing linting issues * fixing linting * fixing linting * Updating code to fix CI/CD errors * Moving flattened hierarchy to dbt_project as a value set * removing hierarchy * Adding cms_hcc_seed info * Adding file for seed * Fixing mispelling in seed * Updating dbt_project.yml * fixing datatype * Updating comment * updated hcc_recapture to work w/ fabric * fixed linting issue * fixed linting issue * fixed linting issue --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated version number to 0.16.1 (tuva-health#1192) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated ci for snowflake (tuva-health#1193) * updated ci for snowflake * updated ci vars * added profiles * updated all other ci workflows & profiles * updated working directories * fixed ci workflow errors * updates for cross-database issues in semantic layer * updates for semantic layer to work on DWs * removed old ci related stuff * removed unused doc blocks and helper scripts * restored dbt doc blocks folder for now --------- Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Update conditions to capture previously missing diagnosis (tuva-health#1175) * updating conditions to include all diagnosis since some were excluded * Adding a missing filter * Adding split part * Adding missing underscore * Adding more documentation * linting fixes * fixing ambigious join error * update fabric * fixing bug with reversed conditions * Adding customization for fabric * Updating split_part carveout for fabric * small doc update --------- Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * BUG FIX: numeric min for hierarchy top-level (tuva-health#1194) fix(cms_hcc): numeric min for hierarchy top-level Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> * Fixed Redshift / Snowflake Discrepancy (tuva-health#1197) fixed issue where adh quality measures were getting different results on redshift/snowflake due to LEAST() function Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * updated version for release (tuva-health#1198) Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local> * Fix observation staging for claims-only logic (tuva-health#1199) fix observation staging for claims-only --------- Co-authored-by: Krish Maypole <krish@tuvahealth.com> Co-authored-by: krishyfishy <53307963+krishyfishy@users.noreply.github.com> Co-authored-by: Sarah Morgan <sarah@tuvahealth.com> Co-authored-by: David Shimamoto <david.shimamoto@gmail.com> Co-authored-by: thutuva <101137626+thutuva@users.noreply.github.com> Co-authored-by: bradmontierth <72261515+bradmontierth@users.noreply.github.com> Co-authored-by: tom-tuva <159959263+tom-tuva@users.noreply.github.com> Co-authored-by: Utsav Paudel <utsavpaudel111@gmail.com> Co-authored-by: Chase Jones <60072797+chase-jones@users.noreply.github.com> Co-authored-by: Bijaya <bijaya.shrestha@maitriservices.com> Co-authored-by: David Shimamoto <david@tuvahealth.com> Co-authored-by: sah129 <55058535+sah129@users.noreply.github.com> Co-authored-by: jansenpa <jansenpa@gmail.com> Co-authored-by: Lucas Leblow <lucas@tuvahealth.com> Co-authored-by: Andreas Martinson <andreas@tuvahealth.com> Co-authored-by: Andreas Martinson <32916663+amartinson193@users.noreply.github.com> Co-authored-by: Ivy Hjornevik <ivyhjornevik@mac.mynetworksettings.com> Co-authored-by: ivy-tuva <ivy.hjornevik@tuvahealth.com> Co-authored-by: Tom Sherwood <tom@tuvahealth.com> Co-authored-by: Gabe Cano <70255816+gabecano4308@users.noreply.github.com> Co-authored-by: NabinHyanmikha-Maitri <nabin.hyanmikha@maitriservices.com> Co-authored-by: Aaron Stern <aaron.stern@tuvahealth.com> Co-authored-by: bradmontierth <bradmontierth@gmail.com> Co-authored-by: Seamus McKinsey <seamus-mckinsey@users.noreply.github.com> Co-authored-by: mkrahu-tuva <mike.krahulec@tuvahealth.com> Co-authored-by: Aaron Neiderhiser <anneiderhiser@gmail.com> Co-authored-by: andreas-homeward <andreas.martinson@homewardhealth.com> Co-authored-by: Aaron Neiderhiser <aaronneiderhiser@Aarons-MacBook-Air.local>
Describe your changes
CodeRx maintained terminologies data.
Following S3 path will be updated every Wednesday/Thursday with latest data.
tuva-public-resources-snowflakeHow has this been tested?
Ran
dbt build -s tag:coderx_terminology --full-refreshinterminology_preprepo that has tests configured.Reviewer focus
Please sync these files ndc, rxnorm_to_atc, rxnorm_brand_generic, rxnorm_generic_available from
tuva-public-resources-snowflakeS3 into prod bucket before release date, kickoff CI and merge.Kindly do not sync data/merge this PR a lot before next release, as new data might be missed in the upcoming release.
Checklist before requesting a review
tuva_last_runto the final outputPackage release checklist
dbt_project.yml(Optional) Gif of how this PR makes you feel
Loom link