Add SVI to Load from S3

[aneiderhiser]

Add 2020 SVI to load via S3 like other terminology. You can download here: https://thetuvaproject.com/terminology/social-vulnerability-index

Add 2022 as well. You can download here: https://github.com/ngladish/SEPI/tree/main/SVI/2022

These are pretty large files so prob make sense to disable by default.

[apancoast]

I'm interested in creating a PR for this. Looking through the repo now to see if I have what it takes.

[apancoast]

These are the required steps I'm observing. Please let me know if I'm missing anything.

1. Download 2022 SVI via provided Github
2. Import to a data warehouse to assure accuracy and cleanliness, documenting for Maintenance Instructions in docs
3. Copy to Tuva's S3
4. Update Terminology Overview md with date and include S3 download link
5. Update social-vulnerability-index.md to reflect changes
   1. Add Maintenance Instructions
   2. Possibly find alternatives to broken CDC links

[aneiderhiser]

@apancoast yep I think that's right. We'll have to help with step #3 (we only make the bucket open for read access).

[apancoast]

Awesome! I'll hop on it this weekend and reach out when it's S3 ready

[apancoast]

Ok, I have four CSVs, county and tracts for 2020 and the same for 2022, ready for import and copy to Tuva's S3.

Transformation applied were:

1. "-999.0" and "-999" to nulls
2. Based off of this SVI Tuva example, all columns should import as varchar.
3. Based off SQL Style Guide, all column names to lowercase.

I put them in my own S3 if someone with would like to copy them from there, or let me know another way!
https://tuva-svi.s3.us-east-2.amazonaws.com/2020/svi_2020_county_202502171559.csv
https://tuva-svi.s3.us-east-2.amazonaws.com/2020/svi_2020_us_202502171603.csv
https://tuva-svi.s3.us-east-2.amazonaws.com/2022/svi_2022_county_202502171610.csv
https://tuva-svi.s3.us-east-2.amazonaws.com/2022/svi_2022_us_202502171610.csv

Once there's legit S3 links, I'll update docs :)

[apancoast]

Hey @aneiderhiser, I made a PR which has some placeholders for Tuva's S3 links. Let me know if there's anything else I need to do.

[aneiderhiser]

Thanks for the bump on this @apancoast -- we'll work to get it reviewed / merged. cc: @cocozuloaga @jansenpa

[apancoast]

I had to remove the files from my personal S3. Let me know if you'd like me to share another way!

[jansenpa]

@apancoast I think we can try to upload the files to our Dev S3 bucket. @kristinashikhrakarmaitri and her team can help us with this. We will discuss today and reach back out to coordinate. Thanks!