EPIC: FIM 6 - HydroVIS updates required with next HAND version

[RobHanna-NOAA]

In the next HAND version, some changes are being made that triggers fixes and adjustments to HydroVIS code:

1. Obviously, update the next HAND load code but also includes the new changes below
   • If we keep the bridge centroids, add the new HUC8 column that will be coming
   • Possibly adding a separate new service for Bridges, based on lidar, poly's and forecast for threats for bridges.
   • Review column usage / requirements from the HAND Catfim data load tables.

Bridge Centroid System will be dropped in favour of a new more extensive bridge service (864)[https://github.com//issues/864] (BITS, Bridge Inundation Threat Service). Clean up the load scripts, and dbs in IT, UAT, Prod to remove the old Bridge Centroid System.

2. Rating Curve / Hydrotable fix for NaN. In HV, we put a temp fix in for 2.1.8 (950), but when the new HAND comes out, it will be fixed so we no longer need this temp work around in HV code. FIM card 1339. One hydroID it was noticed on in HV is 24040003.

3. Review adjustments in HV code to compensate for large AK hucs and loading changes. See Issue 998 for when the temp fix was put in.

4. FIM is working with HV to sort out more efficient ways for more efficient loading of HAND data, especially during forecast loads. This includes:

   • possibly changing HAND hydrotables.csv to parquet
   • Reviewing columns in HAND hydrotables
   • Each HAND release already issues hydrotables for each branch, but also has a rollup for all of it's branches at the HUC level. Review HV code to see which is best (or both)
   • Some of these details and ideas have already been recorded in a FIM card 1349.

5. Reconcile CRS's between HAND data coming in HydroVIS code. ie). Most data coming in from HAND is in 5070 for Conus and 3338 (??) for AK. Should HAND issue it all in 3857 that HydroVIS uses? What about AK? Note: Some services may want different crs's for AK. But.. maybe we can get it reconciled so HV code does not need to reproject on the fly anymore. And there are some places this happens in HV code.

   • FIM has a twin card for this. 1334

6. Inundation engine changes for 2.2.0 ? TBD.

7. Catfim - Stage Based: Drop the viz column in the mapx. It will be removed from the catfim data incoming. TBD: Confirm with Derek if he wants the changes for Catfim SB and FB for usage of the "version" field. ie) change to hand_version (4.5.11.1) ?? versus code_version (catfim 2.2).

8. Catfim - Stage Based: New column coming in "is_interval". Also update to add new "stage_uncorrected" field and explain to Monica and others. Update mapx for both new fields PLUS can change the interval layer queries.

9. CatFIM - likely come with a new "notes" field in the libraries, possibly also the sites. See 1421.