[21pt] Create HydroVIS release package for HAND

[RobHanna-NOAA]

Updated Jan 9, 2025

• We are tracking other changes that the next HAND release will require changes in the HV side 1028.

Updated: Nov 26, 2024:

• Hold. HV is re-evaluating how to load data, when and what formats.
• We will likely just drop the branch level hydrotables and use the HUC level aggregated version. It does not appear they are using the HUC level hydrotables, but are confirming it. Either way, that hydrotable might be parquet, depending on what size and location. Parquet is not as useful when we have a small number of records (branch level hydrotables?)

---

Create a new tool that can be run only as needed for Production BED runs to be released to HydroVIS. The new tool needs to do the following:

• Accept an argument for which fim run folder to be used as source: ie) /data/previous_fim/HAND_4_5_11_1
• An argument for where to put the output files for HydroVIS. ie)/data/release/HAND_4_5_11_1 (yes.. I will start keeping separate folders for what I send to HV which I do not currently do.
• The folder structure continues to be the same as our current hand output folder. ie) /HAND_4_5_11_1/{huc number}/branches/{branch number}/xxxx.files.
• Copy over the gw_catchments_reaches_filtered_addedAttributes_{branch number}.tif into the branch folder.
• At each HUC level, there may / may not be a osm_bridge_centroids.gpkg file. Copy that into the huc level folder.
• An optional config file (details below), but defaults to one already embedded in our foss_fim/config folder.

We may have other files, so we need some sort of a config file that tells us: (and it doesn't need to be overly fancy)

• which branch files are copied into the branch parquet.
• which branch files file are simply copied over to the branch folder
• which files are copied over from the HUC level (ie. osm_bridge_centroids.gpkg is the only one at this time.

Need it sooner than later, but not urgent but by Jan 1 at the latest if reasonably possible. It allows time for us to do some dev and testing in HV.

In theory, if this works, we don't have to wait until the March release, to run this tool and re-hand over HAND_4_5_11_1 over to them. We believe it will have major gains in performance for them.