Add IODA conversions to marine obs prep task ex-script

[AndrewEichmann-NOAA]

As a draft PR this is to allow some mid-development input.

• parm/soca/obsproc/obs_list_obsproc.yaml is added as the OBS_LIST for testing purposes
• parm/soca/obsproc/obsproc_config.yaml is added, containing the obs source-specific info in the yamls in utils/test/testinput/ and the dictionary of observation source filename regexp patterns in ush/soca/prep_marine_obs.py - the yaml here is loaded to fetch the observation files and dynamically generate the yaml to feed to the IODA converter. I would be curious if the hierarchy or terminology breaks any established JEDI conventions.
• scripts/exglobal_prep_ocean_obs.py now fetches the observation files to the RUNDIR, creates the IODA converter yaml with the input set to the filenames now returned by prep_marine_obs.obs_fetch, and runs the IODA converters.
• some variable names have been changed to camelCase

Also: this would require some rearranging of test data - right now I'm testing against the full files we used for IODA converters, but for the ctests I presume there would have to be some arrangement like with the IODA converter ctests, making NetCDF files out of text files.

Lemme know what you think.

[guillaumevernieres]

Thanks @AndrewEichmann-NOAA . Looks good, see comments.

[ShastriPaturi]

please see comment below.

[ShastriPaturi]

I need to run it once with actual data to be sure that I follow.
Approving nonetheless.

[apchoiCMD]

Looks good

[guillaumevernieres]

Let's brain storm about the test data tomorrow @AndrewEichmann-NOAA .

[guillaumevernieres]

Thanks @AndrewEichmann-NOAA . Looks good, just a few minor cosmetic comments. Also, sort out your coding norm too.

[emcbot]

Automated Global-Workflow GDASApp Testing Results:
Machine: hera

Start: Wed Nov 29 21:02:03 UTC 2023 on hfe07
---------------------------------------------------
Build:                                 *SUCCESS*
Build: Completed at Wed Nov 29 21:47:36 UTC 2023
---------------------------------------------------
Tests:                                  *Failed*
Tests: Failed at Wed Nov 29 22:08:52 UTC 2023
Tests: 96% tests passed, 2 tests failed out of 54
Tests: see output at /scratch1/NCEPDEV/da/Cory.R.Martin/CI/GDASApp/workflow/PR/719/global-workflow/sorc/gdas.cd/build/log.ctest

[guillaumevernieres]

Looks like a reference mismatch @apchoiCMD :

The following tests FAILED:
        1314 - test_gdasapp_util_smap2ioda (Subprocess aborted)
        1316 - test_gdasapp_util_icecamsr2ioda (Subprocess aborted)
Errors while running CTest

[apchoiCMD]

Looks like a reference mismatch @apchoiCMD :

The following tests FAILED:
        1314 - test_gdasapp_util_smap2ioda (Subprocess aborted)
        1316 - test_gdasapp_util_icecamsr2ioda (Subprocess aborted)
Errors while running CTest

@guillaumevernieres I am fixing them now!

[apchoiCMD]

Looks like a reference mismatch @apchoiCMD :

The following tests FAILED:
        1314 - test_gdasapp_util_smap2ioda (Subprocess aborted)
        1316 - test_gdasapp_util_icecamsr2ioda (Subprocess aborted)
Errors while running CTest

@guillaumevernieres ctest passes on orion but not on hera, found out what is problem but we need to discuss it tomorrow.

[guillaumevernieres]

We'll fix the broken test in a different PR.