v4.9.3-rc1

[WardF]

The NSF Unidata netCDF team is happy to announce the first release candidate for netCDF-C v4.9.3. This release will include a lot of quality of life improvements and bug fixes, as well as improved support for ncZarr. We expect to release a second release candidate, with a focus on improved documentation, and a quick-start guide for our Zarr support with S3 and other cloud-based object stores.

The second release candidate will be out shortly; the final, full release will occur as quickly as possible, but that will depend on issues which arise through testing of this release candidate. The more broadly it is tested, the quicker we'll be able to get the full release out. Thanks all for your patience and your help!

What's Changed

• "Simplify" XGetopt usage by @DennisHeimbigner in "Simplify" XGetopt usage #2678
• Fix bug in szip handling. by @DennisHeimbigner in Fix bug in szip handling. #2679
• Add documentation for logging by @edwardhartnett in Add documentation for logging #2677
• Combine DAP4 test server fixes, resolve a couple conflicts. by @WardF in Combine DAP4 test server fixes, resolve a couple conflicts.  #2681
• Cleanup DAP4 testing by @DennisHeimbigner in Cleanup DAP4 testing #2555
• Fix DAP4 remotetest server by @DennisHeimbigner in Fix DAP4 remotetest server #2558
• Fix issue Bug in hdf5open.c::get_quantize_info() #2674 by @uweschulzweida in Fix issue #2674 #2675
• Check at nc_open if file appears to be in NCZarr/Zarr format. by @DennisHeimbigner in Check at nc_open if file appears to be in NCZarr/Zarr format. #2658
• Fix a syntax issue in CMakeLists.txt by @WardF in Fix a syntax issue in CMakeLists.txt #2693
• hdf5open: check for the H5L info structure version directly by @mathstuf in hdf5open: check for the H5L info structure version directly #2695
• Improve S3 documentation, testing and support by @DennisHeimbigner in Improve S3 documentation, testing and support #2686
• Fix potential dead store by @ZhipengXue97 in Fix potential dead store #2644
• CI: Test --without-plugin-dir on Cygwin by @DWesl in CI: Test --without-plugin-dir on Cygwin #2659
• Fix handling of CURLOPT_CAINFO and CURLOPT_CAPATH by @DennisHeimbigner in Fix handling of CURLOPT_CAINFO and CURLOPT_CAPATH #2690
• Adding a workaround for older versions of cmake by @WardF in Adding a workaround for older versions of cmake #2703
• Remove obsolete code by @DennisHeimbigner in Remove obsolete code #2680
• Improve performance of the nc_reclaim_data and nc_copy_data functions. by @DennisHeimbigner in Improve performance of the nc_reclaim_data and nc_copy_data functions. #2699
• CMakeLists.txt use ON vs yes, indent by @poelmanc in CMakeLists.txt use ON vs yes, indent #2663
• Fix some dependency conditions between some ncdump tests. by @DennisHeimbigner in Fix some dependency conditions between some ncdump tests. #2682
• awsincludes: remove executable permissions by @mathstuf in awsincludes: remove executable permissions #2689
• Fix some problems with Earthdata authorization. by @DennisHeimbigner in Fix some problems with Earthdata authorization. #2709
• Provide a single option to disable all network access and testing. by @DennisHeimbigner in Provide a single option to disable all network access and testing. #2708
• Fix building on macOS by @skosukhin in Fix building on macOS #2710
• Update tinyxml and allow its use under OS/X. by @DennisHeimbigner in Update tinyxml and allow its use under OS/X. #2711
• Suppress filters on variables with non-fixed-size types. by @DennisHeimbigner in Suppress filters on variables with non-fixed-size types. #2716
• Remove fortran bootstrap option by @WardF in Remove fortran bootstrap option #2707
• Add support for HDF5 transient types by @ZedThree in Add support for HDF5 transient types #2655
• Modify PR 2655 to ensure transient types have names. by @DennisHeimbigner in Modify PR 2655 to ensure transient types have names. #2724
• Fix memory leak by @DennisHeimbigner in Fix memory leak #2725
• Enable/Disable some plugins at configure time by @WardF in Enable/Disable some plugins at configure time #2722
• Add capability to enable/disable compression libraries by @gsjaardema in Add capability to enable/disable compression libraries #2712
• Release notes: Minor. Add historical tag, and spell fix. by @Dave-Allured in Release notes: Minor. Add historical tag, and spell fix. #2684
• Fix potential null dereference by @ZhipengXue97 in Fix potential null dereference #2646
• Fix a crash when accessing a corrupted classic file. by @DennisHeimbigner in Fix a crash when accessing a corrupted classic file. #2732
• Explicitly suppress variable length type compression by @DennisHeimbigner in Explicitly suppress variable length type compression #2730
• Cleanup the handling of cache parameters. by @DennisHeimbigner in Cleanup the handling of cache parameters. #2734
• Fix a number of minor bugs by @DennisHeimbigner in Fix a number of minor bugs #2726
• Fix major bug in the NCZarr cache management by @DennisHeimbigner in Fix major bug in the NCZarr cache management #2737
• Fix --has-quantize in autotools-generated nc-config. by @WardF in Fix --has-quantize in autotools-generated nc-config. #2749
• Fix an issue with unescaped paths in the build system by @weiznich in Fix an issue with unescaped paths in the build system #2756
• Mitigate S3 test interference + Unlimited Dimensions in NCZarr by @DennisHeimbigner in Mitigate S3 test interference + Unlimited Dimensions in NCZarr #2755
• Fix cmake s3 support.wif by @WardF in Fix cmake s3 support.wif #2741
• CMake: Ensure all libraries link against MPI if needed by @ZedThree in CMake: Ensure all libraries link against MPI if needed #2758
• CMake: Change header in check for HDF5 zlib/szip support by @ZedThree in CMake: Change header in check for HDF5 zlib/szip support #2757
• Updated static software.html page with reference to met.3d by @WardF in Updated static software.html page with reference to met.3d #2760
• Revert a change made in d3c2cf2 that is proving confounding in MSYS2 bash by @WardF in Revert a change made in d3c2cf236 that is proving confounding in MSYS2 bash #2769
• Address Windows and MacOS s3 issues by @WardF in Address Windows and MacOS s3 issues #2759
• Fix bug with displaying log messages by @ZedThree in Fix bug with displaying log messages #2767
• Add ctest script to CI. by @WardF in Add ctest script to CI.  #2778
• CI: Have nc-autotools use source distribution instead of repository by @DWesl in CI: Have nc-autotools use source distribution instead of repository #2601
• Added stanza to workflow actions so that pushed changes cancel tests by @WardF in Added stanza to workflow actions so that pushed changes cancel tests #2779
• netCDFConfig: find HDF5 if needed by @mathstuf in netCDFConfig: find HDF5 if needed #2751
• Cleanup a number of issues. by @DennisHeimbigner in Cleanup a number of issues. #2763
• CMake: Don't add uninstall target and CPack config if not top-level by @ZedThree in CMake: Don't add uninstall target and CPack config if not top-level #2776
• Replace exec_program with execute_process by @WardF in Replace exec_program with execute_process #2784
• Fix Proxy problem for DAP2 by @DennisHeimbigner in Fix Proxy problem for DAP2 #2764
• Remove stray character in cmake lfs tests for nczarr. by @WardF in Remove stray character in cmake lfs tests for nczarr. #2786
• Renamed mmap variable, which conflicts with mmap() function on FreeBSD by @seanm in Renamed mmap variable, which conflicts with mmap() function on FreeBSD #2790
• Make ncZarr-specific deps and options dependent on ncZarr being enabled. by @WardF in Make ncZarr-specific deps and options dependent on ncZarr being enabled. #2793
• Fix most float conversion warnings by @ZedThree in Fix most float conversion warnings #2782
• Fixed various UBSan warnings about invalid bit shifting by @seanm in Fixed various UBSan warnings about invalid bit shifting #2787
• disable test that depends on ncpathcvt in cmake build w/o utilities by @tbussmann in disable test that depends on ncpathcvt in cmake build w/o utilities #2795
• Update internal tinyxml2 code to the latest version by @DennisHeimbigner in Update internal tinyxml2 code to the latest version #2771
• Remove the execinfo capability by @DennisHeimbigner in Remove the execinfo capability #2789
• Fixed various UBSan warnings about working with NULL pointers by @seanm in Fixed various UBSan warnings about working with NULL pointers #2803
• Improve fetch performance of DAP4 by @DennisHeimbigner in Improve fetch performance of DAP4 #2765
• Fixed misaligned memory access flagged by UBSan by @seanm in Fixed misaligned memory access flagged by UBSan #2800
• Tweaking PR to work with Visual Studio by @WardF in Tweaking PR to work with Visual Studio #2788
• CMake: Use helper libraries for nczarr tests by @ZedThree in CMake: Use helper libraries for nczarr tests #2783
• Fixed various UBSan warnings about working with NULL pointers by @seanm in Fixed various UBSan warnings about working with NULL pointers #2802
• Fix some important bugs in various files by @DennisHeimbigner in Fix some important bugs in various files #2813
• Removed a use of sprintf that required changing a function signature by @seanm in Removed a use of sprintf that required changing a function signature #2743
• sprintf -> snprintf by @seanm in sprintf -> snprintf #2691
• chore: unset executable flag by @e-kwsm in chore: unset executable flag #2745
• Fix nc-config generated by cmake. by @WardF in Fix nc-config generated by cmake. #2825
• Do not compile test program unless required by @magnusuMET in Do not compile test program unless required #2761
• CMake: Add improvements to MPI support by @johnwparent in CMake: Add improvements to MPI support #2595
• Catching up on PRs by @WardF in Catching up on PRs #2826
• Minor fix to doxygen documentation by @gsjaardema in Minor fix to doxygen documentation #2450
• Enable compilation with C89 compiler by @gsjaardema in Enable compilation with C89 compiler #2379
• count argument in H5Sselect_hyperslab by @wkliao in count argument in H5Sselect_hyperslab #2296
• Changed link to netCDF-Fortran documentation. by @WardF in Changed link to netCDF-Fortran documentation. #2830
• Avoid segfault if opening file failed by @rouault in Avoid segfault if opening file failed #2427
• Add clarification for the meaning of NSB by @rkouznetsov in Add clarification for the meaning of NSB #2388
• Add H5FD_http_finalize function and call on hdf5 finalize by @lostbard in Add H5FD_http_finalize function and call on hdf5 finalize #2827
• Reduce warning by changing type of NC_OBJ.id. by @DennisHeimbigner in Reduce warning by changing type of NC_OBJ.id. #2781
• Replaced ancient K&R function declarations to be C23 compatible by @seanm in Replaced ancient K&R function declarations to be C23 compatible #2801
• add new compression to bm_file benchmark by @edwardhartnett in add new compression to bm_file benchmark #2821
• Fix doxygen warnings by @WardF in Fix doxygen warnings #2834
• Fix szip linking by @mwestphal in Fix szip linking #2833
• Silence conversion warnings from malloc arguments by @ZedThree in Silence conversion warnings from malloc arguments #2809
• Use explicit casts in nc4_convert_type to silence warnings by @ZedThree in Use explicit casts in nc4_convert_type to silence warnings #2808
• Manage project version with cmake by @K20shores in Manage project version with cmake #2835
• Define USE_SZIP variable for nc-config.cmake.in by @islas in Define USE_SZIP variable for nc-config.cmake.in #2836
• Place dependencies into separate file by @K20shores in Place dependencies into separate file #2838
• Macros functions by @K20shores in Macros functions #2842
• CMake: Find HDF5 header we can safely include for other checks by @ZedThree in CMake: Find HDF5 header we can safely include for other checks #2762
• Rebase Silence sign conversion warnings from NClist functions #2812 by @WardF in Rebase #2812 #2844
• Silence sign conversion warnings from NClist functions by @ZedThree in Silence sign conversion warnings from NClist functions #2812
• CMake: Add support for UNITY_BUILD by @jschueller in CMake: Add support for UNITY_BUILD #2839
• Fix warnings in NCZarr tests by @ZedThree in Fix warnings in NCZarr tests #2816
• Link against internally defined libraries by @islas in Link against internally defined libraries #2837
• Fix some variable types. Resolves Compile failure on Fedora Rahide i686 #2849 by @opoplawski in Fix some variable types. Resolves #2849 #2850
• Add citation.cff file by @WardF in Add citation.cff file #2853
• Minor -- fix UNset to unset by @gsjaardema in Minor -- fix UNset to unset #2856
• Update bundled utf8proc to 2.9.0 by @ZedThree in Update bundled utf8proc to 2.9.0 #2857
• CMake: Export targets so the build directory can be used directly by @ZedThree in CMake: Export targets so the build directory can be used directly #2774
• Modernize Doxygen CSS by @WardF in Modernize Doxygen CSS #2860
• Fix Windows export by @WardF in Fix Windows export #2861
• Silence ncdump warnings by @ZedThree in Silence ncdump warnings #2840
• Adopt more modern style for doxygen-generated documentation. by @WardF in Adopt more modern style for doxygen-generated documentation. #2864
• Add static build to one-off GitHub Actions testing. by @WardF in Add static build to one-off GitHub Actions testing. #2866
• Fixes finding HDF5 header by @Julius-Plehn in Fixes finding HDF5 header #2867
• Properly handle missing regions in URLS by @DennisHeimbigner in Properly handle missing regions in URLS #2819
• fix cmake build with ENABLE_HDF4 and hdf requiring jpeg by @aumuell in fix cmake build with ENABLE_HDF4 and hdf requiring jpeg #2879
• Revert "fix cmake build with ENABLE_HDF4 and hdf requiring jpeg" by @WardF in Revert "fix cmake build with ENABLE_HDF4 and hdf requiring jpeg" #2882
• Use cmake netCDF with target_* for many options by @K20shores in Use cmake netCDF with target_* for many options #2847
• Pull out FindPNETCDF CMake module by @ZedThree in Pull out FindPNETCDF CMake module #2841
• CI: Fix version of HDF5 used in one-off test by @ZedThree in CI: Fix version of HDF5 used in one-off test #2885
• Fix for H5Literate() callback versioning by @derobins in Fix for H5Literate() callback versioning #2888
• Silence conversion warnings in libsrc4 by @ZedThree in Silence conversion warnings in libsrc4 #2892
• Remove now unused cmake by @K20shores in Remove now unused cmake #2890
• Prefix all options with NETCDF_ by @K20shores in Prefix all options with NETCDF_ #2895
• Fix most warnings in dumplib.c by @ZedThree in Fix most warnings in dumplib.c #2814
• Silence most warnings in libhdf5 by @ZedThree in Silence most warnings in libhdf5 #2874
• Silence warnings in oc2 by @ZedThree in Silence warnings in oc2 #2891
• CMake: Add option to always automatically regenerate ncgen source by @ZedThree in CMake: Add option to always automatically regenerate ncgen source #2822
• Silence most warnings in libsrc by @ZedThree in Silence most warnings in libsrc #2883
• Fix warnings in tests and examples by @ZedThree in Fix warnings in tests and examples #2884
• Fix warnings from backwards-loops by @ZedThree in Fix warnings from backwards-loops #2899
• Modernize CURL in netCDF cmake by @WardF in Modernize CURL in netCDF cmake #2904
• Misc clang-tidy fixes, and added a .clang-tidy config file by @seanm in Misc clang-tidy fixes, and added a .clang-tidy config file #2875
• Rename the vendored strlcat symbol by @weiznich in Rename the vendored strlcat symbol #2906
• Remove superflous check for libcurl by @WardF in Remove superflous check for libcurl  #2907
• Fix warnings in ncgen3 by @ZedThree in Fix warnings in ncgen3 #2900
• Add CI for a Windows Runner on Github Actions. by @WardF in Add CI for a Windows Runner on Github Actions. #2910
• Fix conversion warnings in libdispatch by @ZedThree in Fix conversion warnings in libdispatch #2905
• Refactor _FillValue macro by @WardF in Refactor _FillValue macro #2911
• Fix warnings in ncgen by @ZedThree in Fix warnings in ncgen #2897
• Re-introduce targets into netCDFConfig.cmake.in by @WardF in Re-introduce targets into netCDFConfig.cmake.in #2912
• changes associated with the removal of the Unidata ftp site. by @oxelson in changes associated with the removal of the Unidata ftp site. #2915
• CMake: Enable plugins on MinGW by @MehdiChinoune in CMake: Enable plugins on MinGW #2914
• Modify ncdump to print char-valued variables as utf8. by @DennisHeimbigner in Modify ncdump to print char-valued variables as utf8. #2921
• Honor CMAKE_INSTALL_MANDIR by @WardF in Honor CMAKE_INSTALL_MANDIR #2922
• Convert the ENABLE_XXX options to NETCDF_ENABLE_XXX options for NCZarr by @DennisHeimbigner in Convert the ENABLE_XXX options to NETCDF_ENABLE_XXX options for NCZarr #2923
• ftp --> resources, part II by @oxelson in ftp --> resources, part II #2924
• CI: Setup a CMake job for MSYS2/MinGW by @MehdiChinoune in CI: Setup a CMake job for MSYS2/MinGW #2917
• Fix all warnings in ncdap4 by @ZedThree in Fix all warnings in ncdap4 #2898
• Cleanup various obsolete build issues by @DennisHeimbigner in Cleanup various obsolete build issues #2926
• Fix duplicate definition when using aws-sdk-cpp. by @DennisHeimbigner in Fix duplicate definition when using aws-sdk-cpp. #2928
• Fix a few issues related to detection of libhdf4. by @WardF in Fix a few issues related to detection of libhdf4. #2933
• Cleanup handling of NETCDF_ENABLE_SET_LOG_LEVEL and NETCDF_ENABLE_SET_LOG_LEVEL_FUNC by @DennisHeimbigner in Cleanup handling of NETCDF_ENABLE_SET_LOG_LEVEL and NETCDF_ENABLE_SET_LOG_LEVEL_FUNC #2931
• Add compiler flag to fix infinities issue with intel compilers. by @WardF in Add compiler flag to fix infinities issue with intel compilers. #2935
• Fix some warnings in cmake by @DennisHeimbigner in Fix some warnings in cmake #2940
• Clean up some inconsistencies in filter documentation by @gsjaardema in Clean up some inconsistencies in filter documentation #2943
• Different method for checking HDF5 version requirement by @gsjaardema in Different method for checking HDF5 version requirement #2942
• Fix ordering in CMakeLists.txt by @gsjaardema in Fix ordering in CMakeLists.txt #2941
• Fix cmake-based libnetcdf.settings.in by @WardF in Fix cmake-based libnetcdf.settings.in #2944
• CI: Add Cygwin CMake run by @DWesl in CI: Add Cygwin CMake run #2930
• Convert NCzarr meta-data to use only Zarr attributes by @DennisHeimbigner in Convert NCzarr meta-data to use only Zarr attributes #2936
• Fix: CMAKE_MODULE_PATH contents is being overriden with -D contents, not merged with by @gorloffslava in Fix: CMAKE_MODULE_PATH contents is being overriden with -D contents, not merged with #2946
• Propegate change to metadata and use of anonymous dimensions to NCZarr test by @WardF in Propegate change to metadata and use of anonymous dimensions to NCZarr test #2949
• S3 Mode url reconstruction defaults to wrong server type by @mannreis in S3 Mode url reconstruction defaults to wrong server type #2947
• Fix most warnings in libdap2 by @ZedThree in Fix most warnings in libdap2 #2887
• Check if HDF5 "file" is a DAOS object by @brtnfld in Check if HDF5 "file" is a DAOS object #2021

New Contributors

• @uweschulzweida made their first contribution in Fix issue #2674 #2675
• @ZhipengXue97 made their first contribution in Fix potential dead store #2644
• @poelmanc made their first contribution in CMakeLists.txt use ON vs yes, indent #2663
• @weiznich made their first contribution in Fix an issue with unescaped paths in the build system #2756
• @tbussmann made their first contribution in disable test that depends on ncpathcvt in cmake build w/o utilities #2795
• @e-kwsm made their first contribution in chore: unset executable flag #2745
• @johnwparent made their first contribution in CMake: Add improvements to MPI support #2595
• @lostbard made their first contribution in Add H5FD_http_finalize function and call on hdf5 finalize #2827
• @K20shores made their first contribution in Manage project version with cmake #2835
• @islas made their first contribution in Define USE_SZIP variable for nc-config.cmake.in #2836
• @Julius-Plehn made their first contribution in Fixes finding HDF5 header #2867
• @aumuell made their first contribution in fix cmake build with ENABLE_HDF4 and hdf requiring jpeg #2879
• @derobins made their first contribution in Fix for H5Literate() callback versioning #2888
• @MehdiChinoune made their first contribution in CMake: Enable plugins on MinGW #2914
• @gorloffslava made their first contribution in Fix: CMAKE_MODULE_PATH contents is being overriden with -D contents, not merged with #2946
• @mannreis made their first contribution in S3 Mode url reconstruction defaults to wrong server type #2947

Full Changelog: v4.9.2...v4.9.3-rc1

---

This discussion was created from the release v4.9.3-rc1.

[trexfeathers]

Hello,

Is there a timeline for finalising this release? I know a further release candidate was mentioned a few months ago, but I'm hoping that the full 4.9.3 release will be coming soon. If not, is there a way to get #2764 into an emergency patch release? More details below

With version 4.9.2 - the latest official release - it is not possible to use OpenDAP on a machine that uses a custom SSL certificate, because the custom certificate information in a .dodsrc file (or its equivalents) is not being honoured. This has been fixed in #2764, and I have installed version 4.9.3rc1, which confirms that this definitely re-enables OpenDAP on my machine ✅

Thanks for all your work on the package!

[WardF]

Thank you! I am putting out the release candidate by EOD tomorrow (it was scheduled for today but I ran into some technical hiccups with the docker-based verification back-end, and I hope to have the full release out by the end of the month, as long as no blocking issues are reported!

[opoplawski]

I'm just going to note that I think that it is unexpected to have a soname bump/ABI incompatibility in patch level version increment. Any particular reason not to go with 4.10.0 with such a change?

[WardF]

That is a good point, and one I had been too close to the code to consider. I will give it some thought as I'm preparing the release, it would be unusual for the full release to have a different final version than the release candidate but it would serve the correct purpose here.