Skip to content

Commit

Permalink
Update secondary file on compression, referenced by other file.
Browse files Browse the repository at this point in the history
  • Loading branch information
byrnHDF committed Jan 8, 2025
1 parent 0c69598 commit 5e91f0e
Show file tree
Hide file tree
Showing 10 changed files with 695 additions and 6 deletions.
7 changes: 7 additions & 0 deletions doxygen/aliases
Original file line number Diff line number Diff line change
Expand Up @@ -257,6 +257,13 @@ ALIASES += callback_note="\attention \Bold{Leaving callback functions:}\n The ca
ALIASES += par_compr_note="\attention If you are planning to use compression with parallel HDF5, ensure that calls to H5Dwrite() occur in collective mode. In other words, all MPI ranks (in the relevant communicator) call H5Dwrite() and pass a dataset transfer property list with the MPI-IO collective option property set to #H5FD_MPIO_COLLECTIVE_IO.\n Note that data transformations are currently \Bold{not} supported when writing to datasets in parallel and with compression enabled."
ALIASES += sa_metadata_ops="\sa \li H5Pget_all_coll_metadata_ops() \li H5Pget_coll_metadata_write() \li H5Pset_all_coll_metadata_ops() \li H5Pset_coll_metadata_write() \li \ref maybe_metadata_reads"

################################################################################
# Specifications
################################################################################

ALIASES += ref_spec_fileformat="\ref FMT3"
ALIASES += ref_spec_fileformat_btrees_v1="\ref subsubsec_fmt3_infra_btrees_v1"

################################################################################
# References
################################################################################
Expand Down
674 changes: 674 additions & 0 deletions doxygen/dox/HDF5CompressionTroubleshooting.dox

Large diffs are not rendered by default.

4 changes: 3 additions & 1 deletion doxygen/dox/LearnBasics3.dox
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ which keeps track of the chunks associated with a dataset:


\subsubsection susubsecLBDsetLayoutChunkWhy Why Chunking ?
Chunking is required for enabling compression and other filters, as well as for creating extendible
\ref hdf5_chunking is required for enabling compression and other filters, as well as for creating extendible
or unlimited dimension datasets.

It is also commonly used when subsetting very large datasets. Using the chunking layout can
Expand Down Expand Up @@ -149,6 +149,8 @@ It is a good idea to:
\li Test the data with different chunk sizes to determine the optimal chunk size to use.
\li Consider the chunk size in terms of the most common access patterns that will be used once the dataset has been created.

@see hdf5_chunk_issues

\subsection subsecLBDsetLayoutCom Compact
A compact dataset is one in which the raw data is stored in the object header of the dataset.
This layout is for very small datasets that can easily fit in the object header.
Expand Down
1 change: 1 addition & 0 deletions doxygen/dox/RelVersion.dox
Original file line number Diff line number Diff line change
Expand Up @@ -260,4 +260,5 @@ Please note that this libtool version number for interface
compatibility is unrelated to the HDF5 release version for a given
release.

@see BRANCHEXPL
*/
6 changes: 3 additions & 3 deletions doxygen/dox/Specifications.dox
Original file line number Diff line number Diff line change
@@ -1,20 +1,20 @@
/** \page SPEC Specifications

\section DDL
\section sec_spec_ddl DDL

\li \ref DDLBNF110
\li \ref DDLBNF112
\li \ref DDLBNF114
\li \ref DDLBNF200

\section File Format
\section sec_spec_ff File Format

\li \ref FMT1
\li \ref FMT11
\li \ref FMT2
\li \ref FMT3

\section Other
\section sec_spec_other Other

\li \ref IMG
\li \ref TBLSPEC
Expand Down
1 change: 1 addition & 0 deletions doxygen/dox/TechnicalNotes.dox
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,7 @@
\li \ref FMTDISC
\li \ref BRANCHEXPL
\li \ref CODECONV
\li \ref CompTS
\li \ref sec_file_image
\li \ref subsubsec_dataset_transfer_filter
\li \ref FileLock
Expand Down
2 changes: 2 additions & 0 deletions release_docs/RELEASE.txt
Original file line number Diff line number Diff line change
Expand Up @@ -47,6 +47,8 @@ New Features

Configuration:
-------------
- The documentation in the source folder, doc, has been converted to doxygen files.

- Added configuration option for API concurrency support:

CMake: HDF5_ENABLE_CONCURRENCY (ON/OFF) (Default: OFF)
Expand Down
2 changes: 1 addition & 1 deletion src/H5Gmodule.h
Original file line number Diff line number Diff line change
Expand Up @@ -342,7 +342,7 @@
* }
* \endcode
*
* h5dump is described on the “HDF5 Tools” page of the \ref RM.
* \ref sec_cltools_h5dump is described on the \ref sec_cltools page of the \ref UG.
*
* The HDF5 DDL grammar is described in the @ref DDLBNF200.
*
Expand Down
2 changes: 2 additions & 0 deletions src/H5Zmodule.h
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,7 @@
*
* Filter identifiers for the filters distributed with the HDF5
* Library are as follows:
* [PreDefFilters]
* <table>
* <tr><td>#H5Z_FILTER_DEFLATE</td><td>The gzip compression, or
* deflation, filter</td></tr>
Expand All @@ -114,6 +115,7 @@
* <tr><td>#H5Z_FILTER_FLETCHER32</td><td>The Fletcher32 checksum,
* or error checking, filter</td></tr>
* </table>
* [PreDefFilters]
* Custom filters that have been registered with the library will have
* additional unique identifiers.
*
Expand Down
2 changes: 1 addition & 1 deletion src/H5module.h
Original file line number Diff line number Diff line change
Expand Up @@ -1141,7 +1141,7 @@
* </tr>
* </table>
*
* HDF5 requires the use of chunking when defining extendable datasets. Chunking makes it
* HDF5 requires the use of chunking when defining extendable datasets. \ref hdf5_chunking makes it
* possible to extend datasets efficiently without having to reorganize contiguous storage
* excessively.
*
Expand Down

0 comments on commit 5e91f0e

Please sign in to comment.