cmake: Add option to pass flags not used for host tools (#689) #427

Job	Run time
msvc (Debug)	5m 51s
msvc (Release)	4m 57s
formatting	39s
linux (linux-amd64-release, linux-amd64)	1m 15s
linux (clang-tidy)	2m 30s
macos (macos-x86_64, On)	7m 33s
openapi-validate	18s
linux (linux-sanitizer)	5m 43s
macos (macos-arm64)	5m 54s
ui	39s
linux (linux-debug, valgrind --suppressions=deps/osr/docs/tbb.supp --suppressions=deps/osr/docs/p...	8m 49s
docker	18s
	44m 26s

Provide feedback