CMake does not support more than one toolchain per language. It’s just a fundamental design decision baked in at the very early days that isn’t possible to feasibly fix today.
The typical fix is to build the project twice (via ExternalProject), once for the host and then for the cross-compilation step. You can see this in VTK’s iOS and Android build setups.