Also tried to put CMAKE_EXE_LINKER_FLAGS_INIT in a toolchain file but cmake still picks up environment variable.
CMAKE_EXE_LINKER_FLAGS_INIT