You shouldn’t need to add -rpath flags directly. CMake has direct support for specifying RPATH details, and it has separate controls for binaries in the build tree versus binaries you install. See the BUILD_RPATH and INSTALL_RPATH target properties for details. You would normally use CMAKE_BUILD_RPATH and CMAKE_INSTALL_RPATH to set the details globally rather than on each individual target.
You may want to still keep the --disable-new-dtags flag though. That provides behavior that CMake doesn’t control.