So now it really should be about two things: rpath and runtime environment. Your linker line seems to define RPATH for various libs like zlib: -Wl,-rpath -Wl,....../zlib-1.2.11-....../lib. Does it now define a similar thing for boost?
And even if so, if something is linked indirectly (a dependency of boost library itself) it may still be picked up from system location. In this case you either need to control that dependency build (and set its RPATH correctly) or you set LD_LIBRARY_PATH environment variable to point to your libraries.
There’s also a possibility re-configure dynamic linker but it’s system-wide and you almost for sure don’t want it.