How to specify build directory

My project looks something like this

- src
    - hello
- pyproject.toml
- CMakeLists.txt
- build

When I run pip install ., is there any way to specify that I want the build files to be located in the build directory?

I would consider scikit-build. Otherwise, could use python >= 3.8 importlib.resources.path and similar with