How to specify build directory

My project looks something like this

- src
    - hello
        - hello.py
        - init.py    
- pyproject.toml
- setup.py
- CMakeLists.txt
- build

When I run pip install ., is there any way to specify that I want the build files to be located in the build directory?

I would consider scikit-build. Otherwise, setup.py could use python >= 3.8 importlib.resources.path and similar with subprocess.run