Looking into the sources of the ESP-IDF a bit more, I noticed that its actually an IMPORTED target and it seems to be missing the GLOBAL flag.
I’ll see if adding that resolves the issue.
Update: this does seem to resolve the issue. I’ll open up an issue (or PR) on their GitHub repository.