find_package(BLAS) does not find OpenBLAS

Code
1

Hi,

I am using the llama.cpp project to evaluate LLMs. But on Windows I am running into a problem with CMake: The find_package(BLAS) invocation does not find OpenBLAS.

Steps to reproduce

  1. Unpack the fOpenBLAS-0.3.23-x64.zipf inside the projects ./build directory.

  2. Execute:

cmake `
    --debug-find `
    -DLLAMA_BLAS=ON `
    -DLLAMA_BLAS_VENDOR=OpenBLAS `
    ..

Debug Output

The file C:/llama.cpp/build/OpenBLAS/lib/libopenblas.lib does exist and the find_library method location should match.

See llama.cpp/CMakeLists.txt at master-0be54f7 · ggerganov/llama.cpp · GitHub for the implementation.

CMake Debug Log at C:/Users/CountZero/miniconda3/Lib/site-packages/cmake/data/share/cmake-3.26/Modules/FindBLAS.cmake:343 (find_library):
  find_library called with the following settings:

    VAR: BLAS_openblas_LIBRARY
    NAMES: "openblas"
    Documentation: Path to a library.
    Framework
      Only Search Frameworks: 0
      Search Frameworks Last: 0
      Search Frameworks First: 0
    AppBundle
      Only Search AppBundle: 0
      Search AppBundle Last: 0
      Search AppBundle First: 0
    CMAKE_FIND_USE_CMAKE_PATH: 1
    CMAKE_FIND_USE_CMAKE_ENVIRONMENT_PATH: 1
    CMAKE_FIND_USE_SYSTEM_ENVIRONMENT_PATH: 1
    CMAKE_FIND_USE_CMAKE_SYSTEM_PATH: 1
    CMAKE_FIND_USE_INSTALL_PREFIX: 1

  find_library considered the following locations:

    C:/llama.cpp/build/()openblas(\.lib)

  The item was not found.

Call Stack (most recent call first):
  C:/Users/CountZero/miniconda3/Lib/site-packages/cmake/data/share/cmake-3.26/Modules/FindBLAS.cmake:775 (check_blas_libraries)
  CMakeLists.txt:173 (find_package)

-- Could NOT find BLAS (missing: BLAS_LIBRARIES)

The issue https://github.com/ggerganov/llama.cpp/issues/627 is related.

Is this a bug of CMake? Is there a workaround?

2

It looks like BLAS_ROOT should be set to ${LLAMA_BUILD_DIR}/OpenBLAS (or similar). Does that help?

3

Hi,

thank you for the advice.

I set the BLAS_ROOT variable:

cmake `
    -DBLAS_ROOT="${pathToOpenBLAS}" `
    -DLLAMA_BLAS=ON `
    -DLLAMA_BLAS_VENDOR=OpenBLAS `
    ..

And used the following values of $pathToOpenBLAS:

  1. ../../OpenBLAS
  2. ../../OpenBLAS/
  3. C:/absolute/path/to/OpenBLAS
  4. C:/absolute/path/to/OpenBLAS/

But the error message is still the same:

– Could NOT find BLAS (missing: BLAS_LIBRARIES)
CMake Warning at CMakeLists.txt:225 (message):
BLAS not found, please refer to
https://cmake.org/cmake/help/latest/module/FindBLAS.html#blas-lapack-vendors
to set correct LLAMA_BLAS_VENDOR

So it sadly does not help.

4

Does --debug-find help figure out where CMake is looking at least?

5

@ben.boeckel Yes, setting the BLAS_ROOT variable to ../../OpenBLAS causes CMake to search at the right location:

CMake Debug Log at C:/Users/CountZero/miniconda3/Lib/site-packages/cmake/data/share/cmake-3.26/Modules/FindBLAS.cmake:343 (find_library):
  find_library called with the following settings:

    VAR: BLAS_openblas_LIBRARY
    NAMES: "openblas"
    Documentation: Path to a library.
    Framework
      Only Search Frameworks: 0
      Search Frameworks Last: 0
      Search Frameworks First: 0
    AppBundle
      Only Search AppBundle: 0
      Search AppBundle Last: 0
      Search AppBundle First: 0
    CMAKE_FIND_USE_CMAKE_PATH: 1
    CMAKE_FIND_USE_CMAKE_ENVIRONMENT_PATH: 1
    CMAKE_FIND_USE_SYSTEM_ENVIRONMENT_PATH: 1
    CMAKE_FIND_USE_CMAKE_SYSTEM_PATH: 1
    CMAKE_FIND_USE_INSTALL_PREFIX: 1

  find_library considered the following locations:

    C:/absolute/path/to/OpenBLAS/lib/()openblas(\.lib)
    C:/absolute/path/to/OpenBLAS/()openblas(\.lib)
    [...]

But CMake still fails to “find” the OpenBLAS library:

[...]

  The item was not found.

Call Stack (most recent call first):
  C:/Users/CountZero/miniconda3/Lib/site-packages/cmake/data/share/cmake-3.26/Modules/FindBLAS.cmake:775 (check_blas_libraries)
  CMakeLists.txt:181 (find_package)


-- Could NOT find BLAS (missing: BLAS_LIBRARIES)
CMake Debug Log at CMakeLists.txt:181 (find_package):
  find_package considered the following paths for FindBLAS.cmake:

  The file was found at

    C:/Users/CountZero/miniconda3/Lib/site-packages/cmake/data/share/cmake-3.26/Modules/FindBLAS.cmake

  The module is considered not found due to BLAS_FOUND being FALSE.


CMake Warning at CMakeLists.txt:238 (message):
  BLAS not found, please refer to
  https://cmake.org/cmake/help/latest/module/FindBLAS.html#blas-lapack-vendors
  to set correct LLAMA_BLAS_VENDOR

I am using the openblas-0.3.23-x64.zip from Release OpenBLAS 0.3.23 version · xianyi/OpenBLAS · GitHub.

6

I have a similar issue. It can’t find reference implementations (libblas, libcblas) either

7

Has anyone made an issue for this to track it?

8

It seems to me the cmake config package is wrong:

bash-5.2$ head -50 /usr/local/Cellar/openblas/0.3.26/lib/cmake/openblas/OpenBLASConfig*.cmake
==> /usr/local/Cellar/openblas/0.3.26/lib/cmake/openblas/OpenBLASConfig.cmake <==

SET(OpenBLAS_VERSION "0.3.26")
SET(OpenBLAS_INCLUDE_DIRS /usr/local/Cellar/openblas/0.3.26/include)
SET(OpenBLAS_LIBRARIES /usr/local/Cellar/openblas/0.3.26/lib/libopenblas.dylib)

==> /usr/local/Cellar/openblas/0.3.26/lib/cmake/openblas/OpenBLASConfigVersion.cmake <==

set (PACKAGE_VERSION "0.3.26")
if (PACKAGE_VERSION VERSION_LESS PACKAGE_FIND_VERSION)
  set (PACKAGE_VERSION_COMPATIBLE FALSE)
else ()
  set (PACKAGE_VERSION_COMPATIBLE TRUE)
  if (PACKAGE_FIND_VERSION STREQUAL PACKAGE_VERSION)
    set (PACKAGE_VERSION_EXACT TRUE)
  endif ()
endif ()

bash-5.2$

9