BLAS and LAPACK for other programs#

Experimental. The Linux wheels carry numerical_blas, a shared library of 39 BLAS and LAPACK routines under their Fortran names: ?gemm_, ?gesv_, ?getrf_, ?getrs_, ?potrf_ and ?potrs_ in the four precisions, sdot_, ddot_, cdotu_, cdotc_, zdotu_ and zdotc_, and dsyrk_, dgemv_, dtrsm_, dsyevd_, dgesdd_, dgeqrf_, dorgqr_, dgelsd_ and dgeev_ (gfortran’s calling convention, a complex result returned by value); each with 32-bit integers, and under its name ending in 64_ (dgemm_64_) with 64-bit ones, as OpenBLAS’s ILP64 build names them. numerical.blas_library() gives its path (None on macOS and Windows, where the wheels carry none: macOS’s dyld binds each routine a program imports to the library that provides it, which a library inserted by DYLD_INSERT_LIBRARIES, DYLD_FORCE_FLAT_NAMESPACE or not, does not replace; there, CMake’s build is linked by name, -lnumerical_blas). Preloaded, it answers those calls in a program linked against the system’s BLAS and LAPACK, which keep every other routine:

LD_PRELOAD=$(python -c "import numerical; print(numerical.blas_library())") python script.py

Julia reaches the library through libblastrampoline, which loads it by its path and forwards it the routines it has (those it lacks stay OpenBLAS’s). Twelve groups of Julia’s LinearAlgebra tests pass with it on Linux, but for two that compare svd’s vectors with gesvd’s column by column: they agree up to the columns’ signs, which LAPACK leaves open.

using LinearAlgebra
BLAS.lbt_forward(path; clear=false, suffix_hint="64_")  # path: numerical.blas_library()

The program must call BLAS by those names: a NumPy or SciPy from the system’s packages (Debian, Ubuntu, Fedora…) or from FlexiBLAS, R, Octave, a Fortran or C program. NumPy and SciPy wheels from PyPI carry an OpenBLAS whose symbols are renamed, which a preloaded library does not reach. Importing numerical never loads it.

Its routines run NumPy’s and SciPy’s linear algebra test suites in CI, and Julia’s (julia.yml, weekly and on a change to them); an argument is checked as the reference BLAS checks it (the reference XERBLA’s message, then the call returns). A NaN or an infinity, which NumericAL’s own functions refuse, is taken as the reference LAPACK (3.12) takes it, where it takes it one way: getrf, gesv, geqrf, orgqr and the solvers carry it through, potrf reports the order its factorisation stops at, syevd gives NaN eigenvalues and INFO n. gesdd, geev and gelsd report the matrix as an illegal argument (INFO -4), as the reference’s gesdd and geev report a NaN; on an infinity the reference loops without end or gives NaN, and on a NaN its gelsd fails inside.

In C++#

numerical::blas (blas.hpp) carries the same routines as functions with the column-major semantics of BLAS’s ddot, dgemm, dsyrk, dgemv and dtrsm and LAPACK’s routines of those names: dot, gemm (of float, double and their complex numbers), syrk, gemv, trsm, gesv, getrf, getrs, potrf and potrs (the last five, as gemm, of float, double and their complex numbers), syevd, gesdd, geqrf, orgqr, gelsd and geev. CMake builds the shared library with -DNUMERICAL_BUILD_BLAS=ON, to stand in for those routines under a program linked against BLAS and LAPACK (LD_PRELOAD) or a switch such as FlexiBLAS.