So use a data structure designed for storing sparse matrices, and a matmul algorithm that uses said data structure. I have to say I'm a bit confused why you keep bringing up this point, as you have ...

I'm getting ready to start working on a C/C++ project that will be building and solving large tri-diagonal, block tri-diagonal and triangular matrices. I know there are a lot of libraries available ...