generalized eigenvalue problem