Vtgyjfy

Let $A, B$ be two $3 times 3$ (complex) symmetric matrices and suppose the equation $det(xA - B) = 0$ has three distinct solutions. Prove that $A$ is invertible.

Any help appreciated!

Since @user1551 didn't submit an answer, I'm giving one that is inspired on his comment. Nice one!

For starters the matrices do not have to be symmetric. They do not have to be of size $3times 3$ either, but can be of arbitrary size $n times n$. We do require that there are exactly $n$ distinct solutions, because otherwise $A=B=0$ is a counter example.

Let $A=USigma V^*$ be a singular value decomposition (SVD) of matrix $A$, which is guaranteed to exist for any complex matrix $A$. Then $U$ and $V$ are unitary matrices and $Sigma$ is a diagonal matrix of the singular values.

It follows that:
$$det(xA-B)=det(xUSigma V^*-B)=det(U(xSigma-U^*BV)V^*)=det(xSigma-U^*BV)$$

Suppose $A$ is singular. Then the diagonal matrix $Sigma$ has a $0$ on its diagonal. Consequently $(xSigma-U^*BV)$ has a row that does not contain $x$. When we apply the Laplace expansion to calculate it, we find that the resulting determinant cannot be of the maximum degree. Therefore there cannot be exactly $n$ distinct solutions.

Thus $A$ cannot be singular and must therefore be invertible.

Firstly, if $A$ and $B$ are linearly dependent, i.e. $B=lambda A$ for some $lambda$ then we have $det (xA- B)=(x-lambda)^3det A$ which does not have three distinct solutions. Hence $A$ and $B$ are linearly independent.

Let $V=langle A,Brangle$ be the plane spanned by $A$ and $B$. Passing to the projectivization of $mathbb{C}^{3times 3}$, $V$ becomes a line, say $L$. Since the equation has three distinct solution, $V$ contains at least $3$ lines on which every matrix is singular (namely, the lines $mathbb{C}cdot (lambda_i A-B)$, $1leq ileq 3$ for each solution of the equation). Thus, in projective space, $L$ and the degree $3$ hyper surface of singular matrices intersect in at least three points. Since the hyper surface is of degree $3$, they intersect in exactly $3$ points. Since $A$ is not of the form $xA-B$ for any $x$, $A$ is necessarily invertible.

It is possible that I am using some facts that you are not familiar with, in this case you can just comment so I can edit the answer.

Edit : I consider the hyper surface of singular matrices, i.e. the hyper surface defined by $det=0$ in the $8$-dimensional projective space of $3times 3$-matrices. The degree of a hyper surface is given by the degree of the defining polynomial, in this case it is $3$. Now, for a line and a hyper surface in projective space, there are $2$ possibilities, either the line is contained in the hyper surface or they have at most the degree of the hyper surface many intersection points. The line is not contained in the hyper surface in this case since otherwise for all $xinmathbb{C}$ we would have $det(xA-B)=0$. Then we pass to the case where there are at most $3$ intersection points. We already know that there are $3$ intersection points given by the solutions to $det(xA-B)=0$, so three points, all of the form $xA-B$. Now the points on the line spanned by $A,B$ are either of the form $xA-B$ for some $xinmathbb{C}$ or $A$ (any point on the line is of the form $[xA+yB]inmathbb{P}^8$ for some $x,yinmathbb{C}$. All points where $yneq 0$ can be parametrized by $xA-B, xinmathbb{C}$ and there is only one point where $y=0$, which is $A$).

Edit 2 : I would like to point out that this solution immediately generalises to $ntimes n$ case by simply putting $n$ instead of $3$.