Eigenvalues and Eigenvectors

Most vectors change direction when a linear transformation is applied. However, some special vectors keep their direction and are only stretched or shrunk. These are eigenvectors, and their scaling factor is the eigenvalue.

1. The Stability Equation

For a linear operator $A$, a vector $v$ is an eigenvector if: $Av = \lambda v$ where $\lambda$ is a scalar (the eigenvalue).

Intuition: In a 2D rotation, no real vector keeps its direction (except the zero vector). But in a scaling transformation, the axes are eigenvectors because points on them move only along the line.

2. Finding the Spectrum

To find $\lambda$, we must solve $\det(A - \lambda I) = 0$. This gives us the Characteristic Polynomial.

3. The Power Method: Finding Eigenvectors Iteratively

In high-dimensional spaces (like Google’s PageRank), we don’t calculate determinants. Instead, we use the Power Method: repeatedly apply $A$ to a random vector until it converges to the dominant eigenvector.

4. Diagonalization: $A = PDP^{-1}$

If a matrix has enough eigenvectors, we can rotate our coordinate system so the transformation is just axis-aligned scaling. This is the foundation of Principal Component Analysis (PCA).

5. Summary Check