ZRH --:--:--

Eigenvalues and eigenvectors

5 min read4 sections
On this page

Some vectors remain on their span after transformation. Because of linear transformation any vector on that same span remains on that span. These vectors are the eigenvalues with corresponding eigenvalues (scalar).

Since linear transformation of an eigenvector v‾\overline v just scales it, it follows:

Av‾=λv‾=(λI)v‾=(A−λI)v‾=0‾A \overline v = \lambda \overline v = (\lambda I) \overline v = (A-\lambda I)\overline v = \overline 0

This expression is always true for v‾=0\overline v = 0 but this is not allowed. So the only way a multiplication of a matrix with a non-zero vector to be zero is with det(A−λI)=0det(A-\lambda I)=0. Transformation associated with that matrix squishes space into a lower dimension? (chapter 5/6)

Exmaple

(3−λ102−λ)=(3−λ)(2−λ)=0\begin{pmatrix} 3-\lambda & 1 \\ 0 & 2-\lambda \end{pmatrix} = (3-\lambda)(2-\lambda) = 0

After finding eigenvalue, we need eigenvectors associated with eigenvalue (λ=2 or λ=3\lambda = 2 \space or \space \lambda = 3)

  • Change matrix A and solve linear system for 0 (homogeneous)

Rotation don’t have Eigenvalues

(0−110)\begin{pmatrix} 0& -1 \\ 1 & 0 \end{pmatrix}

Shear

Fixes ı^î and moves j^\hat j one over

(1101)\begin{pmatrix} 1& 1 \\ 0 & 1 \end{pmatrix}

Only eigenvector are all vectors on ı^î with eigenvalue 1.

Scaled matrices

(2002)\begin{pmatrix} 2& 0 \\ 0 & 2 \end{pmatrix}

All vectors are eigenvectors with eigenvalue 2.

Diagonal matrix

All basis are eigenvectors with the values being their eigenvalues (here: 2 and 2)

Rectabgular matrices

Cant have eigenvalues because not diagonizable

Is vector an eigenvector of matrix B?

check with: Matrix∗vector=scaled vectorMatrix*vector = scaled \space vector

Show code (16 lines)(1111)∗(11)=(22)=2∗(11)=2v\begin{pmatrix} 1& 1 \\ 1 & 1 \end{pmatrix} * \begin{pmatrix} 1 \\ 1 \end{pmatrix}= \begin{pmatrix} 2 \\ 2 \end{pmatrix}=2* \begin{pmatrix} 1 \\ 1 \end{pmatrix} =2v

So vv is an eigenvector with eigenvalue of 2, since transformation only scales v.

The associated eigenspace is the solution set of the linear system B−2I2=0B-2I_2=0.

Show code (13 lines)B−2I2=(1111)−2∗(1001)=(−111−1)B-2I_2= \begin{pmatrix} 1& 1 \\ 1 & 1 \end{pmatrix} -2* \begin{pmatrix} 1& 0 \\ 0 & 1 \end{pmatrix}= \begin{pmatrix} -1& 1 \\ 1 & -1 \end{pmatrix}

We solve the linear system and the resulting solution set is the eigenspace of the eigenvalue 2.

But how to find all eigenvalues?

The following must be true det(A−λIn)=0det(A-\lambda I_n)= 0

Solve: det(A−λIn)=(1−λ)2=λ2−2λ=λ(λ−2)=0det(A-\lambda I_n)= (1-\lambda)^2 = \lambda^2-2\lambda = \lambda(\lambda-2)=0

The two eigenvalues are 2 and 0, now solve both linear systems with eigenvalues

Eigenvalues Upper triangular matrices?

(2−λ20034−λ500−3−λ)=(2−λ)(34−λ)(−3−λ)\begin{pmatrix} 2-\lambda& 2&0 \\ 0 & \frac{3}{4}-\lambda & 5 \\ 0&0&-3-\lambda \end{pmatrix} = (2-\lambda)(\frac{3}{4}-\lambda)(-3-\lambda)

Eigenvalues: 2,34,−32,\frac{3}{4},-3, this works for all upper matrices. Eigenvalues are its diagonal entries.

quadratic formular

x1,2=−b±(b2−4ac)2ax_{1,2} = \frac{-b \pm \sqrt(b^2-4ac)}{2a}

Diagonalizable

Diagonal matrices have nice properties so it’s convenient to describe a linear mapping by a diagonal matrix.

(a00d)\begin{pmatrix} a & 0 \\ 0 & d \end{pmatrix}

Desribes the scaling by factor a in x1x_1 direction and by factor d in x2x_2-direction. If a or d is negative then this reflects a reflection.

Linear Mapping that use rotations don’t have eigenvectors

Eigenspace

Eigenspace L is a subspace of RnR^n associated to the eigenvalue. Since an eigenvalue has infinite eigenvectors associated with the same eigenvalue.

Determination of Eigenvalues and Eigenvectors

(1111)\begin{pmatrix} 1 & 1 \\ 1 & 1 \end{pmatrix}

Eigendecompostion

Sometimes it is very useful to write a matrix 𝐴 as a product of other matrices, say

A=PDP−1A=PDP^{-1}

such a matrix is called a matrix dececomposition of matrix A. This holds for a linear map described by A and D w.r.t different bases. Goal is to find basis for which matrix D is a diagonal matrix. The matrix PP is called transformation matrix. The process of obtaining PP and DD is called diagonalization.

  • DD is composed of eigenvalues of AA
  • PP is composed of eigenvectors of AA and are not unique

Back to top

Esc

Type at least two letters. Search covers every project and knowledge-base note.

oz@zrh: ~
QUICK DOSSIER · 30 SEC READ

OLIVER ZINGG

Psychologist and data scientist in Zürich. I design the study, model the data and explain what it means.

STATUS
Open to full-time data science roles from January 2027
NOW
Working student, data science & project management at Zurich Insurance (since Nov 2025)
THESIS
M.Sc. thesis (HSLU): leveraging double machine learning for robust decision-making, due December 2026
EDUCATION
M.Sc. Psychology (UZH, 5.6) · M.Sc. Applied Information & Data Science (HSLU, Dec 2026)
TOOLS
R, Python, SQL, Matlab · Power BI, Tableau · mixed models, ML, BERTopic

TOP CASE FILES

  1. Learning and memory formation in children and adolescents with psychiatric disordersMaster's thesis, UZH · 2023
  2. Support vector machines vs. CNNs for Alzheimer's disease classificationBachelor's thesis, UZH · 2021
  3. Simpson's paradox and mixed-effects modelsStatistics · 2023