← Module 02 / Vectors & spaces

Lesson 02.6 · §3.2.2

What disappears, and what can you reach?

Distinguish nullspace, range, row space, column space, and rank.

In this lesson 4 ideas
  1. Collapse a direction
  2. Read the spaces from a matrix
  3. Explore in three dimensions
  4. Transfer

Source scope: §3.2.2. Worked numerical examples, experiments, and practice are teaching supplements unless identified as source results.

Collapse a direction

Take A=[1100]A=\begin{bmatrix}1&1\\0&0\end{bmatrix}. Then A(x,y)=(x+y,0)A(x,y)=(x+y,0). Every output lies on the horizontal axis. Inputs (t,−t)(t,-t) disappear entirely.

For a linear map T:V→WT:V\to W, define

null⁡(T)={v∈V:Tv=0},range⁡(T)={w∈W:∃v∈V, Tv=w}.\operatorname{null}(T)=\{v\in V:Tv=0\},\qquad \operatorname{range}(T)=\{w\in W:\exists v\in V,\ Tv=w\}.

The source leaves checking that both are subspaces as an exercise. Teaching verification: T0=0T0=0; sums and multiples of zero-output inputs still map to zero. For the range, Tx+Ty=T(x+y)Tx+Ty=T(x+y) and αTx=T(αx)\alpha Tx=T(\alpha x) show closure. Notice that the nullspace lives in the input space; the range lives in the output space.

Source footnote 3: Algebraists also call the nullspace the kernel. The notes avoid that name because machine learning uses “kernel” in another sense.

Read the spaces from a matrix

For A∈Rm×nA\in\mathbb R^{m\times n}, its column space is the span of its columns in Rm\mathbb R^m. Since AxAx is the columns weighted by coordinates of xx, this equals the range of its induced map. The source uses range⁡(A)\operatorname{range}(A) for that space. Its row space is the span of its rows in Rn\mathbb R^n, written range⁡(AT)\operatorname{range}(A^T).

The row and column spaces have the same dimension. This common value is the rank:

rank⁡(A)=dim⁡range⁡(A)=dim⁡range⁡(AT).\operatorname{rank}(A)=\dim\operatorname{range}(A)=\dim\operatorname{range}(A^T).

The source states this equality here without proof. For our example, the column space is span⁡{(1,0)}\operatorname{span}\{(1,0)\}, the row space is span⁡{(1,1)}\operatorname{span}\{(1,1)\}, and the rank is one. Equal dimensions do not mean equal spaces.

Explore it yourself

Follow the columns

Compare an invertible map with a collapse. Which directions disappear?

Preparing interactive controls…

x₁x₂-4-4-3-3-2-2-1-1011223344xAx

x = (1.000, 1.000); Ax = (2.000, 2.000). det A = 2; rank = 2. null(A) = {0}; range(A) = ℝ². The image of the dashed unit square has area 2.

Axes: first and second real coordinates, in unit steps. Endpoints and labels identify each vector.

Explore in three dimensions

Explore it yourself

Watch a dimension disappear

Flatten the cube onto a plane, then onto a line. Track a vector that the final map sends to zero.

Preparing interactive controls…

Teaching supplement · interactive 3D projection · one grid interval = one coordinate unit

xAₜxfinal null directionxyz0

Change the mathematics

Aₜ = diag(1.000, 1.000, 0); x = (1.000, 1.000, 1.000); Aₜx = (1.000, 1.000, 0). Rank = 2. null(A) = span{e₃}; range(A) = span{e₁,e₂}.

The dashed red cube is the original input. The green image occupies the output space. At t = 1, the amber input direction maps to zero. Rotating the camera cannot restore a dimension removed by the map.

Camera controls · change only the view

Drag the diagram with a mouse, or use these sliders with a keyboard or touch. Projection can make perpendicular directions look oblique; the coordinate readout is unchanged.

Red: input or first direction. Blue: second direction or reference. Green: result. Amber: residual, normal, or third direction. Labels distinguish overlapping objects.

Transfer

Can a 2×32\times3 matrix have a range equal to R3\mathbb R^3?

Check the output space

No. Its outputs lie in R2\mathbb R^2. Its nullspace lies in R3\mathbb R^3, but that is a different space with a different role.