← Module 01 / Getting started & notation

Lesson 01.2 · §2 Notation

A field guide to the symbols

Translate every entry in the source’s notation table into words and a small example.

In this lesson 6 ideas
  1. Read the sentence inside the symbol
  2. Objects: where the numbers live
  3. Operations: what to do with an object
  4. Probability: describe uncertainty
  5. One capital letter can change the question
  6. Context beats memorization

Read the sentence inside the symbol

Notation saves space. It does not replace meaning. When a symbol looks unfamiliar, ask: “What kind of object is this? What operation is happening? What are the inputs?”

Explore it yourself

A symbol is a compressed sentence

Choose a symbol. Read its meaning before trying to memorize its shape.

Preparing interactive controls…

ℝ

Real numbers

The set of real numbers.

−2, 0, ½, √2, and π are real numbers.

Objects: where the numbers live

The following tables preserve every entry in the source notation table. The examples and reading advice are teaching additions.

Source symbolMeaningA small example
R\mathbb RThe set of real numbers−2-2, 1/21/2, and 2\sqrt2 belong to it.
Rn\mathbb R^nThe vector space of real n-tuples, endowed with the usual inner product(2,1,−3)∈R3(2,1,-3)\in\mathbb R^3; the usual inner product is the sum of component-wise products.
Rm×n\mathbb R^{m\times n}The vector space of real m-by-n matricesTwo rows and three columns gives a 2×32\times3 matrix.

The superscript in R3\mathbb R^3 counts coordinates. It does not mean “cube each number.” The m×nm\times n specifies rows first, columns second.

Operations: what to do with an object

Source symbolMeaningA small example
δij\delta_{ij}Kronecker delta: 1 when i=ji=j, 0 otherwiseδ22=1\delta_{22}=1 and δ23=0\delta_{23}=0.
∇f(x)\nabla f(\mathbf x)Gradient of ff at x\mathbf xFor f(x1,x2)=x12+3x2f(x_1,x_2)=x_1^2+3x_2, the gradient is (2x1,3)⊤(2x_1,3)^\top.
∇2f(x)\nabla^2 f(\mathbf x)Hessian of ff at x\mathbf xFor the same function, the second-derivative matrix is [2000]\begin{bmatrix}2&0\\0&0\end{bmatrix}.
A⊤\mathbf A^\topTranspose of matrix A\mathbf AIts (i,j)(i,j) entry becomes the (j,i)(j,i) entry.

The 2 in ∇2\nabla^2 signals second derivatives; it does not mean squaring each entry of the gradient. Kronecker delta is an equality indicator, not a derivative or an arbitrarily small change.

Probability: describe uncertainty

Source symbolMeaningA small example or reading cue
Ω\OmegaSample spaceFor a coin flip, {H,T}\{H,T\}.
P(A)P(A)Probability of event AP({H})=1/2P(\{H\})=1/2 for a fair coin.
p(X)p(X)Distribution of random variable XThe whole probability description of X.
p(x)p(x)Probability mass/density function evaluated at xThe value of the relevant function at a particular input.
AcA^cComplement of event AAll outcomes in Ω\Omega outside A.
A∪˙BA\mathbin{\dot\cup}BUnion with the extra requirement A∩B=∅A\cap B=\varnothingFor disjoint events, no outcome belongs to both.
E[X]E[X]Expected value of XA probability-weighted average.
Var⁡(X)\operatorname{Var}(X)Variance of XAverage squared distance from its mean.
Cov⁡(X,Y)\operatorname{Cov}(X,Y)Covariance of X and YAverage product of their deviations from their means.

The interactive picker uses ⊔\sqcup as a readable alternate mark for disjoint union; the source uses a dotted union. The condition “no overlap” is essential with either notation.

One capital letter can change the question

Let XX be the outcome of a fair die, and let x=3x=3 be one particular value. The notation p(X)p(X) refers to the distribution over all six outcomes; p(3)=1/6p(3)=1/6 evaluates its mass function at one outcome. P(X∈{2,4,6})=1/2P(X\in\{2,4,6\})=1/2 asks about an event containing three outcomes.

For a continuous variable with a density, density is not point probability. A density can exceed 1. Probabilities come from integrating over intervals. Module 7 will explain this carefully; the symbol table introduces the distinction now.

Make a prediction

Which expression refers to the entire distribution in the source’s convention?

Context beats memorization

Capital Roman letters can name matrices or random variables. Read the surrounding definition. The notation AA in “P(A)P(A)” names an event; bold A\mathbf A usually names a matrix. The next lesson makes these conventions explicit.