Orthogonality · Definition
Orthogonal vectors
Before you start you need to know
It is the algebraic way of saying “perpendicular”, valid in any dimension; projections and orthogonal bases are built on top of it.
Definition
Two vectors of \(\mathbb{R}^n\) are orthogonal when their dot product is zero; geometrically, they are perpendicular.
In the plane, \(u\cdot v=\|u\|\|v\|\cos\theta\) vanishes with positive norms only when \(\cos\theta=0\), that is, at \(90^\circ\). In \(\mathbb{R}^n\) that computation is taken as the definition, so no picture is needed. The zero vector is orthogonal to everything, since \(0\cdot v=0\) for any \(v\); it is the only vector orthogonal to itself, because \(u\cdot u=\|u\|^2\).
The most used consequence is the Pythagorean theorem: if \(u\perp v\), then \(\|u+v\|^2=\|u\|^2+\|v\|^2\), because the cross term \(2\,u\cdot v\) disappears. For example, \((1,2)\) and \((-2,1)\) are orthogonal since \(-2+2=0\), and in the plane a vector orthogonal to \((a,b)\) is always obtained by rotating: \((-b,a)\).
The vectors orthogonal to a fixed nonzero \(u\) form a subspace: the equation \(u\cdot x=0\) is linear and homogeneous. In \(\mathbb{R}^3\) it is a plane through the origin; in \(\mathbb{R}^2\), a line. A common mistake is to think orthogonal and linearly independent mean the same: \((1,0)\) and \((1,1)\) are independent but not orthogonal. What is true is that nonzero, mutually orthogonal vectors are always independent.
This notion is the step before projecting one vector onto another: the remainder of a projection is precisely an orthogonal vector. Later it will be used to build bases of mutually perpendicular vectors, where coordinates are found with a single dot product.
Think about it
Why is \(0\) the only vector orthogonal to itself?
Because \(u\perp u\) means \(u\cdot u=\|u\|^2=0\), and the norm is zero only for the zero vector.
If \(u\perp v\) and \(u\perp w\), is \(u\) orthogonal to \(2v-3w\)?
Yes: \(u\cdot(2v-3w)=2\,u\cdot v-3\,u\cdot w=0\). That is why the vectors orthogonal to \(u\) form a subspace.
Exercises 10
- Which of the following pairs of vectors is orthogonal?
- For which value of \(k\) are \((k,3)\) and \((2,-4)\) orthogonal?
- Find \(k\) so that \((1,k,2)\) and \((3,-1,-1)\) are orthogonal.
- The zero vector of \(\mathbb{R}^n\) is orthogonal to:
- Which of these vectors is orthogonal to \((1,-2,2)\)?
- If \(u\) and \(v\) are orthogonal, \(\|u\|=3\) and \(\|v\|=4\), what is \(\|u+v\|\)?
- For any \((a,b)\neq(0,0)\), a vector orthogonal to \((a,b)\) in \(\mathbb{R}^2\) is:
- Let \(u,v\) be nonzero with \(u\cdot v=0\). Then:
- Which vector is orthogonal to both \((1,0,1)\) and \((0,1,1)\)?
- Let \(u\neq0\) in \(\mathbb{R}^3\). The set of vectors orthogonal to \(u\) is:
What comes next
References
- Gilbert Strang, Introduction to Linear Algebra, 6th edition, Wellesley-Cambridge Press, 2023. §4.1
- Sheldon Axler, Linear Algebra Done Right, 4th edition, Springer, 2024. §6.A