Basis Vectors & Vector Spaces
WHY: Normal brain data uses 'neuron space' — each axis is one neuron. PCA finds a BETTER basis where each axis represents a pattern of population activity. Same data, different coordinate system — suddenly the structure becomes visible.
The standard basis in 2D is the axes you already know:
• e₁ = [1, 0] — the x-axis
• e₂ = [0, 1] — the y-axis
When you say a point is at (4, 2), you mean: 4 units along e₁, 2 units along e₂. You've been using a basis all along.
A basis is any set of vectors that:
1. Are linearly independent (no redundancy)
2. Span the entire space (you can reach any point)
You need exactly N basis vectors for N-dimensional space — no more, no less.
Subspace: a smaller space inside a bigger one. Example: a plane through the origin inside 3D space is a valid subspace. Neural population activity typically lives on a low-dimensional subspace of the full neuron space — PCA finds the axes of that subspace.
Switching to a better basis = PCA. Same data points, different axes — axes aligned with how the population actually varies.