- **Tensor Algebra**: This constructs new spaces that linearize multilinear maps via a **universal property**.
- **Exterior Algebra**: The study of alternating forms and the **wedge product**. This is essential for defining the determinant and forms the basis for differential geometry.
## 5. Infinite-Dimensional Extensions
Finally, the curriculum bridges into **Functional Analysis**. This involves the study of **Hilbert and Banach spaces**, where the vectors are often functions and the dimensions are infinite. This transition requires integrating linear algebra with topology to handle issues of convergence and continuity.# Graduate Linear Algebra: A Synthesis of Foundations and Theory
The transition to graduate-level linear algebra represents a shift from computational matrix manipulation toward the rigorous analysis of **abstract vector spaces** and **linear operators**. This curriculum provides the theoretical framework necessary for advanced study in pure mathematics, physics, and data science.
## 1. Algebraic Foundations and Duality
At the graduate level, spaces are defined over a **field**, a mathematical structure (such as real or complex numbers) where arithmetic operations are consistent. An **abstract vector space** consists of elements that obey specific axioms under addition and scalar multiplication.
Central to this study is the **dual space**, the vector space of all **linear functionals**—mappings that transform vectors into scalars. Understanding the relationship between a space and its **double dual** is a cornerstone of functional analysis. Key theorems include the **Rank-Nullity Theorem**, which relates the dimensions of a transformation’s **kernel** (the set of vectors mapped to zero) and its **image** (the output space).
## 2. Spectral Theory and Canonical Forms
Spectral theory investigates the internal structure of linear operators through their **eigenvalues** and **eigenvectors**. The goal is to find a basis that simplifies the representation of an operator.
- **Diagonalization**: The process of representing an operator as a diagonal matrix, possible only when a complete set of eigenvectors exists.
- **Jordan Canonical Form**: A block-diagonal representation used for operators that cannot be diagonalized, applicable over algebraically closed fields.
- **Rational Canonical Form**: A more general decomposition based on the theory of **Modules over a Principal Ideal Domain (PID)**, which does not require the field to be algebraically closed.
## 3. Inner Product Spaces and Geometry
By introducing an **inner product**—a positive-definite mapping used to define angles and lengths—vector spaces gain geometric structure.
- **Orthogonality**: Using the **Gram-Schmidt process**, researchers can construct orthonormal bases, which are essential for stable computations.
- **The Spectral Theorem**: This provides the conditions under which an operator can be diagonalized by a unitary transformation, specifically for normal or self-adjoint operators.
- **Singular Value Decomposition (SVD)**: A fundamental tool for dimensionality reduction, generalizing eigendecomposition to any matrix.
## 4. Multilinear Algebra and Tensors
Graduate studies extend linear concepts to higher-order structures through **multilinear algebra**.
- **Tensor Products**: A method of constructing new spaces that linearizes multilinear maps, governed by a **universal property**.
- **Exterior Algebra**: The study of alternating forms and the **wedge product**, which is critical for defining determinants and for applications in differential geometry.
## 5. Advanced Applications
The curriculum concludes with two divergent paths:
1. **Numerical Linear Algebra**: Focuses on the stability and efficiency of **matrix factorizations** (such as **LU** or **QR decomposition**) and iterative methods for large-scale systems.
2. **Infinite-Dimensional Spaces**: The study of **Hilbert and Banach spaces**, which forms the bridge to functional analysis and quantum mechanics.