User:SirMeowMeow/sandbox/Vector Space

Definition
A vector space is one of the central objects of study in linear algebra. Any set which is compatible with the two operations of a vector space, namely vector addition and scaling, can be considered a vector space, and any element from this space is a vector.

To be compatible with vector scaling, a vector space must be accompanied with a field (or ring for generality), typically denoted $$\mathsf{F}$$ or $$\mathsf{K}$$. This field may sometimes be called the base, ground, or underlying field, and an element from a field may be called a scalar. When the context is clear, the mention of a field may be omitted.

The smallest vector space contains only the identity element under vector vector addition, and is known as the trivial vector space.

Abstract Definition
A vector space $$\mathcal{V}$$ over a field $$\mathsf{F}$$ is a set defined with an abelian addition $$+: \mathcal{V} \times \mathcal{V} \to \mathcal{V}$$ and a vector scaling function $$\mathsf{F} \times \mathcal{V} \to \mathcal{V}$$ of the form $$(\alpha, \vec{x}) \mapsto \alpha \vec{x}$$, such that:

Vector Addition

Where $$\vec{0}, \vec{x}, \vec{y}, \vec{z} \in \mathcal{V}$$.

Vector Scaling

Where $$1, \alpha, \beta \in \mathsf{F}$$.

Finite Definition
A finite list of $$n$$ scalars from $$\mathsf{F}$$ is written $$\mathsf{F}^n$$, and all finite-dimensional vector spaces are isomorphic or linearly equivalent to the vector space defined over $$\mathsf{F}^n$$.

Vector Addition
Let $$[x_1 \cdots x_n], [\ y_1 \cdots y_n] \in \mathsf{F}^n$$. Finite vector addition is defined as pointwise scalar addition.

Vector Scaling
Let $$\sigma \in \mathsf{F}$$ and $$[x_1 \cdots x_n] \in \mathsf{F}^n$$. Finite vector scaling is defined as pointwise scalar multiplication.

Functional Spaces
The vector space of polynomials forms an infinite-dimensional vector space.

Bitvectors
The field of two elements $$\{ 0, 1 \}$$ is considered the smallest field, and is named the Galois field of two elements, denoted as $$\operatorname{GF} (2)$$ or $$\mathsf{F}_2$$. Because this vector space does not admit any inner product, the dot product of two identical vectors from $$\mathsf{F}_2^n$$ may be zero.

Finite Vector Spaces
Finite vector spaces may be defined only with finite groups over finite fields with a prime order of elements, denoted $$\mathsf{F}_p^n$$ for any prime $$p$$.

Polynomial F[x]
The set of polynomial terms below spans $$\mathsf{F}[x]$$, and is countably infinite. The polynomials form a vector space because elements from $$\mathsf{F}[x]$$ form a commutative group, and because polynomials are closed under vector scaling.

A set polynomials are independent when trivial combination is the only zero polynomial.

The derivative is a linear endomorphism which is defined for all polynomials, and it's surjective but not injective. But for endomorphisms on finitely generated modules, surjectivity, injectivity, and isomorphism are all equivalent conditions. Thus $$\mathsf{F}[x]$$ forms an infinite-dimensional vector space.

Linear Combination
Let $$\mathcal{V} = \{ \vec{v}_1 \cdots \vec{v}_{n} \}$$ be a subset of a vector space, and let $$\sigma_1 \cdots \sigma_n \in \mathsf{F}$$. Then a linear combination of $$\mathcal{V}$$ is defined as any vector which is the sum of scaled vectors in $$\mathcal{V}$$.

A trivial combination means every $$\sigma_i = 0$$.

Span
Let $$\mathcal{V} = \{ \vec{v}_1 \cdots \vec{v}_n \}$$ be a subset of a vector space, and let $$\sigma_1 \cdots \sigma_n \in \mathsf{F}$$. Then the span of $$\mathcal{V}$$ is defined as the set of all combinations from $$\mathcal{V}$$.

The empty vector sum is defined as the additive identity $$\vec{0}$$, and thus the span of the empty set is the trivial vector space. Alternatively we can say that the span of any set generates the smallest vector space containing that set.

Independence
Let $$\mathcal{V} = \{ \vec{v}_1 \cdots \vec{v}_n \}$$ be a subset of a vector space, and let $$\sigma_1 \cdots \sigma_n \in \mathsf{F}$$. Then $$\mathcal{V}$$ is independent iff the trivial combination is the only vanishing sum.

Conversely, $$\mathcal{V}$$ is dependent if any non-trivial combination of $$\mathcal{V}$$ can be $$\vec{0}$$.

Observations

 * $$\mathcal{V}$$ is independent iff the removal of any vector changes the span.
 * $$\mathcal{V}$$ is independent iff no vector in $$\mathcal{V}$$ can be expressed as a combination of other vectors in $$\mathcal{V}$$.

Basis and Dimension
The basis of a vector space $$\mathcal{V}$$ is any independent set whose span is exactly $$\mathcal{V}$$, and the elements of a basis are called basis vectors. The dimension of $$\mathcal{V}$$ is the number of vectors or cardinality of its basis, written as $$\dim(\mathcal{V})$$.

If the basis of $$\mathcal{V}$$ has finite cardinality, then $$\mathcal{V}$$ is defined as a finite-dimensional vector space; otherwise, $$\mathcal{V}$$ is an infinite-dimensional vector space.

Observations

 * Every vector space has a basis.
 * All choices of basis for a vector space will have the same cardinality.
 * Any independent subset of $$\mathcal{V}$$ which isn't spanning can be expanded into a basis.
 * Any dependent subset which spans $$\mathcal{V}$$ can remove vectors until it is a basis.

Linear Subspace
A linear subspace of a vector space $$\mathcal{V}$$ is any subset which is also a vector space under the same abelian addition and vector scaling as $$\mathcal{V}$$. The trivial vector space is the smallest subspace which contains only the identity element of vector addition.

The subspaces $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ are independent iff for any pair of subspaces the only vector in common is $$\vec{0}$$. Thus for any pair of independent subspaces their intersection is the trivial subspace.


 * $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ is independent iff the trivial combination is the unique vanishing sum.
 * $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ is independent iff every subspace contributes to the span of the subspace sum.

Sum of Subspaces
The sum of subspaces $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ is the set of all vector sums with summands drawn from each corresponding subspace.

Direct Sum of Subspaces
A list of subspaces $$\mathcal{V}_1 \cdots \mathcal{V}_n \subseteq \mathcal{V}$$ is independent if for any pair of subspaces the only vector in common is $$\vec{0}$$. Thus for any pair of independent subspaces their intersection is the trivial subspace.

The direct sum of subspaces $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ is sum of independent subspaces, and is written:


 * $$\dim (\mathcal{V}_1 + \mathcal{V}_2) = \dim (\mathcal{V}_1) + \dim (\mathcal{V}_2) - \dim(\mathcal{V}_1 \cap \mathcal{V}_2)$$
 * $$\dim (\mathcal{V}_1 \oplus \mathcal{V}_2) = \dim (\mathcal{V}_1) + \dim (\mathcal{V}_2)$$

Cartesian Product of Subspaces
Let $$\mathcal{V}_1 \cdots \mathcal{V}_n$$ be vector spaces over the same field. Then the cartesian product of these spaces is defined as the set of all lists whose indexed elements are drawn from their corresponding vector spaces:


 * $$\dim (\mathcal{V}_1 \times \cdots \times \mathcal{V}_n) = \dim \mathcal{V}_1 + \cdots + \dim \mathcal{V}_n $$

Maps on Vector Spaces
A mapping between vector spaces which preserves vector addition and scaling may be known as a linear map, operator, homomorphism, or function.

Let $$\mathcal{V}, \mathcal{W}$$ be vector spaces over a ring or field $$\mathsf{F}$$. Then a linear map $$\Phi : \mathcal{V} \to \mathcal{W}$$ is defined as any mapping such that:

Where $$\sigma_i \in \mathsf{F}$$, and $$\vec{v}_i \in \mathcal{V}$$, and $$\vec{w}_i \in \mathcal{W}$$.

Observations

 * Linear combinations in $$\mathcal{V}$$ are mapped to linear combinations in $$\mathcal{W}$$.
 * Group homomorphism implies identity is mapped to identity, and inverses are mapped to inverses: $$\vec{v} + (-\vec{v}) \mapsto \vec{w} + (-\vec{w})$$.

Inner Product Spaces
Let $$\mathcal{V}$$ be a vector space over a field $$\mathsf{F}$$. An inner product is a mapping $$\langle \cdot, \cdot \rangle : \mathcal{V} \times \mathcal{V} \to \mathsf{F}$$ such that:

A vector space for which an inner product can be defined is called an inner product space.

Dot Product
Let $$\vec{x} = [x_1 \cdots x_n], \ \vec{y} = [y_1 \cdots y_n]$$ be from the vector space $$\mathcal{V}$$ over a field $$\mathsf{F}$$. Then dot product is a map $$\mathcal{V} \times \mathcal{V} \to \mathsf{F}$$ such that: For vector spaces where the dot product qualifies as an inner product, the dot product is known as a definition for Euclidean distance.

Affine Subset
Let $$\mathcal{V}_1$$ be a subset of the vector space $$\mathcal{V}$$. Then an affine subset can be defined as the set:

Any affine subset $$\vec{v} + \mathcal{V}_1$$ is defined as parallel to $$\mathcal{V}_1$$.

Vector Space of Affine Subsets
Let $$\mathcal{V}_1$$ be a subset of the vector space $$\mathcal{V}$$, and let $$\vec{v}, \vec{w} \in \mathcal{V}$$.

Quotient Space
The quotient space $$\mathcal{V} / \mathcal{V}_1$$ is defined as the set of affine subsets which are parallel to $$\mathcal{V}_1$$.


 * $$\dim \mathcal{V} / \mathcal{V}_1 = \dim \mathcal{V} - \dim \mathcal{V}_1$$

Quotient Map
Let $$\mathcal{V}_1$$ be a linear subspace of $$\mathcal{V}$$. The quotient map $$\pi : \mathcal{V} \to \mathcal{V} / \mathcal{V}_1$$ is defined: