Sequence space

In functional analysis and related areas of mathematics, a sequence space is a vector space whose elements are infinite sequences of real or complex numbers. Equivalently, it is a function space whose elements are functions from the natural numbers to the field K of real or complex numbers. The set of all such functions is naturally identified with the set of all possible infinite sequences with elements in K, and can be turned into a vector space under the operations of pointwise addition of functions and pointwise scalar multiplication. All sequence spaces are linear subspaces of this space. Sequence spaces are typically equipped with a norm, or at least the structure of a topological vector space.

The most important sequence spaces in analysis are the $ℓ$ spaces, consisting of the $p$-power summable sequences, with the p-norm. These are special cases of Lp spaces for the counting measure on the set of natural numbers. Other important classes of sequences like convergent sequences or null sequences form sequence spaces, respectively denoted c and c0, with the sup norm. Any sequence space can also be equipped with the topology of pointwise convergence, under which it becomes a special kind of Fréchet space called FK-space.

Definition
A sequence $$x_{\bull} = \left(x_n\right)_{n \in \N}$$ in a set $$X$$ is just an $$X$$-valued map $$x_{\bull} : \N \to X$$ whose value at $$n \in \N$$ is denoted by $$x_n$$ instead of the usual parentheses notation $$x(n).$$

Space of all sequences
Let $$\mathbb{K}$$ denote the field either of real or complex numbers. The set $$\mathbb{K}^{\N}$$ of all sequences of elements of $$\mathbb{K}$$ is a vector space for componentwise addition
 * $$\left(x_n\right)_{n \in \N} + \left(y_n\right)_{n \in \N} = \left(x_n + y_n\right)_{n \in \N},$$

and componentwise scalar multiplication
 * $$\alpha\left(x_n\right)_{n \in \N} = \left(\alpha x_n\right)_{n \in \N}.$$

A sequence space is any linear subspace of $$\mathbb{K}^{\N}.$$

As a topological space, $$\mathbb{K}^{\N}$$ is naturally endowed with the product topology. Under this topology, $$\mathbb{K}^{\N}$$ is Fréchet, meaning that it is a complete, metrizable, locally convex topological vector space (TVS). However, this topology is rather pathological: there are no continuous norms on $$\mathbb{K}^{\N}$$ (and thus the product topology cannot be defined by any norm). Among Fréchet spaces, $$\mathbb{K}^{\N}$$ is minimal in having no continuous norms:

But the product topology is also unavoidable: $$\mathbb{K}^{\N}$$ does not admit a strictly coarser Hausdorff, locally convex topology. For that reason, the study of sequences begins by finding a strict linear subspace of interest, and endowing it with a topology different from the subspace topology.

$ℓ^{p}$ spaces
For $$0 < p < \infty,$$ $$\ell^p$$ is the subspace of $$\mathbb{K}^{\N}$$ consisting of all sequences $$x_{\bull} = \left(x_n\right)_{n \in \N}$$ satisfying $$\sum_n |x_n|^p < \infty.$$

If $$p \geq 1,$$ then the real-valued function $$\|\cdot\|_p$$ on $$\ell^p$$ defined by $$\|x\|_p ~=~ \left(\sum_n|x_n|^p\right)^{1/p} \qquad \text{ for all } x \in \ell^p$$ defines a norm on $$\ell^p.$$ In fact, $$\ell^p$$ is a complete metric space with respect to this norm, and therefore is a Banach space.

If $$p = 2$$ then $$\ell^2$$ is also a Hilbert space when endowed with its canonical inner product, called the , defined for all $$x_\bull, y_\bull \in \ell^p$$ by $$\langle x_\bull, y_\bull \rangle ~=~ \sum_n \overline{x_n} y_n.$$ The canonical norm induced by this inner product is the usual $$\ell^2$$-norm, meaning that $$\|\mathbf{x}\|_2 = \sqrt{\langle \mathbf{x}, \mathbf{x} \rangle}$$ for all $$\mathbf{x} \in \ell^p.$$

If $$p = \infty,$$ then $$\ell^{\infty}$$ is defined to be the space of all bounded sequences endowed with the norm $$\|x\|_\infty ~=~ \sup_n |x_n|,$$ $$\ell^{\infty}$$ is also a Banach space.

If $$0 < p < 1,$$ then $$\ell^p$$ does not carry a norm, but rather a metric defined by $$d(x,y) ~=~ \sum_n \left|x_n - y_n\right|^p.\,$$

c, c0 and c00
A is any sequence $$x_{\bull} \in \mathbb{K}^{\N}$$ such that $$\lim_{n \to \infty} x_n$$ exists. The set of all convergent sequences is a vector subspace of $$\mathbb{K}^{\N}$$ called the c space. Since every convergent sequence is bounded, $$c$$ is a linear subspace of $$\ell^{\infty}.$$ Moreover, this sequence space is a closed subspace of $$\ell^{\infty}$$ with respect to the supremum norm, and so it is a Banach space with respect to this norm.

A sequence that converges to $$0$$ is called a and is said to. The set of all sequences that converge to $$0$$ is a closed vector subspace of $$c$$ that when endowed with the supremum norm becomes a Banach space that is denoted by and is called the  or the.

The, is the subspace of $$c_0$$ consisting of all sequences which have only finitely many nonzero elements. This is not a closed subspace and therefore is not a Banach space with respect to the infinity norm. For example, the sequence $$\left(x_{nk}\right)_{k \in \N}$$ where $$x_{nk} = 1/k$$ for the first $$n$$ entries (for $$k = 1, \ldots, n$$) and is zero everywhere else (that is, $$\left(x_{nk}\right)_{k \in \N} = \left(1, 1/2, \ldots, 1/(n-1), 1/n, 0, 0, \ldots\right)$$) is a Cauchy sequence but it does not converge to a sequence in $$c_{00}.$$

Space of all finite sequences
Let
 * $$\mathbb{K}^{\infty}=\left\{\left(x_1, x_2,\ldots\right)\in\mathbb{K}^{\N}:\text{all but finitely many }x_i\text{ equal }0\right\}

$$,

denote the space of finite sequences over $$\mathbb{K}$$. As a vector space, $$\mathbb{K}^{\infty}$$ is equal to $$c_{00}$$, but $$\mathbb{K}^{\infty}$$ has a different topology.

For every natural number $n \in \N$, let $$\mathbb{K}^n$$ denote the usual Euclidean space endowed with the Euclidean topology and let $$\operatorname{In}_{\mathbb{K}^n} : \mathbb{K}^n \to \mathbb{K}^{\infty}$$ denote the canonical inclusion
 * $$\operatorname{In}_{\mathbb{K}^n}\left(x_1, \ldots, x_n\right) = \left(x_1, \ldots, x_n, 0, 0, \ldots \right)$$.

The image of each inclusion is
 * $$\operatorname{Im} \left( \operatorname{In}_{\mathbb{K}^n} \right)

= \left\{ \left(x_1, \ldots, x_n, 0, 0, \ldots \right) : x_1, \ldots, x_n \in \mathbb{K} \right\} = \mathbb{K}^n \times \left\{ (0, 0, \ldots) \right\}$$ and consequently,
 * $$\mathbb{K}^{\infty} = \bigcup_{n \in \N} \operatorname{Im} \left( \operatorname{In}_{\mathbb{K}^n} \right).$$

This family of inclusions gives $$\mathbb{K}^{\infty}$$ a final topology $$\tau^{\infty}$$, defined to be the finest topology on $$\mathbb{K}^{\infty}$$ such that all the inclusions are continuous (an example of a coherent topology). With this topology, $$\mathbb{K}^{\infty}$$ becomes a complete, Hausdorff, locally convex, sequential, topological vector space that is Fréchet–Urysohn. The topology $$\tau^{\infty}$$ is also strictly finer than the subspace topology induced on $$\mathbb{K}^{\infty}$$ by $$\mathbb{K}^{\N}$$.

Convergence in $$\tau^{\infty}$$ has a natural description: if $$v \in \mathbb{K}^{\infty}$$ and $$v_{\bull}$$ is a sequence in $$\mathbb{K}^{\infty}$$ then $$v_{\bull} \to v$$ in $$\tau^{\infty}$$ if and only $$v_{\bull}$$ is eventually contained in a single image $$\operatorname{Im} \left( \operatorname{In}_{\mathbb{K}^n} \right)$$ and $$v_{\bull} \to v$$ under the natural topology of that image.

Often, each image $$\operatorname{Im} \left( \operatorname{In}_{\mathbb{K}^n} \right)$$ is identified with the corresponding $$\mathbb{K}^n$$; explicitly, the elements $$\left( x_1, \ldots, x_n \right) \in \mathbb{K}^n$$ and $$\left( x_1, \ldots, x_n, 0, 0, 0, \ldots \right)$$ are identified. This is facilitated by the fact that the subspace topology on $$\operatorname{Im} \left( \operatorname{In}_{\mathbb{K}^n} \right)$$, the quotient topology from the map $$\operatorname{In}_{\mathbb{K}^n}$$, and the Euclidean topology on $$\mathbb{K}^n$$ all coincide. With this identification, $$\left( \left(\mathbb{K}^{\infty}, \tau^{\infty}\right), \left(\operatorname{In}_{\mathbb{K}^n}\right)_{n \in \N}\right)$$ is the direct limit of the directed system $$\left( \left(\mathbb{K}^n\right)_{n \in \N}, \left(\operatorname{In}_{\mathbb{K}^m\to\mathbb{K}^n}\right)_{m \leq n\in\N},\N \right),$$ where every inclusion adds trailing zeros:
 * $$\operatorname{In}_{\mathbb{K}^m\to\mathbb{K}^n}\left(x_1, \ldots, x_m\right) = \left(x_1, \ldots, x_m, 0, \ldots, 0 \right)$$.

This shows $$\left(\mathbb{K}^{\infty}, \tau^{\infty}\right)$$ is an LB-space.

Other sequence spaces
The space of bounded series, denote by bs, is the space of sequences $$x$$ for which
 * $$\sup_n \left\vert \sum_{i=0}^n x_i \right\vert < \infty.$$

This space, when equipped with the norm
 * $$\|x\|_{bs} = \sup_n \left\vert \sum_{i=0}^n x_i \right\vert,$$

is a Banach space isometrically isomorphic to $$\ell^{\infty},$$ via the linear mapping
 * $$(x_n)_{n \in \N} \mapsto \left(\sum_{i=0}^n x_i\right)_{n \in \N}.$$

The subspace cs consisting of all convergent series is a subspace that goes over to the space c under this isomorphism.

The space Φ or $$c_{00}$$ is defined to be the space of all infinite sequences with only a finite number of non-zero terms (sequences with finite support). This set is dense in many sequence spaces.

Properties of ℓp spaces and the space c0
The space ℓ2 is the only ℓp space that is a Hilbert space, since any norm that is induced by an inner product should satisfy the parallelogram law


 * $$\|x+y\|_p^2 + \|x-y\|_p^2= 2\|x\|_p^2 + 2\|y\|_p^2.$$

Substituting two distinct unit vectors for x and y directly shows that the identity is not true unless p&thinsp;=&thinsp;2.

Each $ℓ^{p}$ is distinct, in that $ℓ^{p}$ is a strict subset of $ℓ^{s}$ whenever p&thinsp;<&thinsp;s; furthermore, $ℓ^{p}$ is not linearly isomorphic to $ℓ^{s}$ when $p ≠ s$. In fact, by Pitt's theorem, every bounded linear operator from $ℓ^{s}$ to $ℓ^{p}$ is compact when $p < s$. No such operator can be an isomorphism; and further, it cannot be an isomorphism on any infinite-dimensional subspace of $ℓ^{s}$, and is thus said to be strictly singular.

If 1&thinsp;<&thinsp;p&thinsp;<&thinsp;∞, then the (continuous) dual space of ℓp is isometrically isomorphic to ℓq, where q is the Hölder conjugate of p: 1/p + 1/q = 1. The specific isomorphism associates to an element x of $ℓ^{q}$ the functional $$L_x(y) = \sum_n x_n y_n$$ for y in $ℓ^{p}$. Hölder's inequality implies that Lx is a bounded linear functional on $ℓ^{p}$, and in fact $$|L_x(y)| \le \|x\|_q\,\|y\|_p$$ so that the operator norm satisfies
 * $$\|L_x\|_{(\ell^p)^*} \stackrel{\rm{def}}{=}\sup_{y\in\ell^p, y\not=0} \frac{|L_x(y)|}{\|y\|_p} \le \|x\|_q.$$

In fact, taking y to be the element of $ℓ^{p}$ with
 * $$y_n = \begin{cases}

0&\text{if}\ x_n=0\\ x_n^{-1}|x_n|^q &\text{if}~ x_n \neq 0 \end{cases}$$ gives Lx(y) = ||x||q, so that in fact
 * $$\|L_x\|_{(\ell^p)^*} = \|x\|_q.$$

Conversely, given a bounded linear functional L on $ℓ^{p}$, the sequence defined by $x_{n} = L(e_{n})$ lies in ℓq. Thus the mapping $$x\mapsto L_x$$ gives an isometry $$\kappa_q : \ell^q \to (\ell^p)^*.$$

The map
 * $$\ell^q\xrightarrow{\kappa_q}(\ell^p)^*\xrightarrow{(\kappa_q^*)^{-1}}(\ell^q)^{**}$$

obtained by composing κp with the inverse of its transpose coincides with the canonical injection of ℓq into its double dual. As a consequence ℓq is a reflexive space. By abuse of notation, it is typical to identify ℓq with the dual of ℓp: (ℓp)* = ℓq. Then reflexivity is understood by the sequence of identifications (ℓp)** = (ℓq)* = ℓp.

The space c0 is defined as the space of all sequences converging to zero, with norm identical to ||x||∞. It is a closed subspace of ℓ∞, hence a Banach space. The dual of c0 is ℓ1; the dual of ℓ1 is ℓ∞. For the case of natural numbers index set, the ℓp and c0 are separable, with the sole exception of ℓ∞. The dual of ℓ∞ is the ba space.

The spaces c0 and ℓp (for 1 ≤ p < ∞) have a canonical unconditional Schauder basis {ei | i = 1, 2,...}, where ei is the sequence which is zero but for a 1 in the i&thinsp;th entry.

The space ℓ1 has the Schur property: In ℓ1, any sequence that is weakly convergent is also strongly convergent. However, since the weak topology on infinite-dimensional spaces is strictly weaker than the strong topology, there are nets in ℓ1 that are weak convergent but not strong convergent.

The ℓp spaces can be embedded into many Banach spaces. The question of whether every infinite-dimensional Banach space contains an isomorph of some ℓp or of c0, was answered negatively by B. S. Tsirelson's construction of Tsirelson space in 1974. The dual statement, that every separable Banach space is linearly isometric to a quotient space of ℓ1, was answered in the affirmative by. That is, for every separable Banach space X, there exists a quotient map $$Q:\ell^1 \to X$$, so that X is isomorphic to $$\ell^1 / \ker Q$$. In general, ker Q is not complemented in ℓ1, that is, there does not exist a subspace Y of ℓ1 such that $$\ell^1 = Y \oplus \ker Q$$. In fact, ℓ1 has uncountably many uncomplemented subspaces that are not isomorphic to one another (for example, take $$X=\ell^p$$; since there are uncountably many such Xs, and since no ℓp is isomorphic to any other, there are thus uncountably many ker Qs).

Except for the trivial finite-dimensional case, an unusual feature of ℓp is that it is not polynomially reflexive.

ℓp spaces are increasing in p
For $$p\in[1,\infty]$$, the spaces $$\ell^p$$ are increasing in $$p$$, with the inclusion operator being continuous: for $$1\le pp$$. But if $$\|x\|_p = 1$$, then $$|x_i|\le 1$$ for all $$i$$, and then $$\textstyle\sum |x_i|^q \le \textstyle\sum |x_i|^p = 1$$.

ℓ2 is isomorphic to all separable, infinite dimensional Hilbert spaces
Let H be a separable Hilbert space. Every orthogonal set in H is at most countable (i.e. has finite dimension or $$\,\aleph_0\,$$). The following two items are related:
 * If H is infinite dimensional, then it is isomorphic to ℓ2
 * If $dim(H) = N$, then H is isomorphic to $$\Complex^N$$

Properties of ℓ1 spaces
A sequence of elements in ℓ1 converges in the space of complex sequences ℓ1 if and only if it converges weakly in this space. If K is a subset of this space, then the following are equivalent: Here K being equismall at infinity means that for every $$\varepsilon > 0$$, there exists a natural number $$n_{\varepsilon} \geq 0$$ such that $\sum_{n = n_{\epsilon}}^{\infty} | s_n | < \varepsilon$ for all $$s = \left( s_n \right)_{n=1}^{\infty} \in K$$.
 * 1) K is compact;
 * 2) K is weakly compact;
 * 3) K is bounded, closed, and equismall at infinity.