analysis-0

This note is my bird’s eye view of analysis, espeically developing key ideas in metric spaces and continuity to make our life easier later. Analysis is about problems, counter-examples, and crafting of clever inequality among many other things (not that I would know :)) and we will do plenty of that to come

Analysis-0 - Metric Spaces

In order to do analysis, one needs a notion of distance, and one of the biggest traps is to blindly borrow intuition from R\mathbb{R} or R2\mathbb{R}^2, so we will borrow with our eyes open.

0 - Metric Spaces and Open Balls

a set XX and a map d:X2R0d: X^2 \to \mathbb{R}_{\geq 0} is called a metric space if:

  • d(x,y)=0    x=yd(x,y) = 0 \iff x = y for any x,yXx,y \in X
  • d(x,y)=d(y,x)d(x,y) = d(y,x) for any x,yXx,y \in X
  • d(x,z)+d(z,y)d(x,y)d(x,z)+d(z,y) \ge d(x,y) for any x,y,zXx,y,z \in X (triangle inequality)

We will work with two objects very often, one is open balls, and the other is punctured open balls:

let XX be a metric space, for any x0Xx_{0} \in X and any r>0r > 0, the set Br(x0):={xX:d(x,x0)<r}B_{r}(x_{0}) := \{x\in X: d(x,x_{0}) < r\} is called an open ball (or open neighbourhood) of x0x_{0} with radius rr.

The set Br×(x0):=Br(x0){x0}B_{r}^\times(x_{0}):= B_{r}(x_{0}) - \{x_{0}\} we will call a punctured open ball. Notice that an open ball is always nonempty, (it has its centre at least) whereas the punctured open ball may be empty.

TikZ diagram

Indeed, if we have a “set without its boundary” intuitively, we know that any point inside, will have some (perhaps really small) open ball around it, completely contained inside that set.

Let UXU \subset X, we say uUu \in U is an interior point if there exists some ϵ>0\epsilon > 0 for which Bϵ(u)UB_{\epsilon}(u) \subset U.

We say UU is open if every uUu \in U is an interior point of UU.

if XX is a metric space, we see (vacuously) that \emptyset is open, and XX is open too.

Extremal Examples

Now, in analysis, we want to hunt for extremal examples. Is there a metric space where all subsets are open? consider Z\mathbb{Z} with the usual metric d(x,y)=yxd(x,y) = |y-x|. Choose ϵ=0.01\epsilon = 0.01, now let UZU \subset \mathbb{Z} and uUu \in U, notice that Bϵ(u)={u}UB_{\epsilon}(u) = \{u\} \subset U.

Is there a metric space where the only open sets are the trivial ones? suppose XX had at least two points x,yx,y, and let d=d(x,y)>0d^* = d(x,y) > 0. then Bd(x)B_{d^*}(x) is nonempty since it contains xx, and it is not all of XX since it does not contain yy. thus XX has a nontrivial open set.

therefore, the metric topology on XX is trivial if and only if X1|X| \leq 1.

1 - Limit Points and Closed Sets

The next object of concern is limit points. let XX be a metric space and UXU \subset X. we say pXp \in X is a limit point, if for any ϵ>0\epsilon > 0, Bϵ×(p)UB^\times_{\epsilon}(p) \cap U \neq \emptyset. That is, any punctured ball around pp has elements in UU.

It is quite evident that if pp is a limit point of UU any ball around pp has an infinite number of elements in UU.

For the sake of contradiction, suppose for some ϵ>0\epsilon^* > 0, Bϵ×(p)UB^\times_{\epsilon^*}(p) \cap U has only a finite number of elements: u1,u2,,unu_{1},u_{2},\dots,u_{n}. set γ=min(d(p,u1),d(p,u2),,d(p,un))\gamma = \min(d(p,u_{1}),d(p,u_{2}),\dots,d(p,u_{n})).

Now notice that Bγ×(p)UBϵ×(p)UB^\times_{\gamma}(p) \cap U \subset B^\times_{\epsilon^*}(p) \cap U, but by the choice of γ\gamma, none of u1,,unu_1,\dots,u_n is in Bγ×(p)B^\times_{\gamma}(p). thus, Bγ×(p)U=B^\times_{\gamma}(p) \cap U = \emptyset, which contradicts the fact that pp is a limit point of UU.

we say a set is closed, if it contains all its limit points.

Closed Sets and Open Complements

Now, we shall prove here, as a theorem, what is taken as a definition in topology.

let XX be a metric space and UXU \subset X, then UU is closed if and only if XUX-U is open.

TikZ diagram

suppose UU is closed, and let xXUx \in X-U. since UU contains all its limit points, xx is not a limit point of UU. thus, for some r>0r > 0, Br×(x)U=B^\times_r(x) \cap U = \emptyset. since xUx \notin U, we also have Br(x)U=B_r(x) \cap U = \emptyset, ie Br(x)XUB_r(x) \subset X-U. that is xx is interior in XUX-U. thus XUX-U is open.

The other direction is very straightforward. Suppose XUX-U is open, and pp is a limit point of UU, further suppose p∉Up \not \in U, thus pp is interior to XUX-U, contradicting that pp is a limit point of UU.

2 - The Metric Topology and Continuous Maps

The next claim we will make is that open balls, are the basis which generate the metric topology of a metric space.

What do we require of basis? we need them to be open and cover the space, we need for any point in the intersection of two basis another basis contained in that intersection containing the point. Such things are satisfied by open balls.

Next we will show that any open set is a union of open balls. This is true because in the metric space definition, every point inside an open set is interior, thus has an open ball completely contained in the open set. Thus we can take the union of all such balls.

Open Sets Form a Topology

Next we will show that open sets in the metric sense form a topology: let XX be a metric space: of course ,X\emptyset, X are open.

now, suppose UαU_{\alpha}, αA\alpha \in A is a collection of open sets. let uαAUαu \in \bigcup_{\alpha \in A} U_{\alpha}, of course, for some α\alpha^*, uUαu \in U_{\alpha^*}, ie some Br(u)UαB_{r}(u) \subset U_{\alpha^*}. Therefore, obviously, Br(u)αAUαB_{r}(u) \subset \bigcup_{\alpha \in A} U_{\alpha}, thus uu is interior in the union of that collection.

now let UiU_{i}, 1in1 \leq i \leq n be a finite collection of open sets. let ui=1nUiu \in \bigcap_{i=1}^nU_{i}, of course then, there exists rir_{i}, 1in1 \leq i \leq n such that Bri(u)UiB_{r_{i}}(u) \subset U_{i}.

now, let r=min(r1,r2,,rn)r^* = \min(r_{1},r_{2},\dots,r_{n}), then for any ii, Br(u)Bri(u)UiB_{r^*}(u) \subset B_{r_i}(u) \subset U_{i}.

ie, Br(u)i=1nUiB_{r^*}(u) \subset \bigcap_{i=1}^nU_{i}.

Continuous Maps Between Metric Spaces

Now, if f:XYf: X \to Y is a map between metric spaces, we have two definitions of continuity, and they better be equivalent:

  • ff is continuous if pre-images of open sets are open, (in the metric topology).
  • for each x0Xx_{0} \in X and each ϵ>0\epsilon > 0, there exists δ>0\delta > 0 such that dX(x,x0)<δd_{X}(x,x_{0})< \delta implies dY(f(x),f(x0))<ϵd_{Y}(f(x), f(x_{0})) < \epsilon.

suppose ff is continuous as given by the first definition.

let x0Xx_{0} \in X, consider any Bϵ(f(x0))B_{\epsilon}(f(x_{0})). Indeed, f1(Bϵ(f(x0)))f^{-1}(B_{\epsilon}(f(x_{0}))) is open in XX, ie x0x_{0} is interior to it. that is, there exists some δ>0\delta > 0 such that Bδ(x0)f1(Bϵ(f(x0)))B_{\delta}(x_{0}) \subset f^{-1}(B_{\epsilon}(f(x_{0}))), ie f(Bδ(x0))Bϵ(f(x0))f(B_{\delta}(x_{0})) \subset B_{\epsilon}(f(x_{0})).

Now suppose ff is continuous as given by the second definition. let UU be open in YY. let vf1(U)v \in f^{-1}(U), now we know that for some ϵ>0\epsilon > 0, Bϵ(f(v))UB_{\epsilon}(f(v)) \subset U. for that ϵ\epsilon, there is some δ>0\delta > 0 such that f(Bδ(v))Bϵ(f(v))Uf(B_{\delta}(v)) \subset B_{\epsilon}(f(v)) \subset U. of course then Bδ(v)f1(U)B_{\delta}(v) \subset f^{-1}(U), thus f1(U)f^{-1}(U) is open.

Now, it is quite clear, using complements, that in topological spaces (and thus metric spaces) arbitrary intersections and finite unions of closed sets are closed.

3 - Dense, Perfect, and Compact Sets

Now some more definitions:

A subset UU of a metric space XX is said to be dense, if for each xXx \in X, either xUx \in U or xx is a limit point of UU, moreover if XX is a metric space such that any xXx \in X is a limit point of XX, then the space is said to be dense in itself.

Now, if uUu \in U is not a limit point of UU, then it is called an isolated point of UU.

Finally UU is perfect if it is closed and every uUu \in U is a limit point of UU. ie UU is perfect if it is closed and has no isolated points.

As with compactness in topological spaces, a subset UXU \subset X is compact, if every open cover of UU has a finite subcover.

note: Most of the properties on a subset of a space, (topological or metric) can be pulled directly down into the subspace induced by that subset, either by taking intersection of open sets, or by inheriting the metric. For example, a space XX is compact if every open cover has a finite subcover, UU is a compact subset if and only if as a subspace, it is a compact space.

We say that the empty set is bounded. A nonempty subset UU of a metric space XX is bounded if there exists M>0M > 0 and some u0Uu_{0} \in U such that for any uUu \in U, d(u,u0)Md(u, u_{0}) \le M.

Compact Sets Are Closed and Bounded

Suppose XX is a metric space and UU is a compact subset of XX, then UU is closed and bounded:

first we will show that UU bounded. this is immediate if UU is empty, so suppose it is nonempty and take some u0Uu_{0} \in U. now build a sequence of balls Bri(u0)B_{r_{i}}(u_{0}), iNi \in \mathbb{N}, ri=2ir_{i} = 2^i. since the distance between any two points is finite, this sequence of balls covers UU. Of course, it has a finite subcover, but every ball is contained in the next one in this sequence, thus there exists some nNn \in \mathbb{N} such that UB2n(u0)U \subset B_{2^n}(u_{0}).

TikZ diagram

Next we will show that UU is closed, ie XUX-U is open: this is immediate if UU is empty, so suppose it is nonempty and let xXUx \in X-U. Now, build a cover of UU by taking Br(u)(u)B_{r(u)}(u), where r(u)=d(u,x)/3r(u) = d(u,x)/3. This choice ensures that even if the whole r(u)r(u) ball sticks out toward xx, every point in it remains more than 2d(u,x)/32d(u,x)/3 away from xx.

We will now prove this. select r(u)=d(u,x)/3r(u) = d(u,x)/3 and get the finite subcover Br(ui)(ui)B_{r(u_{i})}(u_{i}), 1in1 \le i \le n. now, let r=min(r(ui),i[1,n])r^* = \min(r(u_{i}), i \in [1,n]) we claim that no uUu \in U is in Br(x)B_{r^*}(x). let uUu \in U, then for some ii, uBr(ui)(ui)u \in B_{r({u_{i}})}(u_{i}). thus, d(ui,x)d(u,x)+d(u,ui)d(u_{i}, x) \le d(u,x) + d(u,u_{i}). ie, d(u,x)d(ui,x)d(u,ui)d(u,x) \ge d(u_{i},x) - d(u,u_{i}). since d(u,ui)<r(ui)d(u,u_{i}) < r(u_{i}) and d(ui,x)=3r(ui)d(u_{i},x) = 3r(u_{i}) we have d(u,x)>2r(ui)2r>rd(u,x) > 2r(u_{i}) \ge 2r^* > r^*.

Continuous Images and Closed Subsets

The following holds for any topological space: let f:XYf: X \to Y be continuous, and XX compact. then f(X)f(X) is a compact subspace of YY.

Take an open cover of f(X)f(X), take its pre-image under ff to get an open cover of XX, since XX is compact, you get its finite subcover, send it back by taking its image under ff, to get a finite subcover of f(X)f(X).

lemma: let XX be a topological space, and KXK \subset X a compact set. Then, if UKU \subset K is closed, then UU is compact.

we know KUK-U is open in the subspace KK. Take any open cover of UU, and extend it to an open cover of KK by adding KUK-U. Take a finite subcover of KK, and discard KUK-U if it was selected. what remains is a finite subcover of UU.

Notice that any point of Z\mathbb{Z} with the usual metric is isolated in Z\mathbb{Z}, and any point of Q\mathbb Q is a limit point of itself. Ie Q\mathbb Q is dense in itself.

4 - Ordered Fields and the Real Numbers

A field FF with an order \le on the set FF is said to be an ordered field if the field operations play nice with order:

  • xyx \le y, xyx' \le y' implies x+xy+yx + x' \le y + y'
  • 0x0 \le x, 0y0 \le y implies 0xy0 \le xy

ordered fields are cute, for example, as a field we know 101 \neq 0 suppose 101 \le 0, and of course 11-1 \le -1 (order is reflexive) thus we obtain 010 \le -1 by adding them together. now we can multiply two copies of that inequality, and get 0(1)(1)=10 \le (-1)(-1) = 1. together with 101 \le 0, antisymmetry would give 1=01=0, a contradiction. (these things follow from field axioms)

that is 010 \le 1 in an ordered field.

an ordered set SS has the least upper bound property, or the supremum property, if any nonempty subset with an upper bound, has the least upper bound defined as follows:

let USU \subset S we say that UU is bounded above if for some aSa \in S, uau \le a for any uUu \in U. Further, we call aSa^* \in S the least upper bound of UU if aa^* is an upper bound of UU, and for any upper bound aa of UU, we have aaa^* \le a.

We can analogously define lower bounds and greatest lower bounds, and the greatest lower bound property on an ordered set.

We define R\mathbb{R} to be the ordered field which has the supremum property and contains Q\mathbb Q as a subfield (up to isomorphism), and we will not bother constructing it. Further, it follows that R\mathbb{R} has the infimum property as well, that is, any nonempty set with a lower bound, has the greatest lower bound.

If nothing is mentioned, we take the usual d(x,y)=yxd(x,y) = |y-x| metric on R\mathbb{R}.

lemma -1: let URU \subset \mathbb{R} be nonempty and bounded above and α=sup(U)\alpha = \sup(U). Then αU\alpha \in U or α\alpha is a limit point of UU (perhaps both). proof: suppose neither is true. well since α\alpha is not a limit point of UU, there exists some ϵ>0\epsilon > 0 such that (αϵ,α+ϵ)U(\alpha -\epsilon, \alpha +\epsilon) \cap U is empty. ie, for each uUu \in U, uαϵu \le \alpha-\epsilon (of course uαu \le \alpha). thus, αϵ\alpha - \epsilon is an upper bound of UU, a contradiction.

lemma 0: [0,1][0,1] is closed.

proof: we will show R[0,1]=(,0)(1,)\mathbb{R}-[0,1] = (-\infty,0) \cup (1, \infty) is open. of course any point in R[0,1]\mathbb{R} -[0,1] is interior to it.

lemma 1: [0,1][0,1] is bounded. (left as an exercise for the reader)

Compactness of the Unit Interval

Theorem. [0,1][0,1] is a compact subspace of R\mathbb{R}.

proof: This one is a banger. Let U\mathscr{U} be an open cover of [0,1][0,1] clearly, some UUU \in \mathscr{U} contains 00. Of course then 00 is interior to UU, ie for some ϵ>0\epsilon > 0, [0,ϵ)U[0,\epsilon) \subset U. so at least [0,ϵ/2][0,\epsilon/2] has a finite subcover. we would like to extend him :) (for example, ϵ/2\epsilon/2 in some UUU \in \mathscr{U} and thus he is interior to UU, and …)

let S={x[0,1]:[0,x]i=1nUi, UiU}S = \{ x \in [0,1]: [0,x] \subset \bigcup_{i=1}^n U_{i}, \ U_{i} \in \mathscr{U} \}. That is SS is the subset of [0,1][0,1] whose closed interval starting at 00 is finitely covered by sets in U\mathscr{U}. SS is nonempty and bounded above, thus let α=sup(S)\alpha =\sup(S). We claim α=1\alpha = 1. For contradiction, suppose α<1\alpha < 1. that is, α\alpha is in some UαUU_{\alpha} \in \mathscr{U} and is interior to it. thus, for some ϵ>0\epsilon > 0 with α+ϵ<1\alpha+\epsilon < 1, (αϵ,α+ϵ)[0,1]Uα(\alpha-\epsilon, \alpha + \epsilon) \cap [0,1] \subset U_{\alpha}.

Now, if αS\alpha \in S, then of course [0,α][0,\alpha] is finitely covered, and hence [0,α+ϵ)[0,\alpha+ \epsilon) is finitely covered by taking union with UαU_{\alpha}. of course then [0,α+(ϵ/2)][0, \alpha + (\epsilon/2)] is finitely covered, ie α+(ϵ/2)S\alpha + (\epsilon/2) \in S, a contradiction.

Otherwise, α\alpha is a limit point of SS. thus, there is some sSs \in S with α(ϵ/2)<s<α\alpha-(\epsilon/2) < s < \alpha. Ie, [0,s][0,s] is finitely covered, and taking union with UαU_{\alpha}, [0,α+(ϵ/2)][0, \alpha +(\epsilon/2)] is yet again finitely covered, a contradiction.

Thus, α=1\alpha = 1. well cool, we still don’t know if 1S1 \in S, (if 1S1 \in S, we are done so suppose otherwise) but what we do know is that since 1U1 \in U for some guy in the open cover, for some δ>0\delta > 0, we have (1δ,1]U(1-\delta,1] \subset U. since 11 is a limit point of SS, there is some sSs \in S with 1δ<s<11-\delta < s < 1. ie [0,s][0,s] is finitely covered, and taking union with UU, [0,1][0,1] is finitely covered.

5 - The Standard Topology on Rn\mathbb{R}^n

Now, we will pause and gain some intuition on the standard topology (using the L2L_{2} or whatever the usual metric) on Rn\mathbb{R}^n.

TikZ diagram

The projection of an open ball in Rn\mathbb{R}^n onto each axis gives an open interval. Let us show this:

let πi:RnR\pi_{i}: \mathbb{R}^n \to \mathbb{R} be the projection map onto the ii-th axis. that is, πi(x)=xei\pi_{i}(\mathbf{x}) = \mathbf{x} \cdot \mathbf{e^i} where ei\mathbf{e^i} is the usual iith basis.

let x0Rn\mathbf{x_{0}} \in \mathbb{R}^n, and r>0r > 0, we claim that πi(Br(x0))=Br(x0i)\pi_{i}(B_{r}(\mathbf{x_{0}})) = B_{r}(\mathbf{x_{0}^i}).

First, let Li={xRn:x=x0+tei,t(r,r)}L_{i} = \{ \mathbf{x} \in \mathbb R^n : \mathbf{x} = \mathbf{x_{0}} + t\mathbf{e^i}, t \in (-r,r) \} of course LiBr(x0)L_{i} \subset B_{r}(\mathbf{x_{0}}). Notice if xLi\mathbf{x} \in L_{i}, πi(x)=x0ei+t=x0i+t\pi_{i}(\mathbf{x}) = \mathbf{x_{0}}\cdot \mathbf{e^i} + t = \mathbf{x_{0}^i} + t where t(r,r)t \in (-r,r) thus, πi(Li)=Br(x0i)\pi_{i}(L_{i}) = B_{r}(\mathbf{x_{0}^i}).

This means that Br(x0i)πi(Br(x0))B_{r}(\mathbf{x_{0}^i}) \subset \pi_{i}(B_{r}(\mathbf{x_{0}})). But of course, if xBr(x0)\mathbf{x} \in B_{r}(\mathbf{x_{0}}), then xix0ixx0<r|\mathbf{x^i}-\mathbf{x_{0}^i}| \le |\mathbf{x}-\mathbf{x_{0}}| < r. That is, πi(x)=xiBr(x0i)\pi_{i}(\mathbf{x}) = \mathbf{x^i} \in B_{r}(\mathbf{x_{0}^i}).

thus, we have πi(Br(x0))Br(x0i)\pi_{i}(B_{r}(\mathbf{x_{0}})) \subset B_{r}(\mathbf{x_{0}^i}).

Now, we claim that Br(x0)i=1nπi(Br(x0))B_{r}(\mathbf{x_{0}}) \subset \prod_{i=1}^n \pi_{i}(B_{r}(\mathbf{x_{0}})). That is, the intervals obtained by projecting an open ball onto each axis, when taken product contain the open ball.

That is, Br(x0)i=1nBr(x0i)B_{r}(\mathbf{x_{0}}) \subset \prod_{i=1}^n B_{r}(\mathbf{x_{0}^i}).

As before, if xBr(x0)\mathbf{x} \in B_{r}(\mathbf{x_{0}}) then x=x0+tu\mathbf{x} = \mathbf{x_{0}} + t\mathbf{u} where u\mathbf{u} is a unit vector and t(r,r)t \in (-r,r).

but of course x=<xi>\mathbf{x} = <\mathbf{x^i}> (as a tuple), where xi=xeiBr(x0i)\mathbf{x^i} = \mathbf{x} \cdot \mathbf{e^i} \in B_{r}(\mathbf{x_{0}^i}) as shown earlier. Thus by definition, xi=1nBr(x0i)\mathbf{x} \in \prod_{i=1}^n B_{r}(\mathbf{x_{0}^i}).

And finally, we will show that there exists a SINGLE ϵ\epsilon (this will help A LOT in showing continuity, I think) for which i=1nBϵ(x0i)Br(x0)\prod_{i=1}^n B_{\epsilon}(\mathbf{x_{0}^i}) \subset B_{r}(\mathbf{x_{0}}).

Indeed, if xi=1nBϵ(x0i)\mathbf{x} \in \prod_{i=1}^n B_{\epsilon}(\mathbf{x_{0}^i}), then xi(x0iϵ,x0i+ϵ)\mathbf{x^i} \in (\mathbf{x_{0}^i}-\epsilon, \mathbf{x_{0}^i} + \epsilon), that is

ϵ<xix0i<ϵ.-\epsilon < \mathbf{x^i} - \mathbf{x_{0}}^i < \epsilon.

equivalently,

i=1n(xix0i)2<nϵ2.\sum_{i=1}^n (\mathbf{x^i} - \mathbf{x_{0}^i})^2 < n\epsilon^2.

of course then, it is sufficient if nϵ2<r2n\epsilon^2 < r^2, i.e. ϵ<r/n\epsilon < r/\sqrt{n}.

Okay, very nice. Now, we shall show a couple of things.

let UiU_{i}, 1in1 \leq i \leq n be a collection of open sets in R\mathbb{R} we claim i=1nUi\prod_{i=1}^n U_{i} is open in Rn\mathbb{R}^n

let xi=1nUi\mathbf{x} \in \prod_{i=1}^n U_{i}, then by definition, xiUi\mathbf{x^i} \in U_{i}, ie for some ϵi>0\epsilon_{i} > 0 Bϵi(xi)UiB_{\epsilon_{i}}(\mathbf{x^i}) \subset U_{i}, let ϵ=mini(ϵi)\epsilon = \min_{i}(\epsilon_{i})

then, Bϵ(xi)UiB_{\epsilon}(\mathbf{x^i}) \subset U_{i}, thus i=1nBϵ(xi)i=1nUi\prod_{i=1}^n B_{\epsilon}(\mathbf{x^i}) \subset \prod_{i=1}^n U_{i}.

But as shown earlier, Bϵ(x)i=1nBϵ(xi)B_{\epsilon}(\mathbf{x}) \subset \prod_{i=1}^n B_{\epsilon}(\mathbf{x^i}) thus x\mathbf{x} is interior to i=1nUi\prod_{i=1}^n U_{i}.

Similarly, if URnU \subset \mathbb{R}^n is open, each Ui=πi(U)U_{i} = \pi_{i}(U) is open in R\mathbb{R}.

suppose xπi(U)x \in \pi_{i}(U). then there is xU\mathbf{x} \in U for which xi=x\mathbf{x^i} = x. Then for some r>0r > 0, Br(x)UB_{r}(\mathbf{x}) \subset U but of course then, πi(Br(x))πi(U)\pi_{i}(B_{r}(\mathbf{x})) \subset \pi_{i}(U). Equivalently, Br(xi)UiB_{r}(\mathbf{x^i}) \subset U_{i}.

In Rn\mathbb{R}^n we can thus denote the open box i=1n(xiϵ,xi+ϵ)\prod_{i=1}^n (\mathbf{x^i}-\epsilon, \mathbf{x^i} +\epsilon) as Iϵn(x)I^n_{\epsilon}(\mathbf{x}), and equivalently, we can say that URnU \subset \mathbb{R}^n is open if and only if, for each xU\mathbf{x} \in U, there exists some ϵ>0\epsilon > 0 such that Iϵn(x)UI^n_{\epsilon}(\mathbf{x}) \subset U.

Compact Boxes

Theorem. [0,1]n[0,1]^n is a compact subspace of Rn\mathbb{R}^n.

We will proceed by induction, (notice we have already shown the base case) Suppose [0,1]k[0,1]^k is compact, [0,1]k+1=[0,1]k×[0,1][0,1]^{k+1} = [0,1]^k \times [0,1] (up to isomorphism).

let x[0,1]x \in [0,1] and consider the set Ax=[0,1]k×{x}A_{x} = [0,1]^k \times \{x \}. Notice that the set isomorphism g:[0,1]k[0,1]k×{x}g: [0,1]^k \to [0,1]^k \times \{x\} given by x(x,x)\mathbf{x} \mapsto (\mathbf{x},x) (concatenation) is continuous. Thus as shown earlier, g([0,1]k)=Axg([0,1]^k) = A_{x} is a compact subspace of Rk+1\mathbb{R}^{k+1}.

Now let V\mathscr{V} be an open cover of [0,1]k+1[0,1]^{k+1}. of course, V\mathscr{V} is an open cover of AxA_{x}, and from that view, let V\mathbf{V} be a finite subcover of AxA_{x}.

since each uAx\mathbf{u} \in A_{x} is in some open set in V\mathbf{V}, there exists r(u)r(\mathbf{u}) such that the open box Ir(u)k+1(u)I^{k+1}_{r(\mathbf{u})}(\mathbf{u}) is contained in some set in V\mathbf{V}. but of course, the collection of all such open boxes cover AxA_{x} and thus, there is a finite subcover I={Irik+1(ui):1it}\mathscr{I} = \{ I^{k+1}_{r_{i}}(\mathbf{u_{i}}): 1 \le i \le t \}, moreover V\mathbf{V} covers I\bigcup \mathscr{I}.

The nice thing with open boxes is, it lets us reason about each axis independently.

Any uAx\mathbf{u} \in A_{x} is in some Irik+1(ui)I^{k+1}_{r_{i}}(\mathbf{u_{i}}). of course, u=(u,x)\mathbf{u} = (\mathbf{u'},x) where u=<ui>i=1k\mathbf{u'} = <\mathbf{u^i}>_{i=1}^k.

thus, {u}×(xri,x+ri)Irik+1(ui)\{\mathbf{u'}\}\times(x-r_{i},x+r_{i}) \subset I_{r_{i}}^{k+1}(\mathbf{u_{i}}).

That is to say, taking r=min(ri)r^* = \min(r_{i}), [0,1]k×(xr,x+r)[0,1]^k \times (x-r^*, x+ r^*) is covered by I\mathscr{I} and thus covered by V\mathbf{V}. (note: the keen reader might yell at me saying hey x=0x = 0 or x=1x = 1 means the interval (xr,x+r)(x-r,x+r) gets cutoff. if you like, you may take intersection with [0,1][0,1], or work in the ambient space)

Indeed, then for any open cover V\mathscr{V} of [0,1]k+1[0,1]^{k+1} and any x[0,1]x \in [0,1], there exists some rx>0r_x > 0 for which a finite subcollection Vx\mathbf{V}_{x} of V\mathscr{V} covers [0,1]k×(Brx(x)[0,1])[0,1]^k \times (B_{r_x}(x) \cap [0,1]).

but of course, the collection {Brx(x)[0,1]:x[0,1]}\{B_{r_x}(x) \cap [0,1] : x \in [0,1]\} covers [0,1][0,1], so it has a finite subcover Brxj(xj)[0,1]B_{r_{x_j}}(x_j) \cap [0,1], 1jp1 \le j \le p. The union of the corresponding finite collections Vxj\mathbf{V}_{x_j} is then a finite subcover of [0,1]k+1[0,1]^{k+1} by sets in V\mathscr{V}.

Now we get a bunch of stuff for free. For example, i=1n[ai,bi]\prod_{i=1}^n [a_{i},b_{i}] is a compact subspace of Rn\mathbb{R}^n.

owing to the lemma from before it is sufficient to show that the map f:[0,1]ni=1n[ai,bi]f: [0,1]^n \to \prod_{i=1}^n[a_{i},b_{i}] given by ua+(ba)u\mathbf{u} \mapsto \mathbf{a} + (\mathbf{b}-\mathbf{a}) \mathbf{u} is continuous, (where aei=ai\mathbf{a}\cdot \mathbf{e^i} = a_{i} and bei=bi\mathbf{b} \cdot \mathbf{e^i} = b_{i}, and the multiplication is elementwise) for any real aibia_{i} \le b_{i}.

If b=a\mathbf{b}=\mathbf{a}, then ff is constant and therefore continuous. Otherwise, let ϵ>0\epsilon > 0, and let xx0<ϵ/ba|\mathbf{x} - \mathbf{x_{0}}| < \epsilon/|\mathbf{b}-\mathbf{a}|. Notice f(x)f(x0)=(ba)(xx0)baxx0|f(\mathbf{x})- f(\mathbf{x_{0}})| = |(\mathbf{b}-\mathbf{a})(\mathbf{x} - \mathbf{x_{0}})| \le |\mathbf{b}-\mathbf{a}||\mathbf{x}-\mathbf{x_{0}}| (the right hand side is Hölder’s inequality, which we shall show below) and thus f(x)f(x0)<ϵ|f(\mathbf{x})- f(\mathbf{x_{0}})| < \epsilon.

Hölder’s Inequality

In Rn\mathbb{R}^n, abab|\mathbf{a} \mathbf{b}| \le |\mathbf{a}||\mathbf{b}| where the multiplication on vectors is elementwise. i.e. we must show

i=1n(aibi)2i=1nai2i=1nbi2.\sqrt{ \sum_{i=1}^n(a_{i}b_{i})^2 } \le \sqrt{ \sum_{i=1}^na_{i}^2 } \sqrt{ \sum_{i=1}^n b_{i}^2 }.

of course, we can square both sides, and show

i=1n(aibi)2i=1nai2i=1nbi2.\sum_{i=1}^n(a_{i}b_{i})^2 \le \sum_{i=1}^na_{i}^2 \sum_{i=1}^n b_{i}^2.

for ease, let An=i=1nai2, Bn=i=1nbi2A_{n} = \sum_{i=1}^n a_{i}^2, \ B_{n} = \sum_{i=1}^n b_{i}^2.

Notice

An+1Bn+1=An+1Bn+An+1bn+12=AnBn+an+12Bn+bn+12An+an+12bn+12AnBn+an+12bn+12.\begin{align*} A_{n+1}B_{n+1} &= A_{n+1}B_{n} + A_{n+1}b_{n+1}^2 \\ &= A_{n}B_{n} + a_{n+1}^2B_{n} + b_{n+1}^2A_{n} + a_{n+1}^2 b_{n+1}^2 \\ &\ge A_{n}B_{n} + a_{n+1}^2b_{n+1}^2. \end{align*}

Now proceed by induction, (the base case is obvious) and suppose i=1n(aibi)2AnBn\sum_{i=1}^n(a_{i}b_{i})^2 \le A_{n}B_{n}, of course i=1n+1(aibi)2AnBn+an+12bn+12An+1Bn+1\sum_{i=1}^{n+1}(a_{i}b_{i})^2 \le A_{n}B_{n} + a_{n+1}^2b_{n+1}^2 \le A_{n+1}B_{n+1}.

The Heine-Borel Theorem

Theorem. Every closed bounded subset in Rn\mathbb{R}^n is compact.

let URnU \subset \mathbb{R}^n be closed and bounded. Of course then, Ui=1n[ai,bi]U \subset \prod_{i=1}^n[a_{i},b_{i}], and thus is a closed subset of a compact set.

Ie together, in Rn\mathbb{R}^n, a subset is compact if and only if it is closed and bounded.

6 - Continuous Maps Between Real Vector Spaces

From our discussions earlier, it is quite clear that open boxes form an alternative basis, we further claim that if f:RmRnf: \mathbb{R}^m \to \mathbb{R}^n has the property that for each xRmx \in \mathbb{R}^m and any ϵ>0\epsilon > 0, there exists δ>0\delta > 0 such that f(Iδm(x))Iϵn(f(x))f(I^m_{\delta}(x)) \subset I^n_{\epsilon}(f(x)), then ff is continuous. This follows directly from seeing that if URnU \subset \mathbb{R}^n is open, then for any xf1(U)x \in f^{-1}(U), we can take an open ϵ\epsilon box around f(x)f(x) take its pre-image, which would contain the δ\delta box around xx. In fact, this is an equivalent definition of continuity of ff.

we will use this to build a more workable, but equivalent condition to characterise continuous maps from any two real vector spaces.

Consider f:RmRnf: \mathbb{R}^m \to \mathbb{R}^n, we claim that ff is continuous if and only if each projection of ff, fi=πif:RmRf_{i} = \pi_{i} \circ f: \mathbb{R}^m \to \mathbb{R} is continuous.

We only need to show one direction, as πi\pi_{i} is continuous.

Now suppose each fif_{i} is continuous. fix xRmx \in \mathbb{R}^m and let ϵ>0\epsilon > 0. there exists some δi\delta_{i} such that fi(Iδim(x))(fi(x)ϵ,fi(x)+ϵ)f_{i}(I^m_{\delta_{i}}(x)) \subset (f_{i}(x) - \epsilon, f_{i}(x) + \epsilon).

choose δ=min(δi)\delta = \min(\delta_{i}) then πif(Iδm(x))(fi(x)ϵ,fi(x)+ϵ) \pi_{i} \circ f(I^m_{\delta}(x)) \subset (f_{i}(x) - \epsilon, f_{i}(x) + \epsilon).

that is, f(Iδm(x))πi1(fi(x)ϵ,fi(x)+ϵ)=Ri1×(fi(x)ϵ,fi(x)+ϵ)×Rnif(I^m_{\delta}(x)) \subset \pi_{i}^{-1}(f_{i}(x)-\epsilon, f_{i}(x) + \epsilon) = \mathbb{R}^{i-1} \times (f_{i}(x)-\epsilon, f_{i}(x) + \epsilon)\times \mathbb{R}^{n-i}.

If a set is a subset of many sets, it is a subset of their intersection.

Thus, clearly, f(Iδm(x))i=1n(fi(x)ϵ,fi(x)+ϵ)=Iϵn(f(x))f(I^m_{\delta}(x)) \subset \prod_{i=1}^n (f_{i}(x) -\epsilon, f_{i}(x)+ \epsilon) = I^n_{\epsilon}(f(x)).

Now one might be tempted to say that f:RmRf: \mathbb{R}^m \to \mathbb{R} having fj:xjf(x1,x2,xj,,xm)f_{j}: x_{j} \mapsto f(x_{1},x_{2},\dots x_{j},\dots, x_{m}) continuous for each jj and each fixed choice of the rest, means that ff is continuous. This is not true, we will provide many counterexamples later :)

The Reals as a Topological Field

We have special topological spaces, with some algebraic structure on them, for which the operations are continuous. (check algebra note)

we claim R\mathbb{R} is a topological field.

we will show that the addition +:R2R+ : \mathbb{R}^2 \to \mathbb{R} is continuous. Let ϵ>0\epsilon > 0,

suppose (x,y)Iϵ/22((x0,y0))(x,y) \in I_{\epsilon/2}^2((x_{0},y_{0})) then xx0<ϵ/2|x-x_{0}| < \epsilon/2 and yy0<ϵ/2|y-y_{0}| < \epsilon/2. Now notice that (x+y)(x0+y0)xx0+yy0<ϵ|(x+y) - (x_{0} + y_{0})| \le |x-x_{0}| + |y-y_{0}| < \epsilon.

Next we will show that the multiplication :R2R\cdot : \mathbb{R}^2 \to \mathbb{R} is continuous. let ϵ>0\epsilon > 0

now, suppose xx0,yy0<δ|x-x_{0}|, |y-y_{0}| < \delta. first notice (xx0)(yy0)=xy+x0y0(x0y+y0x)(x-x_{0})(y-y_{0}) = xy + x_{0}y_{0} -(x_{0}y + y_{0}x)

that is, (xx0)(yy0)+x0(yy0)+y0(xx0)=xyx0y0(x-x_{0})(y-y_{0}) + x_{0}(y-y_{0}) + y_{0}(x-x_{0}) = xy -x_{0}y_{0}.

that is, repeatedly using a+ba+b|a+b| \le |a| + |b| and simplifying,

xyx0y0<δ2+δ(x0+y0).|xy-x_{0}y_{0}| < \delta^2 + \delta(|x_{0}| + |y_{0}|).

ie we demand δ<1\delta < 1 to make this chill. and sufficiently, we can have δ(x0+y0+1)<ϵ\delta(|x_{0}|+|y_{0}| + 1) < \epsilon

together, it is sufficient to take δ<min(1,ϵ/(x0+y0+1))\delta < \min(1, \epsilon/(|x_{0}| + |y_{0}| + 1)).

Now alarm bells might be ringing over your head, don’t worry! of course, after taking an ϵ\epsilon ball around f(x0,y0)f(x_{0},y_{0}) the δ\delta ball around (x0,y0)(x_{0},y_{0}) absolutely can depend on it!, of course it can’t depend on some point in the ball that isn’t the centre, because that doesn’t make sense, in order to specify elements of a ball, you must pick a radius, so that radius can’t depend on elements of the ball other than the centre. (which is common for all balls)

Finally, we will show that the inverse 1:R×R×^{{-1}}: \mathbb{R}^\times \to \mathbb{R}^\times is continuous.

first notice x0xxx0|x_{0}|-|x| \le |x - x_{0}| (another variant of triangle inequality) thus xx0xx0|x| \ge |x_{0}| -|x-x_{0}|. now suppose xx0<δ<x0|x-x_{0}| < \delta < |x_0|. then x>x0δ|x| > |x_{0}| - \delta, ie

xx01<1/(x0(x0δ)).|x x_{0}|^{-1} <1/(|x_{0}|(|x_{0}| - \delta)).

equivalently,

x1x01<δ/(x0(x0δ)).|x^{-1} - x_{0}^{-1}| < \delta/(|x_{0}|(|x_{0}| - \delta)).

sufficiently, we want δ<ϵx02ϵx0δ\delta < \epsilon|x_{0}|^2 -\epsilon |x_{0}|\delta thus δ<ϵx02/(1+ϵx0)\delta < \epsilon|x_{0}|^2/(1+\epsilon|x_{0}|).

As shown in the algebra notes, thus the collection of continuous maps from any topological space to the reals form a ring under pointwise addition and multiplication. (the maps which do not take zero values are closed under pointwise multiplication and inverse, but not under addition, so they do not form a field.)

Rm\mathbb{R}^m as a Topological Vector Space

Next we shall show that Rm\mathbb{R}^m (over R\mathbb{R}) forms a topological vector space, that is, addition and scalar products are continuous. (of course using the product topology wherever it’s ambiguous)

This follows directly, notice that +:R2mRm+ : \mathbb{R}^{2m} \to \mathbb{R}^m has each projection πi+:(x,y)xi+yi\pi_{i} \circ + : (\mathbf{x},\mathbf{y}) \mapsto \mathbf{x^i} + \mathbf{y^i} continuous, (this is the addition in reals) similarly, the scalar multiplication :R×RmRm\cdot : \mathbb{R} \times \mathbb{R}^m \to \mathbb{R}^m has each projection πi:(λ,x)λxi\pi_{i} \circ \cdot : (\lambda, \mathbf{x}) \to \lambda \mathbf{x^i} which is continuous (multiplication in reals).

That is, the collection of continuous maps from any topological space XX to Rm\mathbb{R}^m form a vector space over R\mathbb{R}, with pointwise addition and scalar multiplication.

7 - Sequences

a map f:NXf: \mathbb{N} \to X where XX is a metric space is called a sequence.

we say ff is cauchy if its terms get arbitrary close, taking a far enough tail. That is, for each ϵ>0\epsilon > 0, there exists NNN \in \mathbb{N} for which whenever i,j>Ni,j > N, we have d(fi,fj)<ϵd(f_{i},f_{j}) < \epsilon.

We will denote the nn-tail of a sequence by f>nf_{>n}. A subsequence of ff is obtained by selecting terms along a strictly increasing map A:NNA: \mathbb{N} \to \mathbb{N}. It is given by fAf \circ A, and will be denoted fAf|A.

we say for some pXp \in X, ff converges to pp and write fpf \longrightarrow p when for each ϵ>0\epsilon > 0, there exists NNN \in \mathbb{N} for which f>NBϵ(p)f_{>N} \subset B_{\epsilon}(p), that is a tail that is ϵ\epsilon-close to pp.

next we claim that the following two statements are equivalent:

  1. f:NXf: \mathbb N \to X converges to pXp \in X.
  2. ff is cauchy and, ff is eventually constant at pp or pp is a (THE) limit point of f(N)f(\mathbb N).

121 \Rightarrow 2: ff is cauchy: we know that a tail of ff is ϵ/2\epsilon/2 close to pp for any ϵ>0\epsilon>0, thus by the triangle inequality, that same tail is ϵ\epsilon close to each other.

now, if ff is eventually constant at pp all balls (WITH CENTRE LOOK AT THE DEFINITION OF CONVERGENCE) at least contain the constant pp-tail.

Now for any ϵ>0\epsilon > 0 some NN-tail is in the open ϵ,p\epsilon,p ball (with centre included), since the sequence is not eventually constant at pp there is an infinite subsequence of this tail contained inside the open ϵ,p\epsilon,p ball that are NOT equal to pp! thus the ball without centre has a nonempty intersection with f(N)f(\mathbb N) thus pp is a (THE) limit point of f(N)f(\mathbb N).

212 \Rightarrow 1: I mean if something is eventually constant at pp then of course it converges to pp.

suppose pp is a limit point of f(N)f(\mathbb N), the intuition we have is that ff is cauchy, meaning tails are eventually ϵ\epsilon close to each other, and further that for any ϵ>0\epsilon > 0 some subsequence (infinite ofc) is ϵ\epsilon close to pp.

somehow we want to put these together to show that tails are ϵ\epsilon close to pp.

well, suppose there is a pathological ϵ\epsilon^* for which no tail is fully contained inside the p,ϵp,\epsilon^* ball, that is to say, the set of nn such that d(f(n),p)ϵd(f(n),p) \ge \epsilon^* has no maximum element. (if it did, you could take the tail beyond that point)

similarly, given that pp is a limit point, the set of nn for which d(f(n),p)<ϵ/2d(f(n),p) < \epsilon^*/2 has no maximum element either.

that is to say, in the tail that is ϵ/2\epsilon^*/2 close to each other, you will find both kinds of elements and then you can take the triangle inequality to show that that shit is a contradiction.

further you can show that if fpf \to p and fqf \to q then p=qp = q.

suppose pqp \neq q. take d(p,q)/2d(p,q)/2 balls around pp and qq. a tail is fully contained in one ball, and a tail is fully contained in the other ball. well one of them is a subtail of the other one, so we have a tail contained in two disjoint sets, which doesn’t make sense.

Convergent Subsequences in Compact Spaces

Now, we claim that if f:NXf: \mathbb{N} \to X is a sequence into a compact metric space, then it has a convergent subsequence.

Let J1=NJ_{-1} = \mathbb{N}. Take ϵk=1/2k+2\epsilon_k = 1/2^{k+2}. Cover XX by open ϵk\epsilon_k balls and take a finite subcover. Given that Jk1J_{k-1} has no maximum element, some ball CkC_k in this finite subcover has the property that

Jk=Jk1f1(Ck)J_k = J_{k-1} \cap f^{-1}(C_k)

has no maximum element. Indeed, if each of these sets had a maximum, then their finite union Jk1J_{k-1} would have a maximum.

Thus, by induction, we have a sequence of nested sets

J0J1J2J_0 \supset J_1 \supset J_2 \supset \dots

such that JkJ_k has no maximum element and, whenever i,jJki,j \in J_k,

d(fi,fj)<2ϵk=12k+1.d(f_i,f_j) < 2\epsilon_k = \frac{1}{2^{k+1}}.

Pick j0J0j_0 \in J_0. Having picked j0<j1<<jkj_0 < j_1 < \dots < j_k with jiJij_i \in J_i, we can pick jk+1Jk+1j_{k+1} \in J_{k+1} such that jk+1>jkj_{k+1} > j_k, since Jk+1J_{k+1} has no maximum element.

Let A:NNA: \mathbb{N} \to \mathbb{N} be given by A(k)=jkA(k)=j_k. We claim that the subsequence fAf \circ A is cauchy. For any ϵ>0\epsilon>0, take KK such that 1/2K+1<ϵ1/2^{K+1}<\epsilon. If m,nKm,n \ge K, then jm,jnJKj_m,j_n \in J_K, and hence

d(fjm,fjn)<12K+1<ϵ.d(f_{j_m},f_{j_n}) < \frac{1}{2^{K+1}} < \epsilon.

If (fA)(N)(f \circ A)(\mathbb{N}) is finite, then fAf \circ A is eventually constant. This is immediate if its image has one point. Otherwise, take δ>0\delta>0 smaller than the minimum distance between two distinct points of its image. A δ\delta-cauchy tail can contain only one point.

Suppose instead that (fA)(N)(f \circ A)(\mathbb{N}) is infinite. We claim that it has a limit point in XX. Otherwise, for each xXx \in X, there is an open ball BxB_x such that

(Bx{x})(fA)(N)=.(B_x-\{x\}) \cap (f \circ A)(\mathbb{N}) = \varnothing.

The balls BxB_x cover XX, so take a finite subcover. Each ball in this finite subcover contains at most one point of (fA)(N)(f \circ A)(\mathbb{N}), which would make (fA)(N)(f \circ A)(\mathbb{N}) finite, a contradiction.

Thus fAf \circ A is cauchy and is either eventually constant or has a limit point. By the equivalence proved above, it converges.