本篇是 Adam B Kashlak 老师的 Probability and Measure Theory 课程笔记 Part 1
Measure Theory
Measures and -Fields
-Field
Question : What sets (subsets of ) am I allowed to measure?
DefinitionFor some set , a -Field is a collection of sets s.t.
- If then
- is closed under union: for a countable collection of sets s.t. for all then
Equivalence : also contains countable intersections because
Measure
DefinitionA measure is a mapping from a -field to the non-negative real numbers s.t.
- For a pairwise disjoint collection then (Countably Additivity)
Special Cases for a Measure Space :
Power Set
DefinitionPower set or is the set of all subsets of
Semi-Ring of Sets
Definition, a collection of subsets of , is called a Semi-Ring when
- If then
- If then there exists a finite number of pariwise disjoint sets for s.t.
Example: all intervals in is a semi-ring
Ring of Sets
Definition, a collection of subsets of , is called a Ring when
- If then
- If then (This implies finite unions are also in )
From the defintion, we know that the intersection of two sets is also in because
ExampleAll finite unions of half open intervals in is a ring
Field
Definitionis a Field if it is a Ring and
EquivalenceSince the whole set is in , then
- the second condition of Ring is equivalent to being closed under complimentation as and
- the third condition of Ring is equivalent to being closed under finite unions as
Note : Field + countable unions -Field
Set Function
DefinitionA set function (not necessarily a measure) is a mapping from a set of functions to . For , we say that
- is monotone if implies
- is additive if for disjoint
- is countably additive if for pairwise disjoint and
- is countably sub-additive if for (not nessarily pairwise disjoint)
- is a pre-measure if is countably additive, and is a ring. For a pre-measure, it is also
- monotone because for we have
- sub-additive because for let then are pairwise disjoint and by monotonicity,
Outter Measure
DefinitionFor a pre-measure on a ring , the outter measure (Not necessarily a Measure) is defined as
for any . This is equal to the smallest possible sum of the pre-measure over all finite or countable collections of in that cover .
Can we “Measure” (Outer Measure) any ? Not necessarily
Denote to be the collection of all measurable sets where we say that is measureable when
Caratheodory Extension Theorem
Caratheodory Extension TheoremLet be a ring on and be a pre-measure, then extends to a measure on .
Note
- is the -field comes from extend by including coutable unions and itself.
- The “corret” extension is the outter measure .
ProofAssume and
- Prove stuff about
as is a pre-measure
is non-negative as is non-negative
is monotone (increasing)
Let and then for any s.t. . Then thus
is countably sub-additive
For and a given , let for s.t.
This is possible because is the infimum. As and as is monotone and is sub-additive, then
Take to get that is countably sub-additive
- Check that and coincide for all
This implies that because the right hand side is the cover of A.
- For any we have because is a cover of and is the infimum
- For the reverse, if then by countable sub-additivity and monotonicity
- Thus
- Check that the ring (all measurable sets)
- i.e. we want to show that is -measurable:
- Note as is sub-additive.
- Next, for some , choose s.t. and
- Furthermore, and thus and take .
- Show that is a -Field
- since
- since
- is closed under coplimentation since which implies that
- is closed under finite intersections since for and any thus . Properties above show that is a Field.
- To get to a -Field, let in be countable and parwise disjoint and . Let , then Then by monotonicity and sub-additivity and let , we get Thus is closed under countable unions ( is a -Field!). Choose we have which means is countably additive.
- Conclusion: is a set function and it’s also a measure on . Since , then . Lastly, as is a measure on , it is also a measure on .
-System and -System
-systemA collection of sets is a -system if
- , .
-systemA collection of sets is a -system if
- If and then .
- If is a sequence of pairwise disjoint sets in then .
Note : a Field is a -system
ExampleLet and contains all subsets with an even number of elements. Then is a -system but not a -Field since but
Dynkin - Theorem
Dynkin - TheoremLet be a -system, be a -system and . Then .
ProofLet be the smallest -system such that , then . Our goal is to show that is also a -system and a collection of sets that is both a -system and a -system is a -Field. Then we necessarily have that .
We only need to show that is closed under intersections.
Let then as is a -system and let’s show that is also a -system:
- as
- If s.t. then for any we have that . Thus , which implies that
- If are pariwise disjoint, then for any , thus . This implies that . Hence, .
By definition of , but is the smallest. Thus and is a -system. Therefore, contains all intersections with elements of .
Lastly, let since , . Then do the same thing we did above to to show that is a -system and thus .
Therefore, is closed under intersections and thus a -Field. This implies that .
Uniquessness of Extension Thereom
Uniqueness of ExtensionLet be -Finite measures on where is a -system. Then, if then and are equal on .
Proof (Finite Measures)Assuming
Let and we only need to show that is a -system because since , by Dynkin - Theorem, which means coincide on .
- If with then hence
- are pairwise disjoint and hence .
is a -system!
Proof (-Finite Measures)
For any s.t. , we define to be all s.t. .
Proceeding as in the proof above, we can show that is a -system and thus .
By -Finiteness we decompose , and . For any and any
here we use inclusion-exclusion formula. This also works for .
Since is a -system, as well as futher intersections, thus
Let we get
Borel -Field
Lebesgue Measure
DefinitionFor any interval in , the Lebesgue measure is defined as .
Are there any s.t. is not -measurable? No
Example: Vitali Set
Let , for define addition mod
Define to contain all -measureable sets s.t. for any , where (shift by ) then we claim that is a -system.
Since is the set contains all intervals , we have because and .
By Dynkin - Theorem,
i.e. Every Borel subset of is shift invariant w.r.t
Next, we say that if then we can decompose into disjoint Equivalence classes.
Define s.t. contains one element from each equivalence class. (We can do this because of the Axiom of Choice) Then no two points in are equivalent. i.e. then for
Thus and by countably additivity
since is traslation invariant, .
- If , then .
- If , then
which yields a contradiction. Thus is not -measurable and we call it Vitali Set.
Fun fact: Lebesgue Measure on is the only translation invariant measure.
- Same for
- There is no -dimensional Lebesgue Measure. i.e. No traslation invariant measure.
Product Measure
DefinitionFor two Measure Spaces and , define where for and .
Question : How are these related? and
From Dudley 4.1.7 , but these two are “usually” equal to each other. e.g.
Independence
Independence for setsFor a countable collection of sets , we say that the collection is independent if for all finite subsets , we have
For a countable collection of -Fields , we say that this collection of -Fields is independent if any set of sets is independent in the sense of the previous definition
TheoremLet be -systems. If for any and , then and are independent.
ProofFor a fixed , we can define two measures for as
By assumption, for any . Hence, by Uniqueness of Extension Theorem, they must coincide on . Therefore, for a fixed and any .
This argument can be repeated by fixing an element to get that for .