1 **Don't try to read this yet!!! Many substantial edits are still in process.
6 I really don't know much category theory. Just enough to put this
7 together. Also, this really is "put together." I haven't yet found an
8 authoritative source (that's accessible to a category theory beginner like
9 myself) that discusses the correspondence between the category-theoretic and
10 functional programming uses of these notions in enough detail to be sure that
11 none of the pieces here is misguided. In particular, it wasn't completely
12 obvious how to map the polymorphism on the programming theory side into the
13 category theory. And I'm bothered by the fact that our `<=<` operation is only
14 partly defined on our domain of natural transformations. But this does seem to
15 me to be the reasonable way to put the pieces together. We very much welcome
16 feedback from anyone who understands these issues better, and will make
22 A **monoid** is a structure <code>(S,⋆,z)</code> consisting of an associative binary operation <code>⋆</code> over some set `S`, which is closed under <code>⋆</code>, and which contains an identity element `z` for <code>⋆</code>. That is:
26 for all s1, s2, s3 in S:
27 (i) s1⋆s2 etc are also in S
28 (ii) (s1⋆s2)⋆s3 = s1⋆(s2⋆s3)
29 (iii) z⋆s1 = s1 = s1⋆z
32 Some examples of monoids are:
34 * finite strings of an alphabet `A`, with <code>⋆</code> being concatenation and `z` being the empty string
35 * all functions <code>X→X</code> over a set `X`, with <code>⋆</code> being composition and `z` being the identity function over `X`
36 * the natural numbers with <code>⋆</code> being plus and `z` being `0` (in particular, this is a **commutative monoid**). If we use the integers, or the naturals mod n, instead of the naturals, then every element will have an inverse and so we have not merely a monoid but a **group**.)
37 * if we let <code>⋆</code> be multiplication and `z` be `1`, we get different monoids over the same sets as in the previous item.
41 A **category** is a generalization of a monoid. A category consists of a class of **elements**, and a class of **morphisms** between those elements. Morphisms are sometimes also called maps or arrows. They are something like functions (and as we'll see below, given a set of functions they'll determine a category). However, a single morphism only maps between a single source element and a single target element. Also, there can be multiple distinct morphisms between the same source and target, so the identity of a morphism goes beyond its "extension."
43 When a morphism `f` in category <b>C</b> has source `C1` and target `C2`, we'll write <code>f:C1→C2</code>.
45 To have a category, the elements and morphisms have to satisfy some constraints:
48 (i) the class of morphisms has to be closed under composition:
49 where f:C1→C2 and g:C2→C3, g ∘ f is also a
50 morphism of the category, which maps C1→C3.
52 (ii) composition of morphisms has to be associative
54 (iii) every element E of the category has to have an identity
55 morphism 1<sub>E</sub>, which is such that for every morphism f:C1→C2:
56 1<sub>C2</sub> ∘ f = f = f ∘ 1<sub>C1</sub>
59 These parallel the constraints for monoids. Note that there can be multiple distinct morphisms between an element `E` and itself; they need not all be identity morphisms. Indeed from (iii) it follows that each element can have only a single identity morphism.
61 A good intuitive picture of a category is as a generalized directed graph, where the category elements are the graph's nodes, and there can be multiple directed edges between a given pair of nodes, and nodes can also have multiple directed edges to themselves. (Every node must have at least one such, which is that node's identity morphism.)
64 Some examples of categories are:
66 * Categories whose elements are sets and whose morphisms are functions between those sets. Here the source and target of a function are its domain and range, so distinct functions sharing a domain and range (e.g., `sin` and `cos`) are distinct morphisms between the same source and target elements. The identity morphism for any element/set is just the identity function for that set.
68 * any monoid <code>(S,⋆,z)</code> generates a category with a single element `x`; this `x` need not have any relation to `S`. The members of `S` play the role of *morphisms* of this category, rather than its elements. All of these morphisms are understood to map `x` to itself. The result of composing the morphism consisting of `s1` with the morphism `s2` is the morphism `s3`, where <code>s3=s1⋆s2</code>. The identity morphism for the (single) category element `x` is the monoid's identity `z`.
70 * a **preorder** is a structure <code>(S, ≤)</code> consisting of a reflexive, transitive, binary relation on a set `S`. It need not be connected (that is, there may be members `x`,`y` of `S` such that neither <code>x≤y</code> nor <code>y≤x</code>). It need not be anti-symmetric (that is, there may be members `s1`,`s2` of `S` such that <code>s1≤s2</code> and <code>s2≤s1</code> but `s1` and `s2` are not identical). Some examples:
72 * sentences ordered by logical implication ("p and p" implies and is implied by "p", but these sentences are not identical; so this illustrates a pre-order without anti-symmetry)
73 * sets ordered by size (this illustrates it too)
75 Any pre-order <code>(S,≤)</code> generates a category whose elements are the members of `S` and which has only a single morphism between any two elements `s1` and `s2`, iff <code>s1≤s2</code>.
80 A **functor** is a "homomorphism", that is, a structure-preserving mapping, between categories. In particular, a functor `F` from category <b>C</b> to category <b>D</b> must:
83 (i) associate with every element C1 of <b>C</b> an element F(C1) of <b>D</b>
85 (ii) associate with every morphism f:C1→C2 of <b>C</b> a morphism F(f):F(C1)→F(C2) of <b>D</b>
87 (iii) "preserve identity", that is, for every element C1 of <b>C</b>:
88 F of C1's identity morphism in <b>C</b> must be the identity morphism of F(C1) in <b>D</b>:
89 F(1<sub>C1</sub>) = 1<sub>F(C1)</sub>.
91 (iv) "distribute over composition", that is for any morphisms f and g in <b>C</b>:
92 F(g ∘ f) = F(g) ∘ F(f)
95 A functor that maps a category to itself is called an **endofunctor**. The (endo)functor that maps every element and morphism of <b>C</b> to itself is denoted `1C`.
97 How functors compose: If `G` is a functor from category <b>C</b> to category <b>D</b>, and `K` is a functor from category <b>D</b> to category <b>E</b>, then `KG` is a functor which maps every element `C1` of <b>C</b> to element `K(G(C1))` of <b>E</b>, and maps every morphism `f` of <b>C</b> to morphism `K(G(f))` of <b>E</b>.
99 I'll assert without proving that functor composition is associative.
103 Natural Transformation
104 ----------------------
105 So categories include elements and morphisms. Functors consist of mappings from the elements and morphisms of one category to those of another (or the same) category. **Natural transformations** are a third level of mappings, from one functor to another.
107 Where `G` and `H` are functors from category <b>C</b> to category <b>D</b>, a natural transformation η between `G` and `H` is a family of morphisms <code>η[C1]:G(C1)→H(C1)</code> in <b>D</b> for each element `C1` of <b>C</b>. That is, <code>η[C1]</code> has as source `C1`'s image under `G` in <b>D</b>, and as target `C1`'s image under `H` in <b>D</b>. The morphisms in this family must also satisfy the constraint:
110 for every morphism f:C1→C2 in <b>C</b>:
111 η[C2] ∘ G(f) = H(f) ∘ η[C1]
114 That is, the morphism via `G(f)` from `G(C1)` to `G(C2)`, and then via <code>η[C2]</code> to `H(C2)`, is identical to the morphism from `G(C1)` via <code>η[C1]</code> to `H(C1)`, and then via `H(f)` from `H(C1)` to `H(C2)`.
117 How natural transformations compose:
119 Consider four categories <b>B</b>, <b>C</b>, <b>D</b>, and <b>E</b>. Let `F` be a functor from <b>B</b> to <b>C</b>; `G`, `H`, and `J` be functors from <b>C</b> to <b>D</b>; and `K` and `L` be functors from <b>D</b> to <b>E</b>. Let η be a natural transformation from `G` to `H`; φ be a natural transformation from `H` to `J`; and ψ be a natural transformation from `K` to `L`. Pictorally:
122 - <b>B</b> -+ +--- <b>C</b> --+ +---- <b>D</b> -----+ +-- <b>E</b> --
124 F: ------> G: ------> K: ------>
125 | | | | | η | | | ψ
127 | | H: ------> L: ------>
131 -----+ +--------+ +------------+ +-------
134 Then <code>(η F)</code> is a natural transformation from the (composite) functor `GF` to the composite functor `HF`, such that where `B1` is an element of category <b>B</b>, <code>(η F)[B1] = η[F(B1)]</code>---that is, the morphism in <b>D</b> that <code>η</code> assigns to the element `F(B1)` of <b>C</b>.
136 And <code>(K η)</code> is a natural transformation from the (composite) functor `KG` to the (composite) functor `KH`, such that where `C1` is an element of category <b>C</b>, <code>(K η)[C1] = K(η[C1])</code>---that is, the morphism in <b>E</b> that `K` assigns to the morphism <code>η[C1]</code> of <b>D</b>.
139 <code>(φ -v- η)</code> is a natural transformation from `G` to `J`; this is known as a "vertical composition". We will rely later on this, where <code>f:C1→C2</code>:
142 φ[C2] ∘ H(f) ∘ η[C1] = φ[C2] ∘ H(f) ∘ η[C1]
145 by naturalness of <code>φ</code>, is:
148 φ[C2] ∘ H(f) ∘ η[C1] = J(f) ∘ φ[C1] ∘ η[C1]
151 by naturalness of <code>η</code>, is:
154 φ[C2] ∘ η[C2] ∘ G(f) = J(f) ∘ φ[C1] ∘ η[C1]
157 Hence, we can define <code>(φ -v- η)[\_]</code> as: <code>φ[\_] ∘ η[\_]</code> and rely on it to satisfy the constraints for a natural transformation from `G` to `J`:
160 (φ -v- η)[C2] ∘ G(f) = J(f) ∘ (φ -v- η)[C1]
163 An observation we'll rely on later: given the definitions of vertical composition and of how natural transformations compose with functors, it follows that:
166 ((φ -v- η) F) = ((φ F) -v- (η F))
169 I'll assert without proving that vertical composition is associative and has an identity, which we'll call "the identity transformation."
172 <code>(ψ -h- η)</code> is natural transformation from the (composite) functor `KG` to the (composite) functor `LH`; this is known as a "horizontal composition." It's trickier to define, but we won't be using it here. For reference:
175 (φ -h- η)[C1] = L(η[C1]) ∘ ψ[G(C1)]
176 = ψ[H(C1)] ∘ K(η[C1])
179 Horizontal composition is also associative, and has the same identity as vertical composition.
185 In earlier days, these were also called "triples."
187 A **monad** is a structure consisting of an (endo)functor `M` from some category <b>C</b> to itself, along with some natural transformations, which we'll specify in a moment.
189 Let `T` be a set of natural transformations <code>φ</code>, each being between some (variable) functor `F` and another functor which is the composite `MF'` of `M` and a (variable) functor `F'`. That is, for each element `C1` in <b>C</b>, <code>φ</code> assigns `C1` a morphism from element `F(C1)` to element `MF'(C1)`, satisfying the constraints detailed in the previous section. For different members of `T`, the relevant functors may differ; that is, <code>φ</code> is a transformation from functor `F` to `MF'`, <code>γ</code> is a transformation from functor `G` to `MG'`, and none of `F`, `F'`, `G`, `G'` need be the same.
191 One of the members of `T` will be designated the "unit" transformation for `M`, and it will be a transformation from the identity functor `1C` for <b>C</b> to `M(1C)`. So it will assign to `C1` a morphism from `C1` to `M(C1)`.
193 We also need to designate for `M` a "join" transformation, which is a natural transformation from the (composite) functor `MM` to `M`.
195 These two natural transformations have to satisfy some constraints ("the monad laws") which are most easily stated if we can introduce a defined notion.
197 Let <code>φ</code> and <code>γ</code> be members of `T`, that is they are natural transformations from `F` to `MF'` and from `G` to `MG'`, respectively. Let them be such that `F' = G`. Now <code>(M γ)</code> will also be a natural transformation, formed by composing the functor `M` with the natural transformation <code>γ</code>. Similarly, `(join G')` will be a natural transformation, formed by composing the natural transformation `join` with the functor `G'`; it will transform the functor `MMG'` to the functor `MG'`. Now take the vertical composition of the three natural transformations `(join G')`, <code>(M γ)</code>, and <code>φ</code>, and abbreviate it as follows:
200 γ <=< φ =def. ((join G') -v- (M γ) -v- φ)
203 Since composition is associative I don't specify the order of composition on the rhs.
205 In other words, `<=<` is a binary operator that takes us from two members <code>φ</code> and <code>γ</code> of `T` to a composite natural transformation. (In functional programming, at least, this is called the "Kleisli composition operator". Sometimes it's written <code>φ >=> γ</code> where that's the same as <code>γ <=< φ</code>.)
207 <code>φ</code> is a transformation from `F` to `MF'`, where the latter = `MG`; <code>(M γ)</code> is a transformation from `MG` to `MMG'`; and `(join G')` is a transformation from `MMG'` to `MG'`. So the composite <code>γ <=< φ</code> will be a transformation from `F` to `MG'`, and so also eligible to be a member of `T`.
209 Now we can specify the "monad laws" governing a monad as follows:
212 (T, <=<, unit) constitute a monoid
215 That's it. Well, there may be a wrinkle here. I don't know whether the definition of a monoid requires the operation to be defined for every pair in its set. In the present case, <code>γ <=< φ</code> isn't fully defined on `T`, but only when <code>φ</code> is a transformation to some `MF'` and <code>γ</code> is a transformation from `F'`. But wherever `<=<` is defined, the monoid laws are satisfied:
218 (i) γ <=< φ is also in T
220 (ii) (ρ <=< γ) <=< φ = ρ <=< (γ <=< φ)
222 (iii.1) unit <=< φ = φ (here φ has to be a natural transformation to M(1C))
224 (iii.2) φ = φ <=< unit (here φ has to be a natural transformation from 1C)
227 If <code>φ</code> is a natural transformation from `F` to `M(1C)` and <code>γ</code> is <code>(φ G')</code>, that is, a natural transformation from `FG` to `MG`, then we can extend (iii.1) as follows:
231 = ((unit <=< φ) G')
232 = ((join -v- (M unit) -v- φ) G')
233 = (join G') -v- ((M unit) G') -v- (φ G')
234 = (join G') -v- (M (unit G')) -v- γ
236 = (unit G') <=< γ
239 where as we said <code>γ</code> is a natural transformation from some `FG'` to `MG'`.
241 Similarly, if <code>φ</code> is a natural transformation from `1C` to `MF'`, and <code>γ</code> is <code>(φ G)</code>, that is, a natural transformation from `G` to `MF'G`, then we can extend (iii.2) as follows:
245 = ((φ <=< unit) G)
246 = (((join F') -v- (M φ) -v- unit) G)
247 = ((join F'G) -v- ((M φ) G) -v- (unit G))
248 = ((join F'G) -v- (M (φ G)) -v- (unit G))
250 = γ <=< (unit G)
253 where as we said <code>γ</code> is a natural transformation from `G` to some `MF'G`.
258 The standard category-theory presentation of the monad laws
259 -----------------------------------------------------------
260 In category theory, the monad laws are usually stated in terms of `unit` and `join` instead of `unit` and `<=<`.
263 P2. every element C1 of a category <b>C</b> has an identity morphism 1<sub>C1</sub> such that for every morphism f:C1→C2 in <b>C</b>: 1<sub>C2</sub> ∘ f = f = f ∘ 1<sub>C1</sub>.
264 P3. functors "preserve identity", that is for every element C1 in F's source category: F(1<sub>C1</sub>) = 1<sub>F(C1)</sub>.
267 Let's remind ourselves of some principles:
269 * composition of morphisms, functors, and natural compositions is associative
271 * functors "distribute over composition", that is for any morphisms `f` and `g` in `F`'s source category: <code>F(g ∘ f) = F(g) ∘ F(f)</code>
273 * if <code>η</code> is a natural transformation from `F` to `G`, then for every <code>f:C1→C2</code> in `F` and `G`'s source category <b>C</b>: <code>η[C2] ∘ F(f) = G(f) ∘ η[C1]</code>.
275 Let's use the definitions of naturalness, and of composition of natural transformations, to establish two lemmas.
278 Recall that join is a natural transformation from the (composite) functor `MM` to `M`. So for elements `C1` in <b>C</b>, `join[C1]` will be a morphism from `MM(C1)` to `M(C1)`. And for any morphism <code>f:C1→C2</code> in <b>C</b>:
281 (1) join[C2] ∘ MM(f) = M(f) ∘ join[C1]
284 Next, consider the composite transformation <code>((join MG') -v- (MM γ))</code>.
286 * <code>γ</code> is a transformation from `G` to `MG'`, and assigns elements `C1` in <b>C</b> a morphism <code>γ\*: G(C1) → MG'(C1)</code>. <code>(MM γ)</code> is a transformation that instead assigns `C1` the morphism <code>MM(γ\*)</code>.
288 * `(join MG')` is a transformation from `MMMG'` to `MMG'` that assigns `C1` the morphism `join[MG'(C1)]`.
293 (2) ((join MG') -v- (MM γ)) assigns to `C1` the morphism join[MG'(C1)] ∘ MM(γ*).
296 Next, consider the composite transformation <code>((M γ) -v- (join G))</code>.
299 (3) This assigns to C1 the morphism M(γ*) ∘ join[G(C1)].
302 So for every element `C1` of <b>C</b>:
305 ((join MG') -v- (MM γ))[C1], by (2) is:
306 join[MG'(C1)] ∘ MM(γ*), which by (1), with f=γ*: G(C1)→MG'(C1) is:
307 M(γ*) ∘ join[G(C1)], which by 3 is:
308 ((M γ) -v- (join G))[C1]
311 So our **(lemma 1)** is:
314 ((join MG') -v- (MM γ)) = ((M γ) -v- (join G)), where γ is a transformation from G to MG'.
318 Next recall that unit is a natural transformation from `1C` to `M`. So for elements `C1` in <b>C</b>, `unit[C1]` will be a morphism from `C1` to `M(C1)`. And for any morphism <code>f:a→b</code> in <b>C</b>:
321 (4) unit[b] ∘ f = M(f) ∘ unit[a]
324 Next consider the composite transformation <code>((M γ) -v- (unit G))</code>:
327 (5) This assigns to C1 the morphism M(γ*) ∘ unit[G(C1)].
330 Next consider the composite transformation <code>((unit MG') -v- γ)</code>.
333 (6) This assigns to C1 the morphism unit[MG'(C1)] ∘ γ*.
336 So for every element C1 of <b>C</b>:
339 ((M γ) -v- (unit G))[C1], by (5) =
340 M(γ*) ∘ unit[G(C1)], which by (4), with f=γ*: G(C1)→MG'(C1) is:
341 unit[MG'(C1)] ∘ γ*, which by (6) =
342 ((unit MG') -v- γ)[C1]
345 So our **(lemma 2)** is:
348 (((M γ) -v- (unit G)) = ((unit MG') -v- γ)), where γ is a transformation from G to MG'.
352 Finally, we substitute <code>((join G') -v- (M γ) -v- φ)</code> for <code>γ <=< φ</code> in the monad laws. For simplicity, I'll omit the "-v-".
355 for all φ,γ,ρ in T, where φ is a transformation from F to MF', γ is a transformation from G to MG', R is a transformation from R to MR', and F'=G and G'=R:
357 (i) γ <=< φ etc are also in T
359 (i') ((join G') (M γ) φ) etc are also in T
362 (ii) (ρ <=< γ) <=< φ = ρ <=< (γ <=< φ)
364 (ρ <=< γ) is a transformation from G to MR', so:
365 (ρ <=< γ) <=< φ becomes: (join R') (M (ρ <=< γ)) φ
366 which is: (join R') (M ((join R') (M ρ) γ)) φ
367 substituting in (ii), and helping ourselves to associativity on the rhs, we get:
369 ((join R') (M ((join R') (M ρ) γ)) φ) = ((join R') (M ρ) (join G') (M γ) φ)
370 ---------------------
371 which by the distributivity of functors over composition, and helping ourselves to associativity on the lhs, yields:
372 ------------------------
373 ((join R') (M join R') (MM ρ) (M γ) φ) = ((join R') (M ρ) (join G') (M γ) φ)
375 which by lemma 1, with ρ a transformation from G' to MR', yields:
377 ((join R') (M join R') (MM ρ) (M γ) φ) = ((join R') (join MR') (MM ρ) (M γ) φ)
379 which will be true for all ρ,γ,φ just in case:
381 ((join R') (M join R')) = ((join R') (join MR')), for any R'.
383 which will in turn be true just in case:
385 (ii') (join (M join)) = (join (join M))
388 (iii.1) (unit F') <=< φ = φ
390 (unit F') is a transformation from F' to MF', so:
391 (unit F') <=< φ becomes: (join F') (M unit F') φ
392 which is: (join F') (M unit F') φ
393 substituting in (iii.1), we get:
394 ((join F') (M unit F') φ) = φ
396 which will be true for all φ just in case:
398 ((join F') (M unit F')) = the identity transformation, for any F'
400 which will in turn be true just in case:
402 (iii.1') (join (M unit) = the identity transformation
405 (iii.2) φ = φ <=< (unit F)
407 φ is a transformation from F to MF', so:
408 unit <=< φ becomes: (join F') (M φ) unit
409 substituting in (iii.2), we get:
410 φ = ((join F') (M φ) (unit F))
412 which by lemma (2), yields:
414 φ = ((join F') ((unit MF') φ)
416 which will be true for all φ just in case:
418 ((join F') (unit MF')) = the identity transformation, for any F'
420 which will in turn be true just in case:
422 (iii.2') (join (unit M)) = the identity transformation
426 Collecting the results, our monad laws turn out in this format to be:
429 when φ a transformation from F to MF', γ a transformation from F' to MG', ρ a transformation from G' to MR' all in T:
431 (i') ((join G') (M γ) φ) etc also in T
433 (ii') (join (M join)) = (join (join M))
435 (iii.1') (join (M unit)) = the identity transformation
437 (iii.2')(join (unit M)) = the identity transformation
442 7. The functional programming presentation of the monad laws
443 ------------------------------------------------------------
444 In functional programming, unit is usually called "return" and the monad laws are usually stated in terms of return and an operation called "bind" which is interdefinable with <=< or with join.
446 Additionally, whereas in category-theory one works "monomorphically", in functional programming one usually works with "polymorphic" functions.
448 The base category <b>C</b> will have types as elements, and monadic functions as its morphisms. The source and target of a morphism will be the types of its argument and its result. (As always, there can be multiple distinct morphisms from the same source to the same target.)
450 A monad M will consist of a mapping from types C1 to types M(C1), and a mapping from functions f:C1→C2 to functions M(f):M(C1)→M(C2). This is also known as "fmap f" or "liftM f" for M, and is called "function f lifted into the monad M." For example, where M is the list monad, M maps every type X into the type "list of Xs", and maps every function f:x→y into the function that maps [x1,x2...] to [y1,y2,...].
455 A natural transformation t assigns to each type C1 in <b>C</b> a morphism t[C1]: C1→M(C1) such that, for every f:C1→C2:
456 t[C2] ∘ f = M(f) ∘ t[C1]
458 The composite morphisms said here to be identical are morphisms from the type C1 to the type M(C2).
462 In functional programming, instead of working with natural transformations we work with "monadic values" and polymorphic functions "into the monad" in question.
464 For an example of the latter, let φ be a function that takes arguments of some (schematic, polymorphic) type C1 and yields results of some (schematic, polymorphic) type M(C2). An example with M being the list monad, and C2 being the tuple type schema int * C1:
466 let φ = fun c → [(1,c), (2,c)]
468 φ is polymorphic: when you apply it to the int 0 you get a result of type "list of int * int": [(1,0), (2,0)]. When you apply it to the char 'e' you get a result of type "list of int * char": [(1,'e'), (2,'e')].
470 However, to keep things simple, we'll work instead with functions whose type is settled. So instead of the polymorphic φ, we'll work with (φ : C1 → M(int * C1)). This only accepts arguments of type C1. For generality, I'll talk of functions with the type (φ : C1 → M(C1')), where we assume that C1' is a function of C1.
472 A "monadic value" is any member of a type M(C1), for any type C1. For example, a list is a monadic value for the list monad. We can think of these monadic values as the result of applying some function (φ : C1 → M(C1')) to an argument of type C1.