Chapter 11: Transform Again, Naturally

We are about to discuss natural transformations in the context of practical utility in every day code. It just so happens they are a pillar of category theory and absolutely indispensable when applying mathematics to reason about and refactor our code. As such, I believe it is my duty to inform you about the lamentable injustice you are about to witness undoubtedly due to my limited scope. Let’s begin.

Curse This Nest

I’d like to address the issue of nesting. Not the instinctive urge felt by soon to be mothers wherein they tidy and rearrange with obsessive compulsion, but the…well actually, come to think of it, that isn’t far from the mark as we’ll see in the coming chapters… In any case, what I mean by nesting is to have two or more different types all huddled together around a value, cradling it like a newborn, as it were.

  1. Right(Maybe('b'));
  3. IO(Task(IO(1000)));
  5. [Identity('bee thousand')];

Until now, we’ve managed to evade this common scenario with carefully crafted examples, but in practice, as one codes, types tend to tangle themselves up like earbuds in an exorcism. If we don’t meticulously keep our types organized as we go along, our code will read hairier than a beatnik in a cat café.

A Situational Comedy

  1. // getValue :: Selector -> Task Error (Maybe String)
  2. // postComment :: String -> Task Error Comment
  3. // validate :: String -> Either ValidationError String
  5. // saveComment :: () -> Task Error (Maybe (Either ValidationError (Task Error Comment)))
  6. const saveComment = compose(
  7.   map(map(map(postComment))),
  8.   map(map(validate)),
  9.   getValue('#comment'),
  10. );

The gang is all here, much to our type signature’s dismay. Allow me to briefly explain the code. We start by getting the user input with getValue('#comment') which is an action which retrieves text on an element. Now, it might error finding the element or the value string may not exist so it returns Task Error (Maybe String). After that, we must map over both the Task and the Maybe to pass our text to validate, which in turn, gives us back Either a ValidationError or our String. Then onto mapping for days to send the String in our current Task Error (Maybe (Either ValidationError String)) into postComment which returns our resulting Task.

What a frightful mess. A collage of abstract types, amateur type expressionism, polymorphic Pollock, monolithic Mondrian. There are many solutions to this common issue. We can compose the types into one monstrous container, sort and join a few, homogenize them, deconstruct them, and so on. In this chapter, we’ll focus on homogenizing them via natural transformations.

All Natural

A Natural Transformation is a “morphism between functors”, that is, a function which operates on the containers themselves. Typewise, it is a function (Functor f, Functor g) => f a -> g a. What makes it special is that we cannot, for any reason, peek at the contents of our functor. Think of it as an exchange of highly classified information - the two parties oblivious to what’s in the sealed manila envelope stamped “top secret”. This is a structural operation. A functorial costume change. Formally, a natural transformation is any function for which the following holds:

natural transformation diagram

or in code:

  1. // nt :: (Functor f, Functor g) => f a -> g a
  2. compose(map(f), nt) === compose(nt, map(f));

Both the diagram and the code say the same thing: We can run our natural transformation then map or map then run our natural transformation and get the same result. Incidentally, that follows from a free theorem though natural transformations (and functors) are not limited to functions on types.

Principled Type Conversions

As programmers we are familiar with type conversions. We transform types like Strings into Booleans and Integers into Floats (though JavaScript only has Numbers). The difference here is simply that we’re working with algebraic containers and we have some theory at our disposal.

Let’s look at some of these as examples:

  1. // idToMaybe :: Identity a -> Maybe a
  2. const idToMaybe = x => Maybe.of(x.$value);
  4. // idToIO :: Identity a -> IO a
  5. const idToIO = x => IO.of(x.$value);
  7. // eitherToTask :: Either a b -> Task a b
  8. const eitherToTask = either(Task.rejected, Task.of);
  10. // ioToTask :: IO a -> Task () a
  11. const ioToTask = x => new Task((reject, resolve) => resolve(x.unsafePerform()));
  13. // maybeToTask :: Maybe a -> Task () a
  14. const maybeToTask = x => (x.isNothing ? Task.rejected() : Task.of(x.$value));
  16. // arrayToMaybe :: [a] -> Maybe a
  17. const arrayToMaybe = x => Maybe.of(x[0]);

See the idea? We’re just changing one functor to another. We are permitted to lose information along the way so long as the value we’ll map doesn’t get lost in the shape shift shuffle. That is the whole point: map must carry on, according to our definition, even after the transformation.

One way to look at it is that we are transforming our effects. In that light, we can view ioToTask as converting synchronous to asynchronous or arrayToMaybe from nondeterminism to possible failure. Note that we cannot convert asynchronous to synchronous in JavaScript so we cannot write taskToIO - that would be a supernatural transformation.

Feature Envy

Suppose we’d like to use some features from another type like sortBy on a List. Natural transformations provide a nice way to convert to the target type knowing our map will be sound.

  1. // arrayToList :: [a] -> List a
  2. const arrayToList = List.of;
  4. const doListyThings = compose(sortBy(h), filter(g), arrayToList, map(f));
  5. const doListyThings_ = compose(sortBy(h), filter(g), map(f), arrayToList); // law applied

A wiggle of our nose, three taps of our wand, drop in arrayToList, and voilà! Our [a] is a List a and we can sortBy if we please.

Also, it becomes easier to optimize / fuse operations by moving map(f) to the left of natural transformation as shown in doListyThings_.

Isomorphic JavaScript

When we can completely go back and forth without losing any information, that is considered an isomorphism. That’s just a fancy word for “holds the same data”. We say that two types are isomorphic if we can provide the “to” and “from” natural transformations as proof:

  1. // promiseToTask :: Promise a b -> Task a b
  2. const promiseToTask = x => new Task((reject, resolve) => x.then(resolve).catch(reject));
  4. // taskToPromise :: Task a b -> Promise a b
  5. const taskToPromise = x => new Promise((resolve, reject) => x.fork(reject, resolve));
  7. const x = Promise.resolve('ring');
  8. taskToPromise(promiseToTask(x)) === x;
  10. const y = Task.of('rabbit');
  11. promiseToTask(taskToPromise(y)) === y;

Q.E.D. Promise and Task are isomorphic. We can also write a listToArray to complement our arrayToList and show that they are too. As a counter example, arrayToMaybe is not an isomorphism since it loses information:

  1. // maybeToArray :: Maybe a -> [a]
  2. const maybeToArray = x => (x.isNothing ? [] : [x.$value]);
  4. // arrayToMaybe :: [a] -> Maybe a
  5. const arrayToMaybe = x => Maybe.of(x[0]);
  7. const x = ['elvis costello', 'the attractions'];
  9. // not isomorphic
  10. maybeToArray(arrayToMaybe(x)); // ['elvis costello']
  12. // but is a natural transformation
  13. compose(arrayToMaybe, map(replace('elvis', 'lou')))(x); // Just('lou costello')
  14. // ==
  15. compose(map(replace('elvis', 'lou'), arrayToMaybe))(x); // Just('lou costello')

They are indeed natural transformations, however, since map on either side yields the same result. I mention isomorphisms here, mid-chapter while we’re on the subject, but don’t let that fool you, they are an enormously powerful and pervasive concept. Anyways, let’s move on.

A Broader Definition

These structural functions aren’t limited to type conversions by any means.

Here are a few different ones:

  1. reverse :: [a] -> [a]
  3. join :: (Monad m) => m (m a) -> m a
  5. head :: [a] -> a
  7. of :: a -> f a

The natural transformation laws hold for these functions too. One thing that might trip you up is that head :: [a] -> a can be viewed as head :: [a] -> Identity a. We are free to insert Identity wherever we please whilst proving laws since we can, in turn, prove that a is isomorphic to Identity a (see, I told you isomorphisms were pervasive).

One Nesting Solution

Back to our comedic type signature. We can sprinkle in some natural transformations throughout the calling code to coerce each varying type so they are uniform and, therefore, joinable.

  1. // getValue :: Selector -> Task Error (Maybe String)
  2. // postComment :: String -> Task Error Comment
  3. // validate :: String -> Either ValidationError String
  5. // saveComment :: () -> Task Error Comment
  6. const saveComment = compose(
  7.   chain(postComment),
  8.   chain(eitherToTask),
  9.   map(validate),
  10.   chain(maybeToTask),
  11.   getValue('#comment'),
  12. );

So what do we have here? We’ve simply added chain(maybeToTask) and chain(eitherToTask). Both have the same effect; they naturally transform the functor our Task is holding into another Task then join the two. Like pigeon spikes on a window ledge, we avoid nesting right at the source. As they say in the city of light, “Mieux vaut prévenir que guérir” - an ounce of prevention is worth a pound of cure.

In Summary

Natural transformations are functions on our functors themselves. They are an extremely important concept in category theory and will start to appear everywhere once more abstractions are adopted, but for now, we’ve scoped them to a few concrete applications. As we saw, we can achieve different effects by converting types with the guarantee that our composition will hold. They can also help us with nested types, although they have the general effect of homogenizing our functors to the lowest common denominator, which in practice, is the functor with the most volatile effects (Task in most cases).

This continual and tedious sorting of types is the price we pay for having materialized them - summoned them from the ether. Of course, implicit effects are much more insidious and so here we are fighting the good fight. We’ll need a few more tools in our tackle before we can reel in the larger type amalgamations. Next up, we’ll look at reordering our types with Traversable.

Chapter 12: Traversing the Stone

Exercises

{% exercise %}
Write a natural transformation that converts Either b a to Maybe a

{% initial src=”./exercises/ch11/exercise_a.js#L3;” %} 

  1. // eitherToMaybe :: Either b a -> Maybe a  
  2. const eitherToMaybe = undefined;

{% solution src=”./exercises/ch11/solution_a.js” %}
{% validation src=”./exercises/ch11/validation_a.js” %}
{% context src=”./exercises/support.js” %}
{% endexercise %} 

  1. // eitherToTask :: Either a b -> Task a b
  2. const eitherToTask = either(Task.rejected, Task.of);

{% exercise %}
Using eitherToTask, simplify findNameById to remove the nested Either.

{% initial src=”./exercises/ch11/exercise_b.js#L6;” %} 

  1. // findNameById :: Number -> Task Error (Either Error User)  
  2. const findNameById = compose(map(map(prop('name'))), findUserById);

{% solution src=”./exercises/ch11/solution_b.js” %}
{% validation src=”./exercises/ch11/validation_b.js” %}
{% context src=”./exercises/support.js” %}
{% endexercise %}

As a reminder, the following functions are available in the exercise’s context:

  1. split :: String -> String -> [String]
  2. intercalate :: String -> [String] -> String

{% exercise %}
Write the isomorphisms between String and [Char].

{% initial src=”./exercises/ch11/exercise_c.js#L8;” %} 

  1. // strToList :: String -> [Char]  
  2. const strToList = undefined;  
  4. // listToStr :: [Char] -> String  
  5. const listToStr = undefined;

{% solution src=”./exercises/ch11/solution_c.js” %}
{% validation src=”./exercises/ch11/validation_c.js” %}
{% context src=”./exercises/support.js” %}
{% endexercise %}