The Methods Of Science & Medieval Rainbows

It happened again! I love it when my interests align.

Not too long ago, Veritasium released a fascinating video on the physics of rainbows—which you should totally watch. In that video they discuss the mechanics of how light waves of differing wavelengths refract in water droplets to form various kinds of single and double-banded rainbows. The video is a pitch to get the viewer to question their prior knowledge of how rainbows work and then it uses that question to dive in to the deeper physics of light that explain an otherwise common phenomenon.

Source: Veritasium

What I didn't expect to find, was that rainbows are not just interesting mechanistically, but that they were a particularly insightful topic of discussion for medieval scholastics when debating the importance of scientific experimentation itself!

Beware, we're going deep into the weeds!

The Issue of Experiment

In order for this to make any sense, we need to dive a bit into how ancient and medieval peoples (and some modern historians thereof) understood their world.

Medieval scholars were not idiots, as some might sometimes conceive today. They had a very nuanced and complex way of understanding and classifying the natural world. The trouble is that it is a very different method of understanding than we use today and that can be very confusing for us moderns to understand. Particularly we have to consider the role of experimentation in ancient and medieval natural philosophy, which was heavily influenced by Aristotle (aka the Stagirite).

I think this quote from Dr. Peter Dear sums the prevalent understanding up pretty well:

"For Aristotelians, by contrast, the philosopher learned to understand nature by observing and contemplating its ordinary course, not by interfering with that course and thereby corrupting it."

Promethean Ambitions, William Newman. p 240 Footnote 8. A quote by Peter Dear from Revolutionnizing the Sciences: European Knowledge and its Ambitions

Now, you might ask yourself: why did they think this way? What reason could the ancients and medievals have for such a strange seeming conclusion? Well, consider this quote from Antonio Perez-Ramos.

"What is the point...of making or constructing something in order to gain insight into Nature's mysteries if we posit from the very start that no productions of human technology can remotely equal or even approach the essence and subtlety of natural processes?"

Promethean Ambitions, William Newman. p 241 Footnote 9. A quote by Antonio Perez-Ramos from Bacon's Forms and the Maker's Knowledge (Emphasis mine).

This assumption, made axiomatically for centuries, is critical if one is to understand this branch of ancient and medieval theory. And while it is true that not all scholars of the time believed such things (as we will see) it is true for many. As such it is/was a prevalent view in the works of many historians as well, a phenomenon that Dr. William Newman calls the noninterventionist fallacy.

The noninterventionist fallacy [is the idea] that the Stagirite and his followers were fundamentally nonexperimental or even actively opposed to experiment, because experimentation involved intervention in natural processes… Indeed, in [this] view, avoidance of artificial intervention was a necessary consequence of the Aristotelian conception of natural science. Since Aristotle defined an object's "nature" as the sum of its regularly occurring properties, any attempt to isolate the object from its normal environment could only interfere with its nature. Since experiment relies on precisely such interference… it becomes ipso facto useless in Aristotelian natural science.1

- Promethean Ambitions, William Newman. p 238-240 (Emphasis mine).

However Newman argues that this fallacy is just that: a fallacy, and that his colleagues (historians of science) should not interpret all medieval or ancient sources this way precisely because Aristotle himself didn't follow the noninterventionist mold, and neither did a very studious set of his later disciples.

The Solution in Rainbows

Theodoric's epic diagram! He and Veritasium were on the same path with their visuals.

One of the examples of ancient and medievalist scientific experimentation comes to us from the writings of Aristotle himself and his later followers.

Aristotle wrote extensively about how rainbows could be formed by the splash and spray of an oar, and later writers like Albertus Magnus and Robert Bacon experimented with making rainbows from glass vessels, spray, wet rags, and more. Albertus "used vessels filled with water to replicate the individual drops of water in a rainbow," and a wet rag to "produce a fine mist and the attendant spectrum."2 Albertus then proceeds to replicate Aristotle's experiments with the oar.

However the culmination of the experimentation on this topic has to be the work of Theodoric of Freiburg who wrote in the first decades of the fourteenth century.

Theodoric managed to use the experimental techniques that we have already described to prove that the rainbow came about from a double refraction and a single reflection within each drop of water. He even managed to explain the formation of the common secondary bow in terms of a double refraction and a double reflection (fig 5.1).

- Promethean Ambitions, William Newman. p 244

What's more, this idea that all Aristotelian natural philosophers denied the usefulness of experiment is refuted by none other than a medieval scholar himself, Themo Judaei when discussing the merits of scientific experimentation and its regard to rainbows and their accompanying halos.

Likewise it must be known that it is said in the title of the question: "just as the rainbow or halo etc.," because it is difficult to know well the composition or manner of composing metals, just as it is difficult to know the way of generating the rainbow. And unless we knew how to make or see the rainbow and its color, as well the halo, by means of art, we would hardly be led to an understanding of the rainbow or the halo—and how they come to be thus.3

Quaestiones, Themo Judaei. Question 27.

He goes on to discuss the relevance of this knowledge to experimentation via a chemical method of making gold, but that is another story.4

1 I get serious "modern questions on the philosophy of Quantum Mechanics" vibes from this.
2 Newman, P 244.
3 "Art" here means the artificial making of things in any way, not just, like, painting—though painting is indeed a kind of art in this definition.
4 While chemically impossible, need I remind you, we can actually do this today so I think the point remains quite valid.

The Practicals Of Writing: Paper And Pens

Without wishing to turn this into a writing & pen blog, I did want to talk a little more about the kit I use these days, if only because I figure some readers out there might find it interesting or useful.

For a long time, I bought several different kinds of notebooks—and pens—looking for the right fit for my needs. Eventually, I landed on a setup that I'm very happy with.

A Good Notebook

When it comes to notebooks, I have a set of firm criteria and a wishlist of nice-to-haves.

As some readers might know, I'm left handed and that heavily influences my criteria. I want a notebook with a spine that is thin enough to impact my writing, but at the same time is thick enough to have a meaningful spine presence on a shelf such that I could label the spine and read it. I have a lot of books and notebooks and being able to find things on the shelf quickly matters.

I tried hardbound book blanks (which look amazing on the shelf), but they're a pain to write in because of the thick spine. After that I tried super thin notebooks, but they don't have enough shelf-presence for a spine label and, importantly, they are so thin that they don't contain enough meaningful space for the notes I want to take. Topics spread across volumes and that makes organizing hard.

I tried so called Executive or Professional Notebooks, these are lovely to look at and hold, and they're great on the shelf, but they're just too big to be easily portable. I like to have a notebook with me at all times and these are simply too big for that.

Just a few of my notebooks.

That's when I found my solution, a solution that'd been staring me in the face for a long time.

It's silly to think that my perfect notebook is the simple composition book, but I think it might be. They're super cheap (often only 50¢) and the colored covers (which formed the foundation of my early schooling organizational system) are very useful. They're thick enough to have a good spine, but lay flat on the table. There's enough pages for a meaningful amount of writing, but not so much that filling it feels like a monumental task. I can carry two or three at once in my bag and they're very light and the covers are slightly waterproof—a welcome feature for the occasional coffee spill. The only real downside is that the low price point means that the paper quality is very bad. Personally, I've found that you can offset some of this by choosing the right brand, but it's a fundamental flaw. Still, I'm using them and love them.

What's in a Pen?

I'm not going to discuss pencils here, even though I use a lot of them, simply because Ticonderoga pencils are great and you can just use those.

When it comes to pens though, I have more nuanced thoughts.

Years ago, I preferred gel pens, but they suck for left-handers. The ink dries so slowly that it coats the hand in black smudges. From there I moved on to a hodgepodge of ballpoints and never really found one I liked.

For a while I used a branded metal ballpoint pen from that my Dad took home from work (one of those corporate perks). These felt great in the hand, but they were not great writing implements—and they exclusively came with blue ink, which was a huge detriment. Blue ink sucks.

Photo: mine

Years back, I went to Japan on a vacation with some friends. There I bought a cheap notebook and pen from a convenience store on a whim and then proceeded to fall in love with the pen I randomly picked up there. I've used them ever since and while they are cheap, they write extremely well and, crucially, the fine point and particular ink dries very quickly. No smudges on the page, or on my hand! It's a great pen for left-handers. Now, I prefer a very fine point, so that might be a turn off for some people, but I do recommend these pens.

In other places I use my fountain pens, though I've basically stopped using my dip pens just because they're a hassle. I still love my fountain pens but those Zebra Sarasa pens have stolen my heart.

For the record: None of this is an ad for any item mentioned here. I just like them.

If you're reading this and you have other suggestions to solve these same problems, I'd love to hear them.

Also, like I mentioned in my previous post, I've started a newsletter. If you like this post and want to get future posts delivered straight to your inbox, then subscribe!

Starting A Newsletter

You should subscribe to my newsletter!

I'm a few years late to the trend here, but I've gone ahead and set up a newsletter for those of you that are interested in getting these posts delivered direct to your inbox.

I personally use an RSS reader, though I realize that I'm a dying breed these days, but I don't want to exclude anyone who wants to see my posts but just isn't into RSS.

This has been a long time coming, so I'm happy to finally have it done. You can subscribe to this post and all my upcoming ones at the link above.

Don't worry, nothing is going to change here. I'm just adding a new way to follow this blog. There's a lot more to come and I promise you, it'll be exciting stuff.

You should subscribe :)

Developing Style: Writing Cursive Two Years In

Over a year ago, I switched to writing entirely in cursive and wrote at length on the techniques and methods I used to re-learn it. This post is an update to those earlier two in which I will dive into the beautiful process I've undertaken trying to develop a personal style for my handwriting.

I still write a lot and I'd estimate that well over 95% of that writing is in cursive. Doing something so much and with deliberate intent will doubtless improve one's skill but, countering that progress, is the speed at which I write. So my writing ends up looking a bit like a doctor's scrawl—if a bit more legible.

A picture of my current handwriting.
Photo: mine

Adding Personal Flair

However, the lovely thing about writing by hand is that the skill is incredibly personal. Letterforms are standardized and designed for speed and ease of use, but nothing says you actually have to use all of them as designed. I have always loved how older (1800–1950s) style writing looks and so I wanted to try to emulate those forms where possible. As well, several capital letters are tricky to write consistently and I do not mind occasionally lifting my pen at the start of a sentence. Important too, I changed some letters because I don't like how they look in their standard form.

This led me to abandon several letter forms like the H, F, T, A, and both versions of the letter Z in favor of simpler or more stylistic alternatives.

Several letterforms I have changes
Photo: mine

These changes make my writing feel like it's actually mine. It's a strange feeling, coming from the world of digital type, but the letters you write can be truly yours if you invest the time to make them so.

Technical Changes

What may be more difficult to notice is the changes I've made to how I hold and push the pen. These changes help me better emulate the style I prefer but they also make it much easier to write for longer durations. Older styles of writing focused on larger letterforms and swirls because the hand wasn't the primary mode of pen-transport; instead the whole arm was involved! This was largely because your arm gets tired more slowly and so a style like that is more suited to jobs where you'd be writing all day.

As well, the authors of handwriting styles are almost always right-handed, something I can never truly escape. Writing left-handed involves deciphering and deconstructing the motions and techniques for writing and reconstructing them in a way that works for you. I end up pushing my pen left-to-right at an angle far more parallel to the page than before—where as a right-handed person would drag their pen the same way. Along with this, I try to use my arm and shoulder to move my pen more often than not and these techniques combined lead to gaps in some letter forms as the pen is not intended to be used this way, and it slants the letters more steeply.

A larger sample picture of my current handwriting.
A larger sample of my writing related to a recent blog post on narrative action.
Click to view a larger version. Photo: mine

Legibility Concerns

No doubt there are readers who are currently thinking: your writing is completely illegible! What good is it if I can't read it‽ Well I have two answers to that question:

First, my writing is primarily for my own consumption and so it matters little to me if others can read it, I certainly can. But secondly, one thing I've found fascinating is that by learning to read and write cursive as I have, even with a modern or personal style, I have a lot less trouble reading other people's handwriting than I did before!

I personally love this YouTube channel: Objectivity, where they trawl through the Archives of the Royal Society and read old writing, and a common joke in the videos is that only Keith, the Head Librarian can read any of the letters they pull out. However that's not because he's some expert in handwriting, it's because he's used to doing so! I find myself no longer struggling as much to read the same kinds of letters now that I perform the daily practice of deciphering my own handwriting!

So in short, things go well with this little quest of mine. It's been a long road to get here, and tons of ink has been spilt to make it so, but I still recommend it, for no other reason than it feels good to have done.

Narrative Structure And The Principle Of Least Action

I love reading and watching non-fiction because it never answers a question without raising many more. The process of learning and discovery is a never ending quest to slay the hydra. Every severed head—every answered question—only brings with it more heads to slay. This all brings me to an insight that occurred to me the other day after rewatching a Veritasium video on the discovery of the Principle of Least Action—for like the fifteenth time.

Perhaps narrative structures, stories, also obey this same principle.

Action, Briefly Explained

For those who don't know about the Principle of Least Action, you should watch the video—it's great. But in short, Action is a concept in physics. Specifically, it's the combination of mass, distance, and velocity, the minimization of which seems to underpin the motion of all objects in the universe. Action alone seems to determine the trajectory of objects in space, that is the path they take as they move.1 In our modern theories of physics Action is fundamental, and Nature seems to do her best to minimize the expense of it.

A picture of a set of possible curves between two points on a 2-d plane.
A visualization of all possible paths a particle might take as it moves. Photo credit: Veritasium

Of all the possible paths that an object could take as it moves, it seems that objects in free-fall motion always move along the specific trajectory which minimizes the Action.

Narration viewed as Action

In writing there is a principle called Chekhov's gun, which states simply that:

If in the first act you have hung a pistol on the wall, then in the following one it should be fired. Otherwise don't put it there.

The point is to rid your story of extraneous elements. Detail must serve a narrative purpose; it must be justified. In a way, this is similar to the Principle of Parsimony (a.k.a. Occam's Razor) which is commonly paraphrased as, "of two competing theories, the simpler explanation of an entity is to be preferred." As a writer, your job is to craft a world and a narrative that fits disparate information together into a seamless whole. The better story is the one which requires fewer assumptions by the reader and omits extraneous information. This might be otherwise phrased as crafting a "tight" story. A tight story with a good ending is one that minimizes the information required for a reader to find the narrative and its completion engaging, one that ties up loose ends, and one that gives the reader the feeling of satisfaction and closure.

A picture of a set of books on physics together with several good stories and a hint that they are related.
Grand Unification?

Stories exist in an abstract space with many more dimensions than our familiar 3-D space would allow me to depict. However the story is still singular, it follows a well-defined path traced by its words through this space and my argument is that the "ideal path", the one which the author ought to prefer when writing, is the one which minimizes the Action in that space.

To be clear, I do not have a rigorous formulation for this idea, it's an idle musing after all, but upon reflection it seems to comport with my intuition about good writing. Perhaps a thought experiment will help.

A (Totally Rigorous) Proof

Consider two points on the Plane with the X & Y dimensions quantifying some range of values for narrative structure: say the amount of world-building in a scene vs the progression of the story over all. Moving "up" on this chart means adding more backstory, while moving "right" is progressing the story.

A picture of two points on the 2-D plane connected by a single trajectory and a slightly different trajectory which quote uses endquote more action
A point in the story begins at point A (at page α) and moves to point B (at page β). Photo credit: Veritasium

Now, the story will likely have many, many more dimensions than this, but stay with me.

The story itself then is a curve which connects the two points at a given page count. This curve, or the path of the story as it moves through pages, can take many forms. However the one it should take under the principle above is the one which minimizes the Narrative Action (which we have not, and will not, formally define).2

Now consider altering this curve by adding additional detail about the world. This detail is by definition unnecessary to the story because the minimal path exists from point A to point B as defined above. Therefore that detail would only increase the total Narrative Action and should be removed.3

In this way, the writer should emulate Nature in her effort to minimize all information in their story which is not required to attain the desired effect. Obviously the hard part is actually intuiting the true path that does this, but I'm not here to tell you how to be a good writer, that's too hard. Still, these ideas do seem connected, or perhaps that's just me.

1. Yes, curvature is also a thing. Also Quantum. Ignore it.

2. Out of scope for this conversation.

3. Associated with this is the idea that a story should create stresses, that is ask questions, which are relaxed or resolved by later sections. That tension is critical, but the path followed from the author's insertion of that tension (akin to the throwing of a ball which disturbs it from free-fall motion) and the resolution of it (the ball's final destination) should still follow this principle.

Experts In The Internet Age: The Power Of Email

These days I spend a fair bit of my time emailing libraries in order to get access to research materials for a project I'm working on, and I'd like to share what has become a very typical experience for me and one that I think more people should know about.

tl;dr librarians are amazing and incredibly helpful.

It all started in the way most things do these days: with a search and a random recommended result.

At the time, I was looking into several different genres of music played during the seventeenth and eighteenth centuries (1600-1700) across Europe and the Middle East. Specifically I was looking into English/American Colonial and Romanian Folk. I came across several incredible melodies—including one that immediately stole my heart even though it wasn't at all what I was looking for—and I eventually stumbled on this tune captured by a visitor to Colonial Williamsburg:

This was precisely what I was looking for, but the song came in with no introduction and the video itself contained no further clues as to what this song even was. I wanted to know more about it (and potentially find the source of the melody and others like it) but I was starting from a pretty bare slate.

I started my research by trying to find any information on the Colonial Williamsburg site as to the kinds of music their performers play, but that went nowhere. So, I headed over to my piano and deciphered the tune by ear so that I could potentially look up the sheet music. However no music search engine I could find could tell me what the song was. I was running low on options now, so I did what I've now done several times: I emailed the Colonial Williamsburg Research department and simply asked if they could help.

A few days later I had a response:

[Our] Performing Arts dept [says] that the clip you have is a medley of songs. They're from the John Playford English Dancing Master collection of tunes, and are called, ‘Cockleshells,’ and ‘Oranges and Lemons.’ (emphasis mine)

Perfect. I had a source. Even better: that source is on the Internet Archive.

A screenshot of the songbook mentioned earlier contining the music for Cockleshells.
Photo credit: Internet Archive

Now, some readers might be asking why I am telling this story at all. Didn't I simply send an email and get a reply? Yes. I did. But that's precisely why I feel so compelled to tell it.

These days the internet is a beast with two heads: seemingly everything is available on it, yet we have trouble finding anything. Mathematicians sometimes refer to this phenomenon as the problem of finding the hay in a haystack. We're surrounded by information and yet overwhelmed by any ability to actually navigate it to find what we want.

Amidst this chaos, I have continued to find guidance and help in the form of the under-appreciated experts who staff our libraries and research institutes. There is only so much that independent research can accomplish and it's hard to remember that you can ask for help.

In the past few years I've sent dozens of emails like this one and always received helpful responses. Increasingly, in our ever-connected world, data may exist on the internet, but we might find that we will end up relying on the knowledge of the experts in the physical realm to find it.

The internet has made so much content and information available at our fingertips, but perhaps the most powerful fragment of that content is a simple email address.

I've said it before, and I'll say it again: even with all its many flaws, I love email. When in doubt, you can simply ask.

What if: Bookclub, but AI?

A while back I had a free evening and a silly idea, and what resulted was an interesting exploration of the large-context behavior and analytical capabilities of modern LLMs (ChatGPT in my case). The idea was very simple:

What would happen if ChatGPT hosted a bookclub with itself?

Now, this is—of course—a very serious question with very serious implications for the trajectory of modern technology, so I set out on a quest to answer mankind's greatest curiosity.

A few hours later, I had my answer, so let's go over it, shall we?

The Why

There has long been a common notion in the Discourse that—since LLMs are trained on public internet data and since that data is increasingly polluted with AI spam content—the general quality of AI-generated results would degrade over time.

As well it's widely known that even the most top-quality LLMs today generally return banal, shallow, and overly friendly responses, even when prompted not to (in some cases because of explicit training to do so), and I was curious to see what would happen if GPT was given the opportunity to converse, long-form, over time with a disparate group of minds. I was interested to see if GPT would overcome its preference for lackluster observations when summarizing text and genuinely discover something novel. To do this, I knew I couldn't simply ask it questions about a given text in its training set, I would need to instruct it to conduct an elaborate play of personalities, each of whom would read and summarize the text in their own way.

Getting it Together

The code itself isn't very exciting. I cobbled together a little Python script that would take in a set of personality files for each of my several bookclub participants and then randomly choose between them for who was going to speak next. To keep things consistent, the script would keep a log of the dialogue as it went and submit that with each request.

As I played with the script, I made two changes, each of which significantly improved the conversation. First, I made it so that each participant would be primed by feeding ChatGPT the given personality and the chapter text, and then I asked GPT to summarize the chapter in the perspective of the given person. That summary would then be added to the given person's mind-state. Second, I added a bias in the random choice of speaker that preferred any names mentioned in the prior response—GPT often referred to other characters by name and it would be natural for that person to respond directly.

Both of these changes inspired several additional ideas for future improvements, but we'll get to that in a minute. For now, let's see what happened when the script did its thing.

Ready, Set, Bookclub!

The Cover of the Book assigned for that week's session: The Purple Cloud

The book I had originally lined up for this was Pride and Prejudice as it's easily available in the public domain. However that choice proved useless as ChatGPT knew too much about the book from its training set. I needed something it had rarely encountered before so that I could test its observational prowess.

Hence I chose a book I read a few years back: The Purple Cloud, by M.P. Shiel.

All that was left was to craft a series of personalities to enact my little play, and so I set to crafting some backstories and, like a director: I set the scene.

ChatGPT's Scene Instructions & Motivation GPT receiving character motivations before the show

I workshopped these quite a bit, but I know there's more to do. Obviously I could have tried custom assistants, but that is discussed more below.

At first, I was pleasantly surprised. Each of GPT's personas invented motivations and expanded on their backstories, and GPT never seemed confused about who was talking and easily tracked the flow of the conversation. Characters routinely invented novel conversation topics and helped to slowly invent the character of the world around them.

However it didn't take long before things went awry.

On several attempts, one of my characters would pour wine for the group (a kind enough gesture), and the group would all toast and thank each other for coming out for the evening. However, it seems no where in GPT's training data does it contain any reference to narrative pacing or what to do in order to finish a toast, and so the conversation would inanely continue on and on as each character added more to the toast, and never once did any of them decide to actually drink. 🥂

A screenshot of the output of the script.

In future attempts, I intend to add another personality to act as a sort of stage direction bot, whose only job is to add occasional scene changes that the characters would be assumed to observe. This, hopefully, would alleviate this issue and help to avoid the next one:

Once GPT established a scene, it never changed or evolved. This was surprising as over time all sorts of conversational details were being added to the chat: discussions of the book chapter, character moments, and backstory were ripe for use, but the conversations only ever got duller as they went on. Soon characters were agreeing to visit a consistently invented, newly-opened, vegan cafe with apparently fantastic croissants, but as the small talk progressed characters would endlessly revisit topics, gush pointlessly, and never add anything novel of value.

And that leads me to my most interesting observation: the conversation always died without any insight into or worthwhile analysis of the book chapter provided. Sure, characters would discuss the most superficial of elements and it was all incredibly mundane. Discussion was largely focused on the sense of foreboding mood found in the chapter or on the director's stage direction for some of the characters to be put off by the often unwieldy prose. For all it's might, GPT couldn't even be bothered to bring up specifics of the main character's arctic expedition, comment on any specific character's motivations or plot drama, or even try to predict the ending.

A screenshot of the output of the script.
Overall (perceived) conversational quality.

And invariably, one of my characters would ask when the eponymous Purple Cloud would appear, to which another would reply that it "sounded ominous". GPT it seems is about as good at analyzing novel text as a high-schooler who only read the back-of-the-book blurb (read: myself in high-school).

What Does It All Mean?

In general, I was less-than-impressed with GPT's abilities in this task. As I mentioned before, it quickly became apparent that GPT could spout off vapid insights regarding the text of Pride and Prejudice even without the chapter text (I had a bug originally that prevented the text from being included in the chat log, but nevertheless GPT knew about the plot and characters), however with a less-familiar text it proved much less insightful than I expected.

In general, I'm not sure what to make of this little experiment. I'm more certain that I'd like to try it all again with several specific, technical improvements that will hopefully address some of the limitations I encountered.

Bookclub 2.0

While I haven't gotten around to implementing any of these yet, here's the list of features I came up with to improve the process:

Use Stage Direction: As I said, one of the chief limitations of this process was the fact that the scene itself never evolved. That meant that after each character had explored their backstory and current setting, there was no where to go and so they babbled on incessantly about nothing. Adding another agent whose primary job is to insert novel change would hopefully disturb the equilibrium and allow for new insights.

A dump truck drives by and outside a dog barks.

Improve each Character's Mental Model: Here I'd hope to track not only the character dialogue but improve on the priming process I mentioned before by asking (at every step) what each character thinks about the current situation and allow their own mental state to evolve beyond what is present in the spoken dialogue. Currently it's not possible for characters to have separate internal and external states which also likely flattens their complexity. As well I'd hope to include much more detail in each character's backstory and education including other materials they found interesting or recently encountered.

Consider Different LLMs: One critical limitation of this approach is that it only uses one LLM and therefore is biased toward one set of training data and methods. Perhaps if a given character were assigned a different LLM that could help matters. There's bound to be implicit baises in each model that could affect the conversational tone (and who knows! perhaps then it would be possible to have a jerk participate in the conversation).

In addition to these two improvements, I'd hope to investigate some technical changes as well. The sheer volume of tokens being submitted (including the entire chapter text and dialogue history) means that the project quickly racked up a tab. However in order to have richer character personas I'd likely need to investigate training custom assistants rather than feeding it all through the chat log API.

Anyways that's it. I don't really have a through-line for this post. I just tried a thing and thought it was worth sharing. If you have suggestions or feedback, please file an issue or shoot me an email. The project is up on GitHub if you want to play with it yourself.

A Counting Meta-Post

It's been a while since we've run this little snippet, so let's see what we get!

$ find archive/ -name "*.md"|xargs -I {} cat {} | wc -w
124582

That means that there's roughly 124,582 total words written on this blog, not bad! That means I've managed to increase the total word count on this blog by nearly 24% in two years.

I'm not going for word count here, but it's still an interesting metric mostly because I post so much less frequently than I used to. That realization lead me to a much more interesting question about the overall length of individual blog posts over time. I posted the preliminary results over on Mastodon where I also discussed my reasoning behind the obvious trend of post length increasing over time.

A chart of the length of blog posts over time with a trend line that clearly goes up and to the right.

In general, my posts get longer as time goes on, and you can see that even more clearly in this chart which groups posts by the year they were A boxplot of the posts on this blog grouped by year

The general trend for a given post's word count had been slightly upward for a long time, but the trend seems to take off in 2021 (with a huge dip in 2023 due to a lot of quick project posts). 2024 however is the clear outlier.

Post by @sonicrocketman@mastodon.social
View on Mastodon

Of course the early days of this blog were a huge outlier as well, but that's another topic. Excluding the early days, things are trending up.*

* In terms of word count. Offer not valid in all states.

Foundational Texts

Recently, I saw this post from Kottke about so called Foundational Texts, and it got me thinking.

Writer Karen Attiah recently wrote about the pleasure of perusing other people’s personal libraries and then asked her followers what their “personal foundational texts” were…those books that people read over and over again during the course of their lives…

How about you? What are your personal foundational texts?

The question is a super interesting one. What books one reads shape their worldview. All media does this but, at least to me, books seem to hold an outsized influence. A few movies or TV shows stand out to me as being my favorites, fewer still exert a shaping force on me. Books seem to possess a more potent staying power.

The thing is, I don't really re-read books (especially non-fiction). Sure, there's a couple I've revisited over the years, but it's a very small list. That said there are select set of books that, once I'd read them, I've never gotten them out of my head.

So let's get into it (in no particular order):

  • The Wizard of Earthsea by Ursula K. LeGuin
  • The People vs. Democracy by Yascha Mounk
  • The Scientific Revolution by Steven Shapin
  • Pale Blue Dot by Carl Sagan
  • The Silmarillion by J.R.R. Tolkien
  • Zen and the Art of Motorcycle Maintenance by Robert M. Pirsig
  • Gödel's Proof by Ernest Nagel

Most of these I read in high school and college (or right after college), which is probably why they are so foundational. What's interesting is that, looking at them now, I clearly see a set of themes that stand out to me as foundational to my thinking about the world: optimism vs. caution, systems vs. the individual, agency vs. limits. Perhaps I'll expound more on these in a future post.

Usually, when I to get interested in a topic, I dive in whole hog, and so my reading list tends to be very single-minded for a while until eventually it takes a sharp detour one day toward something usually unrelated. From 2017-2022 that topic was U.S. Politics and Government. When I'm not in that sort of research-mode, I tend to revert to either some classic American novel or Fantasy.

But this means that what "foundational" means to me is that it is heavily influential and formative as to how I think about a topic. When I think of each of the books in the list above, I can immediately recall the change it had on my thinking.

As I've mentioned before podcasts have had a huge impact on me, especially in my late high-school and early college years. Both the Writing Excuses podcast and the lectures from Astronomy 162 at Ohio State stand out in my memory as shaping my interests.

Now, to continue Jason's call to action, what about you? What are your foundational texts?

Science, Models, And Squeaking Lead

At the dawn of the 14th century the Franciscan alchemist Paul of Taranto crouched over the strange lump of metal he'd created. He gaped, in awe of what he had done. It should have been impossible. The scholars told him he was a fool to even try, yet he'd done it. It wasn't gold that he'd created. He was still far from achieving that goal, but he'd made an important step. According to the book he would later publish under the title Summa perfectionis magisterii, Paul—writing under a deliberately confusing pseudonym—had just transmuted Lead into Tin!1

For those of us in the 21st century, it's second nature to dismiss this sort of claim as obviously ridiculous. There is no known, chemical way to do what Paul intends. But that begs a very obvious question: what had he done? If we take the man at his word, he certainly seems to have done something to his bar of lead, but what? And why did he believe his experiment had succeeded?

These questions will lead us down a very fascinating path, and one that reveals the striking truth about our knowledge of the natural world.

Theory & Practice

We take so much for granted these days about the knowledge of the natural world. We consider obvious and teach to children what took generations of the brightest minds to figure out, and it can be very easy to forget that.

Today we break apart systems to understand them; this is Reductionism. And we use material analysis to understand and manipulate the properties of physical objects: that is we melt, dissolve, chemically alter, and then recombine materials in order to create what we want. But in order to do all that—and better to make predictions about what exactly our methods will accomplish in doing so—we must accept the following assumption: that an object is nothing more than a physical assortment of indivisible components.2 This assumption may seem obvious to most people today, but it wasn't always that way! Indeed most serious philosophers in the past considered the idea ludicrous.3

I won't go into the history of Classical & Medieval Matter Theory, but suffice it to say that before a pre-modern version of what we today would call Atomic Theory would emerge, the dominant view of "What is Stuff?" was far more qualitative than quantitative. For the programmers out there, think of their Matter Theory as a sort of Duck Typing.4

If it walks like a duck and it quacks like a duck, then it's a duck.

Matter was it's qualities. Gold is yellow, ductile, resists being tarnished. Lead tarnishes easily, it's heavy. Tin is silvery and when you bend it, it squeaks. Therefore the process of turning one metal into another is a matter of giving it the desired qualities!

Photos: mine

As at every point in history, there were differing view points about what exactly matter is made of and scholarly opinions differed greatly. However, one theory—preferred by alchemists like our old friend Paul—held that the four prime elements were bound together into a duopoly of two higher-level substances to make the metals. What were those substances? Why sulfur and mercury!

Yup, literal sulfur (or brimstone) and mercury (or quicksilver).

Now before we make fun of Paul too much (or rather Geber as he called himself in his writing), let's try to understand why he thought sulfur and mercury were the foundational elements underpinning all metals. Under this theory, the difference between say lead and gold was simply in the relative proportions of these primary ingredients!

Paul, like so many alchemists, was seemingly quite the avid experimentalist, and so based his theories on what he could determine by the fire. Among many other experiments, he noticed the sulfurous smell given off by impure metals during refining and assumed that such a smell was due to a volatile sulfur within the metal itself. Additionally, according to Dr. William Newman:

The fact that calcined [i.e. burned] metals often appear in the form of yellow, red, or white powder (what we coul call oxides) suggests to Geber that they also contain...sulfur that remains after the volatile sulfur has been forced out by calcination.
- Atoms & Alchemy by William R. Newman, p. 33

As for the mercury, that brings us back to our earlier tale. Again Newman writes:

Geber proves [his] point by washing lead with quicksilver and then melting it. whereupon the lead gains the creak that the tin had lost—as he puts it, the lead is converted to tin.
- Atoms & Alchemy by William R. Newman, p. 33

According to his theory this worked because tin had more intrinsic mercury than lead. Therefore, to transform it, one simply needed to add mercury into the lead. Sure enough, once lead is washed in this way, it squeaks when it bends. Paul had successfully imparted the quality of squeakability into his lead, thereby transforming it (albeit partly) into tin.

It might sound silly, but consider this: here was a person who formed a hypothesis about the cause of a natural phenomenon, then tested it. It worked, so he built on it. That sounds a lot like science, doesn't it?

What Even is Science?

At it's core, modern science is two things: a process of inquiry and a collection of knowledge. Together those two form a model of the natural world that we use to make predictions and offer explanations into the workings of nature. Science does not, and cannot, tell us how nature actually works under the hood, instead it gives us the tools to develop and test our models.

This point is worth belaboring, because for me, it took a long time to really click.

I studied aerospace engineering, which is basically Newton's mechanics, material design, and a lot of stuff about how fluids flow (air is a fluid, you see). When you study physics in this way, it can be tempting to believe you've learned something about nature, but what you've learned is how to model nature. There are always error terms sticking out, gaps in the theory, losses you approximate (spherical, frictionless cows for example). The math isn't nature, it's an approximation. Crucially, it's an approximation that seems to work, or at least it does within your measure of tolerance.

It's hard to remember that we don't really know how nature works. We know how to approximate it. But that fact becomes easier to understand when you approach the study of nature, not from our current perspective, but from the outside.

What's so fascinating to me about the example of poor old Geber/Jabir/Paul above is that his theories about matter were utterly wrong, and yet they did offer testable predictions that were sometimes correct! Like many scientists before and since, Paul may have very well chalked up his experimental failures to defects in apparatus, hidden variables like mineral origins, or even the incompleteness of his own theories, but nevertheless he worked with and improved his theories so to arrive at testable methods and predictions, and he wasn't the only one!

It fascinates me so much because I find myself wondering: what do we believe about nature that future generations will look back on with the same bemusement that we feel about Paul of Taranto or any other proto-scientist who's theories fell short? What about nature will become so obvious that it's taught to ten-year-olds in four centuries, but that now our brightest cannot see?

1 The opening scene of this post is a fictional account, so no one take this too seriously.
2 Or chemically indivisible at least.
3 All of this pertains only to the European West and the Middle East during the Classical and Medieval periods. Basically those cultures touched by the legacy of Aristotle.
4 For the Programmers out there, think about this:
class Tin extends Lead implements Squeakable, Silvery {}