Thank you very much, Priya.
Return of the Shadow is in a sense my late adult
Lord of the Rings. Nearly a decade ago I reached a point where I could no longer read
Lord of the Rings with the same pleasure because I had by now read it too many times. (That is not to say that even today when I do read it but that I always discover something new, which I had never noticed before.)
Return of the Shadow began as a way of reading once again with fresh eyes the journey from a hobbit-hole to Rivendell. But I soon enough discovered the hidden depths of these early drafts, which make difficult but peculiarly rewarding demands. These drafts reveal a master of the art setting down on paper
The Lord of the Rings, and simply watching this happen is a treat in itself. But conceptualizing, that is, articulating what is happening, how and why, I have found a rare challenge. In a nutshell, it seems to me that we have to think our way into the story that Tolkien thought he was telling when he wrote this or that draft, which of all the material in
Return of the Shadow it can be said that it was not the story of the War of the Ring that
The Lord of the Rings became.
So for example, everything surveyed above, the story from the long-expected party all the way to arrival at Rivendell in the early autumn of 1938, belongs to the story of Bingo Bolger-Baggins, Hobbit prankster who makes use of the magic ring to play practical jokes, and indeed begins his story by vanishing from his own birthday party (Bingo is the host of the long-expected party). Bombadil who is not caught by the magic ring was originally showing up Bingo's limitations. But on Weathertop Bingo is overcome by temptation - the call to put on the magic ring proves too strong, and at Rivendell Tolkien makes a note that each encounter with the Black Riders should prompt a desire to put on the ring, which demands that from the start Bingo does not make use of the magic ring, even for jokes. In any case, Weathertop reveals the untenability of a Hobbit prankster in the face of the king of the Ringwraiths; Tolkien is about to start over at Bag-end, twice before October 1938, on the first start Bingo is joined by Samwise Gamgee (pulled out of the garden by his ear just as in the published story today) and on the second Bingo vanishes and Sam is the servant of Frodo Baggins.
By this story-criteria, the very first imagination of Bingo Bolger-Baggins as the heir of Bilbo Baggins itself vanishes with the first return to Bag-end, around September 1938. The second imagination is the story that Tolkien imagines himself to be writing from September 1938 to the close of 1939, which I call the
Ghost Sequel to
The Hobbit.
In this second story-imagination we have nearly all the key elements of
The Lord of the Rings, if very little of the geography of the South and only rudimentary ancient history as background. After Rivendell the Hobbits will follow the great river down into the South, where awaits Ondor and the City of Stone and of Boromir, who has come to Rivendell, and also Mordor, the Fiery Mountain, and the Dark Tower that already in 1939 is associated with an Eye.
This phase of writing comes to a close at the close of 1939 at the tomb of Balin in Moria. Seven stand by the tomb: Boromir, Gandalf, and five Hobbits. Tolkien writes to Stanley Unwin, his publisher, that his new Hobbit story is 3/4 written. This 3/4 written story is where we end up at the end of
Return of the Shadow and is what I call the Ghost Sequel. Tom Bombadil is a far more central presence in such a story.
The Ghost Sequel vanishes and Tolkien imagines himself writing a Hobbit perspective on the Great War of the Ring that ended the Third Age of Middle-earth in summer 1940. This happens in Moria when Trotter, who the Hobbits met in Bree, turns out not to be Peregrin Boffin (who ran away into the blue after listening to too many of Bilbo's tales) but Aragorn the heir of Elendil. With this discovery that a Hobbit is actually the king who is returning the imagination of the kind of story that Tolkien is telling is transformed and the door is open to the story of the Doom of the World that he now tells over five more 'books' of a narrative completed in 1948 plus appendices brought to completion in the early 1950s.
Bombadil's adventures with the Hobbits are touched up over the years. For example, the vision of Aragorn in the memories of the Barrow in Tom's words of the men who go wandering. But what is truly striking is the endurance of this material, which essentially remains as first set down in the passage of Bingo the prankster Hobbit. Somewhere along the way Bombadil became impossible. I mean, my intuition is that he became an enigma because of these reimaginations of the story and so the story-world enacted around him.
I'm dubious, though, that this goes far enough in illuminating what is referenced in this letter, which you drew my attention to.
That is why I left Tom Bombadil in and did not 'tinker' with him though much tempted to do so in the 'Council of Elrond', to bring him into the historical pattern.
He could have been 'called to order' by cutting out or altering the passage on I 144; but I could not do that. I know he behaved like that, and to deny it, for the sake of consistency, would be wrong, and the 'consistency' less real than the mystery.
Letter to Mroczkowski,1964
[The passage I 144: Tom puts on ring and does not vanish; Frodo puts on ring and Tom sees Frodo.]