View on GitHub

Humanities in the Age of AI

Fall 2024 - Anastasia Salter

Tutorial: Reading Across Texts

This week, we’re going to go further in our interactions with prompt-based systems by providing them with new data. For this exercise, you’re going to choose at least one text to analyze through distant reading, starting with my prompts and working towards developing and iterating your own questions. Depending on the level of access you have to the model you’ve chosen, you might find that you have trouble getting results with a complete text, particularly one of the longer books: keep iterating until you are happy with your results.

AI-Assisted Distant Read

Start by selecting a work from Project Gutenberg (anything other than Frankenstein, as I’m using that here as a sample), and make sure you download the “Plain Text UTF-8” version as a .txt file. For instance, the plain text version of Frankenstein is the file here: TXT. You’ll notice that this plain text version has some noise at the top of the file, and at the end – this is information and metadata added by Project Gutenberg. We could delete that ourselves, but we’re going to try out the model’s preprocessing and have it work with us throughout the entire process. So, download that plain text file for now and have it ready to attach when you’re in conversation with the system.

Here’s a guiding set of basic prompts to try - these are general, and it might require several iterations to get the output of each:

These basic steps will result in errors, but they can also provide some useful rapid visualizations and data. Here’s a few examples from my output - you’ll notice that the charts in some cases mention they are corrected because I had to ask for several iterations:

phrases Figure 1. Frequent bigrams and trigrams

word cloud Figure 2. Word cloud, after iterating stop words

character network Figure 3. Character network, weighting for significance

Use Ted Underwood’s article on distant reading from this week’s readings to guide your process and question development. You might find it easiest to analyze a text that’s in an area that you’re familiar with, or that is in an area of interest to you, so that you will have a better capacity to check and verify the output. Critique the quality of results you’re getting, particularly in terms of their potential usefulness for this type of research.

If you’d like to venture further, you can also do some comparative analysis of texts. But for this week, the real goal is to get a better understanding of distant reading with the assistance of generative AI. You’ll notice that your responses might take you down a rabbit hole, with the model suggesting deploying code to get better results. If you have experience in programming and you’re interested in working that way with ChatGPT now, you certainly can start to pursue that path. But right now, it is not necessary

Discussion

After completing our readings, iterate on a distant read of your selected text from Project Gutenberg, using the model I provided in the tutorial to get started and experimenting with other approaches to textual analysis using your original prompts. As with last week, feel free to use ChatGPT, Copilot, Gemini, Claude, or another similar tool. Share the results of your textual analysis in the discussion post, with citations to this week’s readings to ground your decisions and critique.