ChatGPT Can鈥檛 Dream. But It Likes Artwork That Depicts Dreams.
Students use artificial intelligence to help curate new Nasher Museum exhibition
![Nicholas Monro, Cosmic Consciousness, 1970. Screenprint on paper, edition 29/75, 27 1/2 x 40 1/8 inches (69.9 x 101.9 cm). Collection of the Nasher Museum of Art at 老牛影视. Gift of Mr. Lavere G. Lund, 1980.101.2. 漏 Estate of Nicholas Monro.](/sites/default/files/styles/5_3_max_width_575px/public/2023-09/New%20DT%20Magazine%20Hero%20%2853%29%20-%202023-09-12T120233.163.jpg?itok=5tLpWRq_)
Enter Mark Olson, associate professor of the practice of visual and media studies, and his students. 鈥淧artnering with faculty and students is embedded deeply in what we do,鈥 McHugh said. The museum has had a long-standing relationship with Olson, whose work is situated in art and technology, so teaming up for a ChatGPT exhibition was a natural fit.
![Curatorial Assistant Julianne Miao (left) and Julia McHugh, Trent A. Carmichael Director of Academic Initiatives, look over Chat GPT鈥檚 instructions for placing the works of art in the gallery.](/sites/default/files/styles/story_body_inline_horizontal_2x/public/inline-images/Nasher-AI-Exhibit---NYT---CW-3.jpg?itok=yijRT3hR)
Curatorial Assistant Julianne Miao (left) and Julia McHugh, Trent A. Carmichael Director of Academic Initiatives, look over Chat GPT鈥檚 instructions for placing the works of art in the gallery. Photo by Cornell Watson.
Olson and his students engineered a solution: They created a custom version of ChatGPT that could access the Nasher鈥檚 database of 14,000 artifacts in its collection.
Olson describes their process as a series of 鈥減roductive failures.鈥
鈥淭here is a lot of (advice) circulating online that just doesn鈥檛 work,鈥 he said.
Undergraduate Alveena Nadeem was surprised how 鈥渃unning鈥 ChatGPT could be. 鈥淲hen finding ways for the AI to recognize Nasher artifacts, I saw that it could lie and claim to be 鈥榓ware鈥 of these artifacts while not even being able to access it and then make up information about it,鈥 she said.
In the end, 鈥淲e hit upon a way to do this. We transformed Nasher鈥檚 data into a set of numerical representations that could be fed into ChatGPT,鈥 Olson said.
Once the curators at the Nasher had a ChatGPT they could work with, they began writing prompts for an exhibition. 鈥淲e asked it what themes or topics would be exciting at a university art museum,鈥 said McHugh. ChatGPT gave them several different themes but the answers that consistently came back were utopia, dystopia, dreams and the subconscious. The curators settled on that as an organizing concept for the exhibition.
鈥淚t鈥檚 particularly ironic for AI, since it can鈥檛 dream,鈥 McHugh said.
The results were mixed. At times it selected items right on the nose, such as Salvador Dali鈥檚 鈥淢ystery of Sleep.鈥 In other instances, McHugh said, they weren鈥檛 sure why it chose pieces. For example, it chose an ink on paper drawing for a large sculpture by Peter Reginato 鈥 鈥渘ot tied to the exhibition in any obvious way.鈥
Being polite to the AI helped. The team praised ChatGPT with: 鈥淭hat鈥檚 a really great selection, good work. Can you please select more?鈥
鈥淲e had heard references to studies in which AI responded more effectively if the user was polite, so we tried that technique at several points in the experiment,鈥 McHugh said. 鈥淧erhaps it was coincidence, but on the queries in which we were more encouraging of its answers, it was more productive in generating responses.鈥
Salvador Dal铆, The Mystery of Sleep (The Hermit) from the portfolio Visions Surrealiste, 1976.
Utagawa Kuniyoshi, Untitled, 19th century
On the other hand, there were accuracy issues: The AI wouldn鈥檛 always identify works correctly. And then, there were the labels.
The curators asked ChatGPT to generate 50-word labels for the exhibition items. Some labels called a print a sculpture. 鈥淚t can also give a general, flowery language that does not give you information,鈥 said McHugh.
For example, ChatGPT called 鈥淐osmic Consciousness鈥 by Nicholas Monro an 鈥渁we-inspiring sculpture that captures the essence of our cosmic connection 鈥 (and) serves as a reminder of the interconnectedness of all life.鈥
The museum kept ChatGPT鈥檚 labeling as is but is providing its own commentary in the exhibition to accompany it. In response to the Nicholas Monro label: 鈥淲hile ChatGPT鈥檚 selection of this work did not surprise us, its description of it as an awe-inspiring sculpture did. Monro was best known for large-scale sculptures, but clearly this work is neither a sculpture nor particularly awe-inspiring.鈥 The work is a screenprint.
In the end, though, what ChatGPT selected wasn鈥檛 as important as the process and the experience of its capabilities and limitations, says McHugh.
In other words, ChatGPT won鈥檛 be replacing human curators. But 鈥(it) could be a useful assistant in the process,鈥 McHugh said. It could help search the collection in different ways. 鈥淚t brought up a large number of artworks to our attention that haven鈥檛 been on display for a long time.鈥
Olson and his students will be releasing the code for other institutions to experiment with.
![Tunji Adeniyi-Jones, Astral Reflections, 2021.](/sites/default/files/inline-images/web-nasher-tunji-adeniyi-jones-astral-reflections.jpg)