Soundbarrier Blog

Personal blog about hardware, software, data and other interesting things.

AI Conceptual Art

by
Sebastian Schaetz
written

The most significant art exhibit I ever attended to date was the 2013 remake of a 1969 art show in Bern, Switzerland called "Live In Your Head: When Attitudes Become Form" where Harald Szeemann "wanted to show everything that we had not yet seen, everything that came after 'Pop Art' and 'Minimal Art'" (Grégoire Muller, exhibition catalog).

There are many memorable pieces of art from that show but one I particularly enjoyed was Lawrence Weiner's "A 36" by 36" removal to the lathing or support wall of plaster or wallboard from a wall, 1968" where the title is the art-work: a description or an instruction of what to do to create the piece of art.

Lawrence Weiner, A 36" x 36" removal to the lathing or support wall of plaster or wallboard from a wall, 1968, Works & Reconstructions, Kunsthalle, Berne, Switzerland, 1983. © 2021 Lawrence Weiner / DACS, London.
Lawrence Weiner, A 36" x 36" removal to the lathing or support wall of plaster or wallboard from a wall, 1968

The fact that the idea or the concept for a piece of art takes precedence over technique and material is in my opinion a radical change in the understanding of art. Today I can still appreciate painters and sculptors of skill. But the pure execution and craftsmanship, fades a bit in the background. Concept, idea, message, aesthetics are much more interesting.

Sol LeWitt's definition of conceptual art [1] summarizes this in a fitting way:

In conceptual art the idea or concept is the most important aspect of the work. When an artist uses a conceptual form of art, it means that all of the planning and decisions are made beforehand and the execution is a perfunctory affair. The idea becomes a machine that makes the art.

If the idea becomes the machine that makes the art, the entity that does the work turns into a machine operator. Or maybe even better: when translating this into the world of computer science, the conceptual art is the program that gets executed by some machine or engine and the whole thing is running on some compute substrate. The output is an instantiation of the result of the program, but there are many different instantiations.

If the artist's only connection to the instantiation of a piece of art is their idea, and if the individual artistic expression fades into the background, one fun and simple idea comes to mind: could the engine that "executes the artist's idea" be an actual machine like artificial intelligence? Let's see what happens if we feed the prompts and descriptions by conceptual artists into DALL·E 2.

Top left: instructions faxed by Sol LeWitt to Franklin Furnace for wall drawing #811 and three interpretatoins by DALL·E 2 (top right and bottom).
Top left: instructions faxed by Sol LeWitt to Franklin Furnace for wall drawing #811 and three executions by DALL·E 2 (top right and bottom).

I'm not a fan of this -- it has Avant-Garde vibes to it but circles, really? Did not expect circles. Let's try again:

On a wall surface, any continuous stretch of wall, using a hard pencil, place fifty points at random. The points should be evenly distributed over the area of the wall. All of the points should be connected by straight lines.

These are instructions by Sol LeWitt for wall drawing #118.

Top left: instructions by Sol LeWitt for wall drawing #118 and three interpretatoins by DALL·E 2 (top right and bottom).
Four executions of Sol LeWitt's wall drawing #118 by DALL·E 2.

This seems to mix Klim's gold color into a composition that did not follow the instructions at all, or maybe not precisely enough. The images are interesting but far from what the instructions describe. Rather than following the instructions, the AI seems to create a depiction of what it would look like to execute the instructions. When a human follows the instructions, the results look very very different.

Let's let DALL·E 2 try another one -- this one can look very delicate and I find it very beautiful.

Straight lines approximately one inch long, drawn at random, within a square using four directions of time, each a different color: 1) Yellow / vertical 2) Black / horizontal 3) Red / diagonal, left to right 4) Blue / diagonal, right to left and all combinations of these lines and colors on a 4 by 4 pattern of squares.
Four executions of Sol LeWitt's drawing "Straight lines, approximately one inch long, drawn at random, within a square using four directions of line, each a different colour" by DALL·E 2.
Four executions of Sol LeWitt's drawing "Straight lines, approximately one inch long, drawn at random, within a square using four directions of line, each a different color" by DALL·E 2.

I find these aesthetically pleasing. Note that the two red-tones are variants of each other. Let's look at one more set of images -- variants of Lawrence Weiner's square, one of my favorite pieces of art. We tell DALL·E 2 to create

A 36" x 36" removal to the lathing or support wall of plaster or wallboard from a wall.
Four executions of "A 36" x 36" removal to the lathing or support wall of plaster or wallboard from a wall" by DALL·E 2.
Four executions of "A 36" x 36" removal to the lathing or support wall of plaster or wallboard from a wall" by DALL·E 2.

Now these variants of one specific output are pretty cool. We see a tool of some sort that repairs, destroys or changes a wall by chiseling, carving or scraping. It could be either a painting or a photograph.

In closing it should be noted that using Sol LeWitt's text prompts as input to an algorithm or as an algorithm description is not a new idea. Richard Lapham for example created a Sol LeWitt Generator in 2017 and the solving-sol project, an "open project to implement Sol LeWitt's instructions in JavaScript".

It's a bit like the tradeoff between conventional and machine learning solutions for particular problems. The machine learning solution going in has many more degrees of freedom, and properly trained can be quite powerful. The conventional approach will do the same thing over and over and is often limited in what it can do. The fast number of degrees of freedom of DALL·E 2 could almost be confused with creativity.


  1. Sol LeWitt "Paragraphs on Conceptual Art" Artforum, June 1967. ↩︎