Art and the science of generative AI

Picture of Ziv Epstein
Ziv Epstein
Picture of Aaron Hertzmann
Aaron Hertzmann
Picture of Memo Akten
Memo Akten
Picture of Hany Farid
Hany Farid
Picture of Jessica Fjeld
Jessica Fjeld
Picture of Matthew Groh
Matthew Groh
Picture of Laura Herman
Laura Herman
Picture of Neil Leach
Neil Leach
Picture of Robert Mahari
Robert Mahari
Picture of Alex “Sandy” Pentland
Alex “Sandy” Pentland
Picture of Olga Russakovsky
Olga Russakovsky
Picture of Hope Schroeder
Hope Schroeder
Picture of Amy Smith
Amy Smith
Published at Science 2023
Teaser image

Abstract

The capabilities of a new class of tools, colloquially known as generative artificial intelligence (AI), is a topic of much debate. One prominent application thus far is the production of high-quality artistic media for visual arts, concept art, music, and literature, as well as video and animation. For example, diffusion models can synthesize high-quality images, and large language models (LLMs) can produce sensible-sounding and impressive prose and verse in a wide range of contexts. The generative capabilities of these tools are likely to fundamentally alter the creative processes by which creators formulate ideas and put them into production. As creativity is reimagined, so too may be many sectors of society. Understanding the impact of generative AI—and making policy decisions around it—requires new interdisciplinary scientific inquiry into culture, economics, law, algorithms, and the interaction of technology and creativity.

Materials