THE NEURAL YORKER: A CARTOON GENERATOR.
Ilan Manouach (Applied Memetic LLC)
While speculations about the growing role of machines in artistic production have been a consistent trope in modern and contemporary art debates throughout the 20th century, comics from their early beginnings, have been symbiotically expanding with the development of printing, distribution, communication and media technologies. These industrial processes of completion based on generalized automation, standardization practices and an orchestrated division of labour are so embedded in the ways we understand and consume comics, that have become an essential feature for the conceptualization of artistic practices in the medium. Today, deep neural networks play a transformative role in advancing artificial intelligence across various application domains and some of the most creative bits of contemporary art are happening today at the junctions between different disciplines and technologies. As a consequence, within the “computational creativity” literature, various papers and academic researches have proposed different algorithms and model architectures in the exploration of the creative potential of a machine.
Applied Memetic responds to the need to accelerate the technical affordances in the comics and cartoon industry. A transdiciplinary team consisting of a comics artist and several computer scientists has the aspiration to produce the first comic narrative entirely generated by Artificial Intelligence. The project represents a considerable technical and artistic challenge as it explores a set of unconventional operations that don’t account for the production of comic books: web-scraping, image classification, computer vision algorithms, language modeling, indexation, database building and cloud computation. Furthermore, the resources from Machine Learning are steered toward the synthetic production of everything related to original comics art: the artwork, the character designs, the dialogues, the narrative evolution, and the page layout will be entirely generated using the most up-to-date algorithmic architectures and models in Deep Neural Networks such as GAN, GPT-2 and transformers. More than a technical challenge, this is an opportunity to explore unconventional processes by weakening the aesthetics predispositions and received wisdom that are reproduced through specific (human) evolutionary interpretations of artistic production. Interested in harnessing the machinic understanding of comics through recurrent patterns, probability distributions and outliers in comics language that have been lurking in the reader’s pre-attentive reader’s cognition and that we haven’t been able to articulate in words, Applied Memetic embraces the machinic volition in the production of an art object in order to unfold a non-human understanding of the comics medium. During our visually-rich presentation, we would walk the reader through a conceptual, historical and technical understanding of the project in our effort to produce a knowledge-rich, experimental transdisciplinary project that pushes the boundaries of the cartoon format and aspires to produce the first cartoon generated entirely modeled using deep learning. Trained on the historical database of the famous magazine, this is a twitter bot built on a multimodal generative architecture that produces daily cartoons. Still in its «infancy» mode, the algorithm feeds on Twitter’s trending hashtags and topics and is gradually set to fit to the contemporary industry standards for press cartoons, by a semi-supervised learning mode.
AI Engineer: Ioannis Siglidis
Ilan Manouach is a conceptual comics artist. He currently pursues a PhD at Aalto University in Helsinki (adv. Craig Dworkin) where he examines how the comics industry is undergoing historic mutations in the midst of increasingly financialized, globalized technological affordances of the XXIst century. He is mostly known for being the creator of Shapereader, an embodied system of communication designed for blind and partially sighted readers/makers of comics. He is the founder of Applied Memetic, an organization that researches the political repercussions of generative and automated content in the comics industry and highlights the urgency for a new media-rich internet literacy and the director of Futures of Comics, an international research programme that proposes to map the social, economic, racial and gendered forces that shape the industry’s commercial, communication and production routines. The Brussels-based non-profit Echo Chamber is responsible for producing, fundraising, documenting and archiving Manouach’s research on contemporary comics, that has been presented worldwide. He is an Onassis Digital Fellow (2020) and a Kone alumnus (2015, 2017, 2019) and works as an external strategist for the Onassis Foundation visibility through its newly funded publishing activity.