Golan Levin & Nica Ross, Carnegie Mellon University
Curricular Materials for CMU Course 60-461/761, 54-461/661
This is an interdisciplinary studio course in expanded media practices that arise from using devices and algorithms to "capture" the world. We will explore experimental workflows, ranging from no-tech and low-tech to emerging and state-of-the-art techniques, in order to capture, model, and share new representations of people, objects, places and events. Through self-directed research projects, students will develop systems to capture a wide variety of phenomena, and creatively share the media they collect. We will cover a wide range of techniques and artistic practices that incorporate immersive, panoramic, high-speed, multiscopic, and multispectral imaging; depth sensors and 3D scanners; motion capture systems for gestures of the face, body, hand, and eye; computer vision and machine learning techniques for detection, tracking, recognition and classification; and other unusual, forgotten, and nascent technologies for transducing the unseen, ephemeral, and otherwise undetectable.
This course is concerned with the creation of systems to enable new ways of seeing.
This is an interdisciplinary course in experimental media practices that arise from using devices to "capture" the world. In particular, we are concerned with how we can understand and build representations of the world using devices that sense beyond the limits of human perception. In this course, we seek:
- To explore the affordances of exotic, forgotten, and nascent image capture technologies in revealing unseen or alternative realities.
- To explore the use of computation and other technological media in expanding our expressive vocabulary for representations of people, objects, environments, and events.
- To question the practical and epistemological assumptions that underpin the project of capturing representations of reality with devices.
At the conclusion of this course, students will be able to:
- Recognize and identify the use of expanded capture techniques (such as photogrammetry, motion capture, multispectral imaging, binaural audio, stroboscopy, etc.) in popular and experimental media.
- Demonstrate understanding of the scientific principles and/or engineering foundations underlying such techniques, in revealing phenomena beyond the limits of ordinary human perception.
- Demonstrate understanding of the poetic and elucidative potentials of such techniques, and their application to the production of expressive and provocative new culture.
- Command the practical use of one or more such techniques.
This is a partial and mostly unordered list of some of the technologies and techniques we will discuss this semester.
Introductions
Capturing Nouns (People, Places, and Things):
- Typologies
- Portraits I: Series
- Portraits II: Candid Machinery
- Portraits III: The Indirect Portrait
- Multispectral Imaging
- Scientific Photography
- Capturing and Representing Objects: Still Life & More
- Photogrammetry
- Pixel rearrangement
Capturing Phenomena in Time:
- Overcranking (Slow-Motion)
- Undercranking and Time Lapse
- Long Exposure and Light Painting
- Bullet Time (Array Videography)
- Pixillation and Stop-Frame
- Backwards (Retrograde) Time
- Looping (Canon) Time
- Point of View: Moving Cameras
- Point of View: Inversion
- Slit-Scanning
- Experimental Audio Capture
- Gesture Capture in 2D and 3D
- Volumetric Video
More:
- Synthesis from Image Databases
- Gonioreflectometry
- Panoramic, 360-degree, and environmental capture
- Stereography & Binocular Imaging
- Perspective Capture and Representation
- Landscape: Capturing Places
- Fall 2022: Golan Levin & Nica Ross (co-taught)
- Spring 2020: Golan Levin & Nica Ross (co-taught)
- July 2018 one-week workshop: Golan Levin
- Spring 2017: Golan Levin & Claire Hentschker (TA)
- July 2016 one-week workshop: Golan Levin
- Fall 2015: Golan Levin
This syllabus contains contributions by Golan Levin and Nica Ross; James George and Alexander Porter (of Scatter/Specular), Pablo Garcia, Jeffrey Hinkelman, Kyle McDonald, Matt Gray, Yaser Sheikh, Suzie Silver, Claire Hentschker, and others.
- How to take screengrab documentation
- Some software tools used in this course
- Some equipment used in this course
Remaining: a large landfill of as-yet unsorted links and resources.