Technological Features in My Creative Work
Neuroemography:
Neuroemography harnesses emotional responses to create art. By capturing and translating emotional data into visual or auditory forms, this technology allows for the creation of art that is deeply personal and emotionally resonant.
Tangible user interfaces:
With tangible user interfaces (TUIs) like Reactable, I use physical objects and tactile interactions to bridge the gap between digital and physical experiences. This approach brings a tangible, sensory dimension to the creative process, enhancing engagement with the material world.
Embodied Cognition:
Embodied cognition explores how our thoughts and mental processes are influenced by our physical experiences and interactions with the environment. This approach integrates the body's role into cognitive processes, influencing how I create and experience art.
Neurocinema:
Neurocinema investigates how films impact the brain and emotions. By using technologies that capture and analyze viewers' reactions, I create immersive cinematic experiences that adapt in real-time to emotional feedback, offering a personalized and emotionally engaging film experience.
Neuroemography: Art Born from Emotions
"Neuroemography" is a term coined by media artist Yuri Didevich, describing a new art form that uses neurotechnology to visualize human emotional states. "Neuro" refers to the nervous system, "emo" to emotions, and "graph" to the art of drawing and writing. This term implies the creation of images that interpret the brain's neural activity associated with emotions, including drawings generated by AI. Neuroemography can be used in interactive art to record and create visual representations of the viewer's emotional states, as well as in psychology and neuroscience to study emotional processes. Neuroemography helps people better understand and manage their emotions.
Embodied Cognition: A New Trend in Neurobiology and Cognitive Science
"Embodied cognition" is a modern trend in neurobiology, cognitive pedagogy, and psychology. It emphasizes the role of bodily organization and interaction with the environment in cognitive processes, shaping the landscape of contemporary cognitive science, moving away from the computer metaphor.
Robotics researchers like Rodney Brooks and Hans Moravec assert that true AI can only exist in machines with sensory and motor skills, connected to the world through a body. Neurobiologists such as Gerald Edelman and Antonio Damasio explore the connections between the body, brain structures, and aspects of the mind like consciousness and emotions.
In interactive art, embodied cognition opens new horizons. Artificial systems with bodily interfaces can not only respond to the viewer but also interact on a deeper level, reflecting their emotions and states. This creates unique, personalized artistic experiences that deepen our understanding of the connection between the body, brain, and art.
Tangible Mind: Material Media Bringing Us Home
With tangible user interfaces (TUIs) like Reactable, we are moving closer to the idea of a natural environment for an extended mind. These interfaces blend sensory interaction with real objects, drawing us back into a world crafted from tangible items. The concept of transforming real avatars into the virtual world offers a way to harness the digital realm and turn it into a mind-friendly environment. This returns us to the original notion of an extended mind supported by physical objects. Although this idea might seem fantastical, imagine a mind extended into a world interconnected with our bodies and the objects around us. From HCI to an extended self, artificial systems with embodied interfaces can deeply interact with users, reflecting their emotions and states, and creating a unique, personalized artistic experience. This deepens our understanding of the connection between the body, mind, and art.
© Photo by Anastasia Blur and Vera Bezrukova
Neurocinema: Exploring the Brain's Response to Film
Neurocinema delves into the intricate relationship between our brains and the cinematic experience. It examines how the mind perceives and reacts to films, shaping our emotional responses and overall engagement. By capturing these emotional responses to individual scenes, neurocinema establishes a feedback loop that guides the viewing experience, creating a self-regulating cybernetic cycle.
Drawing inspiration from computer game design, neurocinema employs advanced techniques, algorithms, and technologies to craft production scripts and manage the neurocinematic system. This innovative approach paves the way for:
Understanding the impact of film on our brains: Neurocinema sheds light on how different film elements, such as visuals, sounds, and narratives, trigger specific neural responses, influencing our emotions, thoughts, and behaviors.
Creating immersive and emotionally resonant films: By understanding the brain's mechanisms, filmmakers can craft more compelling narratives, design captivating scenes, and evoke desired emotional responses in the audience.
Designing personalized viewing experiences: Neurocinema holds the potential to tailor film experiences to individual preferences and emotional states, enhancing engagement and overall enjoyment.
Neurocinema: At the Intersection of Art, Science, and Technology
This emerging field stands at the crossroads of art, science, and technology, offering a unique lens through which we can explore the profound impact of cinema on our minds. As neurocinema research continues to advance, we can expect to see even more innovative applications in filmmaking, entertainment, and beyond.