https://heqiuyao.squarespace.com/work-4/new-portfolio-item
https://drive.google.com/file/d/1UiCNbU3efA-NgJcwqKekjN3_AR-Cqf9_/view?usp=sharing
Title: Neural Harmony / Nested
Project Description
Drawing inspiration from Neural Syntax by the neuroscientist György Buzsáki, our installation offers an engaging way to explore the concept of nested hierarchical relationships in neural activity. We use the metaphor from the book, which compares neural patterns to the structure of language, to simplify this complex idea. Through the interactive arrangement of words and manipulation of brainwave patterns, participants can visually discern the underlying message and grasp the core concept at play. Developed in collaboration with the Buzsáki Lab at the NYU Neuroscience Institute.
What is your project about?（60words）
An interactive installation designed to introduce the general public to the concept of neural syntax in neural science. Through the interactive arrangement of words and manipulation of brainwave patterns, participants can visually discern the underlying message and grasp the core concept of neural syntax at play.
What does your project do technically?
We combined the technologies of Pepper's Ghost and projection mapping to integrate the display of brain waves and textual content. Additionally, we incorporated physical computing, using Phidget to create a solid interactive knob. For the digital content, we utilized Node.js and Unreal Engine 5, connecting them with Phidget via OSC.
How will people engage with your project?
In "Neural Narratives," viewers encounter a dual display: one part is the animation of brainwave patterns, hinting at their intricate interplay, while the other part dynamic text symbolizing the basic relationship of different brainwaves. Interactive knobs enable users to alter both different brainwaves and text arrangements.
Space Requests