About
"Talking with Neurons" is an interactive installation that enables people to remotely connect with live neural tissues that mimic our nervous system. Neurons are the essential units of our nervous system, including the brain, responsible for information processing and transmission. "Talking with Neurons" invites audiences to conduct a reciprocal conversation through sending voice inputs and receiving audiovisual representations of neuronal activity by in vitro neurons that respond to their vocal cues. By exploring a new method of human-neuron interaction, this installation enables us to imagine a future where we integrate living neurons into the technology we use every day.
"Talking with Neurons "は、私たちの神経系の一部をまねして作られた生きた神経組織と遠隔でつながることができるインタラクティブなインスタレーションです。神経細胞（ニューロン）は脳を含む神経系の主要な細胞で、情報を処理したり伝えたりする役割を持ちます。"Talking with Neurons "では、参加者を神経組織との会話へ誘います。参加者が音声を入力すると、それに対して神経組織が反応します。音と映像で表現された神経の活動を受け取ることで会話のようなやりとりが行われます。このインスタレーションは、人間と神経細胞の新しいインタラクションの方法を探ることで、私たちが毎日使っているテクノロジーに生きた神経細胞を組み込む未来を想像していただきます。
"Talking with Neurons" is an interactive installation that enables people to remotely connect with live neural tissues that mimic our nervous system. Neurons are the essential units of our nervous system, including the brain, responsible for information processing and transmission. "Talking with Neurons" invites audiences to conduct a reciprocal conversation through sending voice inputs and receiving audiovisual representations of neuronal activity by in vitro neurons that respond to their vocal cues. By exploring a new method of human-neuron interaction, this installation enables us to imagine a future where we integrate living neurons into the technology we use every day.
"Talking with Neurons "は、私たちの神経系の一部をまねして作られた生きた神経組織と遠隔でつながることができるインタラクティブなインスタレーションです。神経細胞（ニューロン）は脳を含む神経系の主要な細胞で、情報を処理したり伝えたりする役割を持ちます。"Talking with Neurons "では、参加者を神経組織との会話へ誘います。参加者が音声を入力すると、それに対して神経組織が反応します。音と映像で表現された神経の活動を受け取ることで会話のようなやりとりが行われます。このインスタレーションは、人間と神経細胞の新しいインタラクションの方法を探ることで、私たちが毎日使っているテクノロジーに生きた神経細胞を組み込む未来を想像していただきます。
"Talking with Neurons" is an interactive installation that enables people to remotely connect with live neural tissues that mimic our nervous system. Neurons are the essential units of our nervous system, including the brain, responsible for information processing and transmission. "Talking with Neurons" invites audiences to conduct a reciprocal conversation through sending voice inputs and receiving audiovisual representations of neuronal activity by in vitro neurons that respond to their vocal cues. By exploring a new method of human-neuron interaction, this installation enables us to imagine a future where we integrate living neurons into the technology we use every day.
"Talking with Neurons "は、私たちの神経系の一部をまねして作られた生きた神経組織と遠隔でつながることができるインタラクティブなインスタレーションです。神経細胞（ニューロン）は脳を含む神経系の主要な細胞で、情報を処理したり伝えたりする役割を持ちます。"Talking with Neurons "では、参加者を神経組織との会話へ誘います。参加者が音声を入力すると、それに対して神経組織が反応します。音と映像で表現された神経の活動を受け取ることで会話のようなやりとりが行われます。このインスタレーションは、人間と神経細胞の新しいインタラクションの方法を探ることで、私たちが毎日使っているテクノロジーに生きた神経細胞を組み込む未来を想像していただきます。
Institute of Industrial Science, The University of Tokyo in collaboration with National University of Singapore. This work was supported in part by the UTokyo Ushioda Foundation, the Institute for AI and Beyond, and the Foundation for the Promotion of Industrial Science.
Authors
Prasanth Kunasilan
Alexandra Arguelles
Yuri Klebanov
Siu Yu Angela Chow
Tomoya Duenki
Atsuhiro Nabeta
Yoshiho Ikeuchi
Miles Pennington
Hyunjung Kim
Yu Uchikura
Naoto Takayama
Ryota Murai
Read more at:
Audio-visual representation of neuronal activity
"Talking with Neurons" enables people to remotely speak with in vitro neurons. Audiences activate lab-grown neural circuits called neural organoids in an off-site lab through their vocal cues. The neurons respond to this stimulation by exhibiting patterns of activity that are subsequently translated into audiovisual representations. Essentially, people talk to the neurons, which then promptly respond to the audience.
The configuration of "Talking with Neurons" consists of an installation virtually connected between an on-site exhibition and a remote lab in Tokyo. The on-site location is equipped with a projector, screen, and headset to allow the audience to digitally interact with the neurons. In the virtual setup, in vitro neural circuits are connected to a microelectrode array (MEA) that stimulates the organoids based on the remote input – the audience's voice – and records neuronal activity patterns in response to the stimulation. The captured signals are then transmitted to the on-site computer in real-time and instantly converted into auditory and visual data.
The aural interaction between the user and in vitro neurons is based on intonation, as changes in pitch and rhythm allow oneself to express meaning beyond words. Key activity markers of the neuronal patterns, such as spikes (neuronal action potentials) and bursts (a group of action potentials generated in rapid succession), are encoded into simple sounds. Thus, users can experience the inception of basic communication with lab-grown organoids.
Audiences are given the opportunity to witness a stunning visual rendition of neuronal harmony, demonstrating the spatial and temporal intricacies of the neuronal activities exhibited by in vitro neural circuits. The attached neural organoids, depicted in an abstract manner as two large circles bridged with a thin line surrounded by a dark background, contrast with bright flares that light up during burst events and glimmers that pulsate in time with neuronal spikes. The abstracted visuals of the connected organoid's activity are juxtaposed with live footage of the experiment conducted at the remote lab. The installation re-imagines the technical, data-based experiments as an expressive and engaging experience by relaying complex knowledge to the audience.
Audiences are given the opportunity to witness a stunning visual rendition of neuronal harmony, demonstrating the spatial and temporal intricacies of the neuronal activities exhibited by in vitro neural circuits. The attached neural organoids, depicted in an abstract manner as two large circles bridged with a thin line surrounded by a dark background, contrast with bright flares that light up during burst events and glimmers that pulsate in time with neuronal spikes. The abstracted visuals of the connected organoid's activity are juxtaposed with live footage of the experiment conducted at the remote lab. The installation re-imagines the technical, data-based experiments as an expressive and engaging experience by relaying complex knowledge to the audience.
Audiences are given the opportunity to witness a stunning visual rendition of neuronal harmony, demonstrating the spatial and temporal intricacies of the neuronal activities exhibited by in vitro neural circuits. The attached neural organoids, depicted in an abstract manner as two large circles bridged with a thin line surrounded by a dark background, contrast with bright flares that light up during burst events and glimmers that pulsate in time with neuronal spikes. The abstracted visuals of the connected organoid's activity are juxtaposed with live footage of the experiment conducted at the remote lab. The installation re-imagines the technical, data-based experiments as an expressive and engaging experience by relaying complex knowledge to the audience.
Live demonstrations at SIGGRAPH 2023
Users will be able to try 'Talking with Neurons' at the SIGGRAPH 2023 Art Gallery. Live demonstrations will be held at the following times (PDT).
August 6 (Sun) - August 9 (Wed)
• 2:00 PM - 2:40 PM
• 3:00 PM - 3:40 PM
• 4:00 PM - 4:40 PM
August 10 (Thu)
• 2:00 PM - 2:40 PM
• 3:00 PM - 3:30 PM
With each trial, our systems summarize the visual responses through snapshots of the interaction, adding them to an online archive of these compelling conversations between humans and living neurons. What will be revealed as the brain-like tissues continue to engage in further conversations? Will they respond consistently to similar auditory stimuli? Will they learn and develop?
Sneak Peek of the Backstage: The Ikeuchi Lab, IIS UTokyo
The Ikeuchi Lab is developing methods to build neural tissues outside of our body. Our brain and the nervous system is complex and many different parts coordinate to execute higher-order functions. The researchers aim to comprehend how the network of sections of the brain form and operate, and to contribute to find cure for diseases of the brain. To achieve these, they utilize microfabricated culture vessels and multielectrode arrays. This approach aids them in studying in greater detail how the many parts of the brain form and organize themselves. Read more about the Ikeuchi Lab here.
