芸術する脳 ハッカソン by 理研&芸大
Art meets Brain Hackathon by RIKEN AIP & GeiDai
November 30, 2024, Tokyo, Japan
Institutions supporting the hackathon and the sponsor of the grand prize:
g.tec medical engineering GmbH in Austria graciously sponsors the winning team prize with a fantastic 500 EUR.
Hackathon winning project & team
We’re excited to announce that the winning Team F has been rewarded with a cash prize of 500 EUR, generously sponsored by g.tec medical engineering GmbH in Austria!
Hackathon first mention project & team
Hackathon second mention project & team
All hackathon projects with short descriptions
Team A: BCI Clapping Game
Description:
BCI Motor Imagery Paradigm: Electrodes C3 and C4 over Motor Cortex; Mu (sensorimotor) rhythm bandpower features → contralateral de-synchronization related to movement/motor imagery
Multi-media Art: EEG features send via OSC to MAXMSP; based on granular synthesis; real-rime sound processing; combined visualization of Sound + EEG (WIP)
Members:
Hans Schmidt
Marc WELTER
Zhiyu Zhou
Team B: ネルミン
Description:
α波を用いたBCI ・BCI using alpha waves; リラックスする事により、ピッチと音量をコントロールする ・ Controlling pitch and volume by relaxing; ステージの上で寝る度胸が必要 ・Needs courage to sleep on stage.
Members:
村上 慧
前澤 陽
Lloyd Jakob Marquart
Team C: 『Hackathon Photo. 発覚頌写真 』
Description:
この作品は「横浜写真」をオマージュしている。「横浜写真」とは約150年前に幕末から明治にかけて日本最大の開港地となった横浜を中心に発達した商業写真。日本を訪れた外国人旅客向けの土産物として人気を博た。日本の風景や風俗が焼き付けられたモノクロの写真は、日本画の顔料で色鮮やかに彩色された。したがって横浜写真とは西洋の最新技術である写真と日本の伝統的な技術とが結びついた工芸品だとも言える。
当時の横浜写真は外国人に対してはエキゾチシズム的な目新しいものであったが、150年後の我々にとっても同じく「目新しいもの」であろう。本作品はアイトラッキングの技術を使い、インタラクティブの形で昔の横浜写真の色を付ける過程を還元し、歴史と時間を提示する一方で、私たちが写真あるいは画像を見る眼差しを表現しようとする。また、過去と現在の「芸妓・舞妓」の写真を使うことで、フェミニズム的な視点も入っている。This work pays homage to "Yokohama Photography." Yokohama Photography refers to commercial photography that developed approximately 150 years ago, during the late Edo to early Meiji periods, centered around Yokohama, Japan's largest open port city at the time. These photographs gained popularity as souvenirs for foreign travelers visiting Japan. Monochrome photographs capturing Japanese landscapes and customs were vividly hand-colored using pigments traditionally used in Japanese painting. Thus, Yokohama Photography can be described as a form of craftwork combining the latest Western technology of photography with traditional Japanese techniques.
At the time, Yokohama Photography offered a sense of exotic novelty to foreign audiences. Even 150 years later, it retains this quality of "novelty" for us. This work utilizes eye-tracking technology in an interactive format to recreate the process of coloring old Yokohama photographs, presenting history and the passage of time while also expressing our gaze as we view photographs or images. Additionally, by incorporating photographs of "geisha and maiko" from both past and present, this work also introduces a feminist perspective.
Members:
船附 穂乃花・ Honoka Funatsuki
Ji Xuehan
白川 深紅・Sync Shirakawa
Team D: ガンマ帯域刺激に抵抗してリラックス!音修行して悟りの境地!・Resist gamma band stimulation and relax! Practice sound to reach enlightenment!
Description:
ガンマ帯域(40Hz周辺)の音・光刺激は脳波の速波化を進め、脳を覚醒状態に保つ効果が確認されているが、刺激に屈してしまうのは人間らしくない!と我々は考えました。覚醒状態に保とうとする音楽(ガンマミュージック)を聞きながらでも、リラックス状態を実現しアルファ波が増えることで曲調が変化していく音楽作品です。
Sound and light stimuli in the gamma band (around 40Hz) have been shown to speed up brainwaves and keep the brain awake, but we thought it would be inhuman to succumb to such stimuli! This is a piece of music that changes tone as you relax and increase alpha waves, even while listening to music that keeps you awake (gamma music).
Members:
櫻井 力
茅根 和城
劉晨瀚
投石
Team E: 照明と脳とピアノ・Lighting, Brain and Piano
Description:
部屋の照明をオンオフすることで脳波を変化させ、その信号でMIDIピアノを演奏する。脳波の明確な変化を捉えるため7ch [Oz] のα波に注目しその部分に絞って値を取り出している。会場全体の照明によって演奏された音色は、そのまま会場全員の脳の状態とも相関を持つはずである。
Brainwaves are changed by turning the lights in the room on and off, and the resulting signals are used to play a MIDI piano. To capture clear changes in brainwaves, attention is focused on alpha waves on channel 7 and values are extracted from that portion only. The tone produced by the lighting throughout the venue should directly correlate with the brain state of everyone in the venue.
Members:
星 善太
中川 陽介
後藤 英
Team F: 脳波フィードバック・ダンス・Brainwave Feedback Dance
Description:
ダンサーの動きとアルファ波でシンセサイザーの音色をコントロールする。ダンサーは、ダンスに合わせて生成される音を聴いて自らのダンスにフィードバックしながら即興的に踊る。
The synthesizer's sound is controlled by the dancer's movements and alpha waves. The dancer improvises by listening to the sound generated in time with their dance and feeding it back into their dancing.
Members:
森めぐみ
公文太一・Kumon Taichi
田中翼
Hackathon organizers & mentors:
Arts:
Prof. Kiyoshi FURUKAWA , Tokyo University of the Arts, Tokyo, Japan
Prof. Takayuki HAMANO, Kunitachi College of Music, Tokyo, Japan
Brain & neurotechnology:
Simon KOJIMA, PhD candidate, Shibaura Institute of Technology & RIKEN AIP, Tokyo, Japan
Dr. Tomasz M. RUTKOWSKI, RIKEN AIP, Tokyo, Japan
Dr. Reiko SHIBA, Tokyo University of the Arts & RIKEN, Tokyo, Japan
Jeremia Imanuel Gesha PUNGUS, g.tec, Tokyo, Japan
Hackathon jury:
Co-chairs:
Prof. Kiyoshi FURUKAWA, Tokyo University of the Arts, Tokyo, Japan
Prof. Jarosław KAPUŚCIŃSKI, Stanford University, CA, USA
Members:
Prof. Takayuki HAMANO, Kunitachi College of Music, Tokyo, Japan
Dr. Tomasz M. RUTKOWSKI, RIKEN AIP, Tokyo, Japan
Dr. Minh HA QUANG, RIKEN AIP, Tokyo, Japan
Simon KOJIMA, PhD candidate, Shibaura Institute of Technology & RIKEN AIP, Tokyo, Japan
Jeremia Imanuel Gesha PUNGUS, g.tec, Tokyo, Japan
Event program:
10:00~12:00: Neurotechnology introductory lecture and hands-on neurotech and art workshop by Simon KOJIMA , RIKEN AIP & SIT , and the Unicorn Hybrid Black EEG wearable application instructions by Jeremia Imanuel Gesha PUNGUS, g.tec , Tokyo, Japan
Lunch: "Bring your own"
12:00~ 16:00: Brain & arts hackathon
16:30~18:30: The final project presentations, along with the announcement of the winner and the presentation of the grand prize - open to the public
Address & map:
Center of Creative Inheritance for the Future, Tokyo University of the Arts
東京芸術大学 未来創造継承センター
B1f Arts & Science LAB, 12-8 Uenokoen, Taito City, Tokyo 110-0007, Japan
Contact email:
Materials
スライド資料はこちらからダウンロードいただけます.
Acknowledgments:
JST Grant Number JPMJPF2105 endorsed this event. 本イベントは、JST 共創の場形成支援プログラムJPMJPF2105 の支援を受けたものです。
g.tec medical engineering GmbH in Austria generously provides sponsorship for the winning team award, which includes an exceptional 500 EUR.