��ɫ��Ƶ

Imagine the cacophony of a conversation in which everyone talks, listens and responds at the same time.��

Trained musicians performing together can make a similar set of sensory inputs and brain activity truly resonate. Though a feature of the human experience for thousands of years, interbrain synchronization when playing music is not well understood.

As a member of the��Brain Music Lab, ATLAS PhD student��Thiago Roque has developed novel techniques for studying these nuanced dynamics with the aim to expand our understanding not only of musical performance, but also of human-to-human collaboration and connection more broadly.

In his teens, Roque fell in love with music while beginning to develop his engineering skills. “I always wanted to be an engineer because I wanted to understand how things work, mostly toys and mechanics, electrical stuff,” he said, “but at that point, I also wanted to understand music.”

When he got his first electronic keyboard, he realized, “An electrical engineer designed this to make music, so I realized that I could connect both things.”��

After earning BS and MS degrees in electrical engineering at University of Campinas in Brazil, Roque came to study with��Grace Leslie at Georgia Tech, then transferred to ��ɫ��Ƶ when Leslie opened her Brain Music Lab in the ATLAS Institute.

“Thiago has been a really integral part of the Brain Music Lab,” Leslie noted. “A lot of that has to do with his engineering background—it's rare to find graduate students who have the musical sophistication to be working on these projects and can rise to the occasion when it comes to developing custom technology for the research questions that we have.”

Studying brains in motion

Analyzing brain activity in moving bodies is surprisingly challenging—standard EEG data is captured in subjects who remain still.��

Roque has studied how dancers’ brains sync when they perform together, using his electrical engineering background to develop ways to improve the quality of EEG data in moving subjects.��

To compensate for all the action involved, he sewed motion sensors into the EEG caps and modified hardware to read neck and eye movement to improve data quality. This led to more ambitious plans with an even higher degree of difficulty.

The string ensemble experiment

Having dreamed for years of being able to analyze a string quartet performing a piece of music, Roque explained, “we needed all the equipment to be precisely synchronized, so we had to design this hardware that sends triggers and synchronizes everything. I designed and assembled the printed circuit boards myself.”

He spent months incorporating off-the-shelf EEG equipment, accelerometers and other sensors with custom-designed components to normalize the data and sync it between all the musicians.

The next step was finding a quartet willing to participate in the experiment. Luckily, ��ɫ��Ƶ’s��College of Music—across the street from the ATLAS Institute—is home to several student quartets, including the ensemble that ultimately agreed to participate.��

Roque said, “We wanted to work with students here because we know they will have regular rehearsals. They will have just met each other at the beginning of the semester, so they are new to it. We are planning to measure them at the end of the semester so we can see the progress, how they develop.” ��

An interdisciplinary performance��

For Roque, the ATLAS Institute offers several unique elements that make this type of research possible. “It's an interdisciplinary environment that fosters challenging research with high risks but potentially high payouts, and it's a very creative place,” he noted.��

“Thinking about the University of Colorado, I had this opportunity to enroll in this��triple PhD program. I'm getting a PhD in creative technology and design, neuroscience and cognitive science.”��

Leslie explained how this research fits into the Brain Music Lab’s larger mission: “While we are focusing on technology and developing new technology and studying how humans interface with it, what sets us apart is our focus on the really human element to it.”

The next movement

Roque aims to continue studying this young quartet to determine if their brain activity syncs more thoroughly as they continue to perform together. He would also like to study graduate musicians and seasoned professionals to learn how interbrain coupling may change based on the experience level of the musicians.

Roque also looks forward to bringing this technology to the stage. Plans are in the works for a string quartet performance in the spring semester with a huge visualization of live physiological data to give the audience a sense of the musicians’ synchronization.

“A lot of it is developing this technology that we hopefully can use in the future to continue to study musical group dynamics,” Leslie said, “but there's also this human-computer interaction application where he's done some of the foundational research to show that we can develop brain-computer interfaces that can be social.”

This research may reveal insights as to how human connection and collaboration work. Over time, it could lead to tools and techniques to improve our ability to sync with each other when working on complex tasks—whether that means performing in a string quartet, playing a team sport or simply holding a nuanced conversation.

��