Loopy

This project reimagines how we experience music by addressing the static and non-immersive nature of traditional streaming platforms, where most songs lack true spatial depth. Spatial audio, a technology that simulates three-dimensional sound by positioning audio elements around the listener, has begun to transform how people experience recorded music. However, many “spatial audio” tracks do not fully capitalize on 3D sound technology. This gap exists because spatial mixing is expensive to license, technically complex, and largely inaccessible to independent artists. As a result, there’s a growing need for a tool that increases the accessibility of spatial audio, making it easier for both listeners and creators to engage with. 

While spatial audio has advanced how we listen to music, no automated system currently exists that can intelligently transform a standard song into a context-aware, binaural experience. Manual spatial mixing remains the only option, but it is time-consuming, requires specialized technical expertise, and is often inaccessible to most musicians. Our project introduces an AI-driven system that automatically converts ordinary songs into immersive, 3D-like audio by analyzing lyrical and musical context. To begin, the system focuses on translating lyrical cues into spatial movement. For instance, a lyric such as, “If I slip, I’ll fall into a better situation” could trigger a downward motion of the vocal track, while a song featuring a back-and-forth dialogue between multiple artists could position their voices on opposite sides, creating a natural sense of space and interaction. In addition, we are developing a chat-based interface that enables users to interact with the system, refine spatial effects, and personalize their listening experience. 

Our team is under the mentorship of Brandon Hale from ICAT, using his studio to test spatial mixes and gather expert feedback. This project offers meaningful benefits to both listeners and artists. For listeners, it transforms ordinary music into a rich, immersive soundscape. For artists, it provides an accessible way to experiment with spatial audio, removing technical and financial barriers to 3D sound creation. Ultimately, this project amplifies the arts by giving everyday listeners a more emotional, interactive way to experience music. It also has potential to alter the future of creative work by positioning AI as a partner that helps artists ideate, experiment, and bring their visions to life through an intuitive, web-based platform.