AR instrument exploration
A designed experience in which learners discover music-related tasks through their surroundings.
Sound provides functional feedback.
An AR music-learning experience exploring how playful tasks, audiovisual guidance and embodied interaction can make musical learning more approachable.
SoundQuest is a UI/UX concept for making music learning more playful through AR exploration, guided practice and audiovisual feedback. The wider app journey, AR tasks and learning companion are design proposals. Virtual Music Hall is an implemented Android first-person music scene built around original 3D assets and an original composition. A separate Android AR prototype tests spatial object interaction.
Music theory can feel detached from the act of making music. SoundQuest explores a more embodied approach: learners discover tasks, interact with instruments and receive feedback in context.
Its visual world and interface turn learning into an exploration, connecting AR instruments, a virtual music hall and guided piano practice.
Progression supports the musical activity instead of replacing it.
Find a musical task.
Encounter an instrument in AR.
Try a musical interaction.
Receive audiovisual feedback.
Move to the next task.
The concept connects mobile UI, AR exploration and practice support. Virtual Music Hall is the implemented first-person Android module: players can move through the music environment and start an original song. Separately, an Android AR prototype tests placing and transforming the project’s 3D music assets in physical space.
A designed experience in which learners discover music-related tasks through their surroundings.
A concept for connecting visual cues with physical keys and learner actions.
An implemented Android first-person scene where players move through the environment and start original music.
These screens document the SoundQuest product design: an experience that connects location-based discovery, AR instrument encounters, sound collection, personal progress, community and reflective listening. They are UI/UX design outputs that define the proposed service; they are not presented as a complete released application.
A clear entry point for sound collection, location exploration and meditation.
A GPS-led task turns finding an instrument into a legible, step-by-step goal.
Profile, vault, leaderboard and community views make contribution and progress visible.
Sound collection and meditation extend the experience beyond a single task.
Designed: the SoundQuest app journey, AR learning tasks, guided piano practice, feedback system and community features remain concept work.
Prototyped / implemented: Virtual Music Hall is an Android first-person scene with original music playback; a separate Android AR prototype supports object placement and transformation.
Future direction: haptic or vibration feedback remains a designed direction unless implementation evidence is supplied.
Virtual Music Hall is a completed first-person Android music scene within SoundQuest. I created its 3D music assets and environment. The player can move through the scene and click a play control to start my original song. This is a focused implementation of spatial exploration and music playback, rather than a full build of every proposed SoundQuest learning feature.
Watch the Android AR prototype walkthrough
The AR Pawn handles plane candidates and object placement. Its Blueprint also separates one-finger selection from two-finger gesture actions used to translate, rotate and scale the placed object.
Within the first-person Android scene, clicking the play control starts an original track composed for Visual Music Hall. This is the implemented audio interaction evidenced in the prototype walkthrough.
Haptic / vibration feedback: Designed / Future Direction.
The evaluation should test whether feedback makes the next action clearer, rather than assume that it succeeds.
These are design-review observations from the prototype and interface walkthrough, not findings from a formal user study.
Audio and visual cues should connect an action with a musical response. The remaining design question is whether that response helps a learner understand what to do next.
This walkthrough documents the implemented Virtual Music Hall scene, where the player moves through the Android environment and starts an original song, as well as the separate Android AR object-interaction prototype.