Real-time 3D Object Manipulation based on Music’s Structure using Unity 3D

Abstract / Excerpt:

Music, in its nature, is a sound and can only be perceived through hearing and experiencing it in other sense can be more immersive. There are 2d visualizations that displays the wave form of a music, but it is still not enough to present a music’s structure. The goal of this study is to generate a 3D object in association with music different from common 2d visualizations by using beat detection algorithm. This research is also concerned about displaying a music visually though a deformed 3d figure. There will be some algorithms to be used in order to achieve the output like beat detection, self­-similarity, and etc to analyze and determine the structure of the music. The beat detection algorithm will be used to calculate the beat and the beats per minute from the music. Second, the pattern recognition algorithm analyzes if there are the same patterns in the music. Lastly, Self-­similarity method determines the position of the segment with the same pattern. This research will then develop a software that visualizes music structure in 3D environment by deforming a 3d object according to the analyzed audio values in real-­time.

Info
Source InstitutionAteneo de Davao University
UnitComputer Studies
AuthorsPaul Albrick Coronia, Christopher Jon Torres
Page Count53
Place of PublicationDavao City
Original Publication DateOctober 1, 2015
Tags 3D manipulation, Audio Visualization, Beat Detection, Music Analysis, Music structure, Real­-time, Spectrum
Preview

Download the PDF file .