Many researchers stated that after a period of neglect, because of the methodological problems, the topic of music and emotion is again at the forefront of music psychology. Therefore it is important to integrate existing knowledge from a variety of disciplines to be able to further theoretical development, and the findings of this experimental study would contribute with some conclusions. The study found that effects of unmodified and modified tempo and timbre element towards the emotional musical responses of the musicians differs from those of non-musicians, since musicians are significantly more sensitive towards the tempo and timbre differences. There are definitely differences provided by effects of modified and unmodified tempo and timbre element stimulation towards the emotional musical responses of the listeners, as well as showing that tempo is the most important element and potentially stimulate emotional responses. This study also claims that musical emotional responses which are stimulated by the timbre element of the Javanese gamelan instrument is more effected by the listener’s perception, experience and sociocultural aspects, than only by physics factors. It was shown by the evidence that musical emotional responses of the Javanese Gamelan listeners are significantly more affected by the tempo element compared to the timbre element. Cultural factors were also determined as dominant factors that should always be considered, as it is always related to the perception and musical emotional responses that come forward.