Repository - Experiments

Experiments List

Here is a list of the experiments conducted within the EU SIEMPRE project. They are organized by scenario: Quartet, Orchestra and Audience.
For each experiment, a full description is given with links to access the related recorded material.


  • Solo Vs Ensemble performance

    Can we distinguish between a solo Vs. Ensemble performance based on non-verbal behavioral variables?

    • Abstract: When people perform a task as part of a joint action, their behavior is not the same as it would be if they were performing the same task alone: it is adapted to facilitate shared understanding (or sometimes to prevent it). Joint performance of music offers a test bed for ecologically valid investigations of the way non-verbal behavior facilitates joint action. Here we compare the expressive movement of violinists when playing solo Vs. in the string quartet music ensemble. The first and second violinists of a famous concert string quartet were asked to play the same musical fragment in a solo condition and with the quartet. Synchronized multimodal recordings have been created from the performances, using a specially developed software platform. The differences are not obvious to untrained observers, but appropriate measures show that they exist. In particular, using an appropriate measure of entropy shows that head movements are more predictable in the quartet scenario. The change does not, as might be assumed, entail markedly reduced expression. The data pose provocative questions about joint action in realistically complex scenarios.
    • Acquired signal type: (Qualysis) MoCap, EMG (electromyography), Video, Audio, Questionnaire data (Post Performance).
    • Keywords: automated analysis of non-verbal social signals, joint music action, sampen entropy
    • Detailed Description: Read PDF
    • Data: Solo - Ensamble - Raw Data
    • Related Publications: GlowinskiTorresetal_SBM2012 - GlowinskiBadinoetal_SBM2012

  • The Perturbed Orchestra

    Is watching the orchestra conductor make you playing better?

    • Abstract: In these series of recordings we recorded movement kinematics of 8 violinists (Head, violin and bow), as well as electromyography (right biceps and triceps) and high resolution videos while playing with a complete orchestra (23 members in total). We recorded several pieces of music with three different conductors. Another critical alteration of the normal communication was asking the first row of violins to rotate 180 degrees. With this latter perturbation we completely alter the normal flow of information between the first row and the conductor. Now they have to rely on the second row of violins in order to receive critical information from the conductor.
    • Acquired signal type: (Qualysis) MoCap, EMG (electromyography), Video, Audio.
    • Keywords: Sensorimotor, communication, music, expertise, motor control, joint action, inter-subject coordination
    • Detailed Description: Read PDF
    • Data: Repovizz Format - Raw Data
    • Related Publications: Gneccoetal_ARTIT2013

  • Multimodal investigation of audience responses to live musical performance

    Using different techniques to assess the dimensions of audience engagement in live performance and the eMAP features relevant to them.

    • Abstract: This study seeks to develop effective measures of audience experience in live musical performance. Of particular interest is the testing of novel continuous and retrospective subjective measures. In the experiment 14 participants attended a concert scenario with 4 contrasting short musical performers. Results show that a shortened quality of experience questionnaire was still able to distinguish between performances when ranked by preference and that subjective and physiological continuous measures showed differences within and between performances. This supports their use for future experiments as a means to assess the experience of an audience with a greater numbers of participants and measures.
    • Acquired signal type: Audio, Video, Questionnaire data (Quality of Experience), Continuous subjective response, Electrodermal Activity, Heart Rate.
    • Keywords: Music, Emotion, Audience, Subjective, Physiology, Performer.
    • Detailed Description: Read PDF
    • Data: Repovizz Format take01, take02, take03, take04, - Raw Data
    • Related Publications: BortzSalazaretal_SBM2012