Measuring Behavioral and Physiological Responses in Videos and VR | Jainlab

Abstract

Videos are very powerful at eliciting strong emotional responses from viewers. We are interested in measuring and understanding these responses. We are also interested in measuring responses from viewers in Virtual Reality.

Comparison of Kent and Viewport methods for our dataset and Salient360!


A Benchmark of Four Methods for Generating 360◦ Saliency Maps
from Eye Tracking Data
"A Benchmark of Four Methods for Generating 360◦ Saliency Maps from Eye Tracking Data", Brendan John, Pallavi Raiturkar, Olivier Le Meur, Eakta Jain, IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 2018. Selected as one of the top 4 out of 58 accepted papers invited to submit an extended version to the International Journal of Semantic Computing.
  • Paper (preprint) (PDF - 1.8MB)
  • Code (ZIP)
  • Bibtex entry:
    @inproceedings{john2018,
    author = {John, Brendan and Raiturkar, Pallavi and Banerjee, Arunava and Jain, Eakta},
    title = {A Benchmark of Four Methods for Generating 360◦ Saliency Maps from Eye Tracking Data},
    booktitle = {IEEE International Conference on Artificial Intelligence and Virtual Reality},
    year = {2018},
    organization = {IEEE}
    }

Pupillary light response in VR for two different grayscale intensities.


An Evaluation of Pupillary Light Response Models
for 2D Screens and VR HMDs
"An Evaluation of Pupillary Light Response Models for 2D Screens and VR HMDs", Brendan John, Pallavi Raiturkar, Arunava Banerjee, Eakta Jain, ACM Symposium on Virtual Reality Software and Technology (VRST), 2018.

Example video with emotional responce plotted.


Decoupling Light Reflex from Pupillary Dilation to
Measure Emotional Arousal in Videos
"Decoupling Light Reflex from Pupillary Dilation to Measure Emotional Arousal in Videos", Pallavi Raiturkar, Andrea Kleinsmith, Andreas Keil, Arunava Banerjee, Eakta Jain, ACM Symposium on Applied Perception (SAP), 2016.
Measuring Viewers’ Heart Rate Response to Environment Conservation Videos
"Measuring Viewers’ Heart Rate Response to Environment Conservation Videos", Pallavi Raiturkar, Susan Jacobson, Beida Chen, Kartik Chaturvedi, Isabella Cuba, Andrew Lee, Melissa Franklin, Julian Tolentino, Nia Haynes, Rebecca Soodeen, and Eakta Jain, ACM Symposium on Applied Perception (SAP), 2016.
  • Poster Abstract (PDF)
  • Code & Data (ZIP)
  • Bibtex entry:
    @inproceedings{Raiturkar:2016:MVH:2931002.2948724,
    author = {Raiturkar, Pallavi and Jacobson, Susan and Chen, Beida and Chaturvedi, Kartik and Cuba, Isabella and Lee, Andrew and Franklin, Melissa and Tolentino, Julian and Haynes, Nia and Soodeen, Rebecca and Jain, Eakta},
    title = {Measuring Viewers' Heart Rate Response to Environment Conservation Videos},
    booktitle = {Proceedings of the ACM Symposium on Applied Perception},
    series = {SAP '16},
    year = {2016},
    pages = {138--138},
    doi = {10.1145/2931002.2948724},
    url = {http://doi.acm.org/10.1145/2931002.2948724}
    }
Scan Path and Movie Trailers for Implicit Annotation of Videos
"Scan Path and Movie Trailers for Implicit Annotation of Videos", Pallavi Raiturkar, Andrew Lee, and Eakta Jain, ACM Symposium on Applied Perception (SAP), 2016.
  • Poster Abstract (PDF)
  • Code & Data (ZIP)
  • Bibtex entry:
    @inproceedings{Raiturkar:2016:SPM:2931002.2948723,
    author = {Raiturkar, Pallavi and Lee, Andrew and Jain, Eakta},
    title = {Scan Path and Movie Trailers for Implicit Annotation of Videos},
    booktitle = {Proceedings of the ACM Symposium on Applied Perception},
    series = {SAP 16},
    pages = {141--141},
    doi = {10.1145/2931002.2948723},
    year = {2016},
    url = {http://doi.acm.org/10.1145/2931002.2948723}
    }

Copyright notice

© 2016 Copyright is held by the owner/author(s). Publication rights licensed to ACM.