Post on 09-Feb-2017
MMeasu
Copelabs Cognition and People centric Computing Labs
Pedro J. Rosa, Ph.D.
Measuring cognitive and emotional processes-
Medición de processos cognitivos y emocinales
Pedro J. Rosa, Ph.D.
JULIO 21-23
EMOTION
Defining emotion
Emotion is a complex and non-consensual phenomenon
JULIO 21-23
The fetish for emotions
A large body of literature has shown the intimacy between emotion and cognition.
(e.g. LeDoux, 2002; Rosa et al., 2014, 2015)
JULIO 21-23
Defining emotion
JULIO 21-23
Are “supraordinate programs” that orchestrate a concerted psychophysiological response to current situations of adaptive significance in our evolutionary past.
(Loewenstein, 2007)
Measuring a person’s emotional state is one of the most vexing problems in affective science.
(Mauss & Robisson, 2009)
Defining emotion
JULIO 21-23
JULIO 21-23
Emotional episode is not a state but a process in time, during which a response is triggered by a certain stimulus. According to appraisal theories of emotion, once a stimulating event occurs, the individual evaluates what the consequences of this event may be and how they may affect his well-being and goals. Immediately after, a response is triggered to adjust to the new situation or to take action to modify it into a more suiting one.
Emotional episode
Stages of emotional episode
JULIO 21-23(Lazarus, 1991;Scherer, 1984;Smith &Ellsworth, 1985),
Stages of emotional episode
JULIO 21-23
Subjective/Cognitive
Physiological
Behavior
ThreatFear
response
JULIO 21-23
Emotional components
Emotions have been traditionally divided into three main components (the so called‘emotional response triad’ - Scherer 2001): physiological arousal, motor expression, and subjective feeling.
Subjective/Cognitive Physiological Behavior
Measurement
JULIO 21-23
Is the assignment of a number to a characteristc of an object event.
(Pedhazur et al, 1991)
JULIO 21-23
Type of measurement
Subjective vs Objective
JULIO 21-23
Subjective measurement
People’s opinions on certain issues.
Responses on checklists and rating scales Questionnaires
Responses on checklists and rating scales (Self-reports)
JULIO 21-23
Subjective measurement
JULIO 21-23
Measurement of the subjective emotional
experience
Dimensional vs discrete approach
JULIO 21-23
Measurement of the subjective emotional
experience
Dimensional vs discrete approach
Dimensional approach (Russel, 1980)
JULIO 21-23
Dimensional approach (Russel, 1980)
JULIO 21-23
There are a few fundamental dimensions that organize emotional responses. The most commonly assumed dimensions are valence, arousal sometimes referred to as activation), and approach–avoidance.
(Davidson, 1999; Lang, Bradley, & Cuthbert, 1997; Russell & Barrett, 1999; Schneirla, 1959; Watson, Wiese, Vaidya,& Tellegen, 1999).
Dimensional approach (single-item instrument)
JULIO 21-23
Affective space
JULIO 21-23
Tecnostress 1
Arousal
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
Valence
Technostress
positive
Arousal
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
Valence
positive
Negative
Arousal
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
Valence
negative
Pros and Cons
PROS:
Pictorical instrument
Minimize the respondent’s fatigue
CONS: the inability to measure differentiated emotions is a very important weak point
Neutral
Arousal
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 9
Valence
Neutral
Affective space
Afective grid(AG; Russell, Weiss, & Mendelsohn, 1989)
X
Excited
Calm
Unpleasant Pleasant
Afective grid(AG; Russell, Weiss, & Mendelsohn, 1989)
PROS:
Just a X is needed to respond
Minimize the respondent’s fatigue
CONS: Unfamiliar format
Feling scale (FS; Hardy & Rejeski, 1989)
Feling scale (FS; Hardy & Rejeski, 1989
The Feeling Scale (FS; Hardy & Rejeski, 1989) is an ll-point bipolar scale of pleasure and displeasure that ranges from -5 to +5. Anchors are provided at o="Neutral" and at all odd integers, ranging from -5 = "Very bad" to +5 = "Very good.“
Feling scale (FS; Hardy & Rejeski, 1989
PROS:
The rating scale is more intuitive (negative valence linked to the minus sign, neutral =0, and positive valence linked to the plus sign)
Minimize the respondent’s fatigue
CONS:
Not a pictorical instrument
The Felt Arousal Scale (FAS) (Svebak & Murgatroyd, 1985)
Feling scale (FS; Hardy & Rejeski, 1989
It is a 6-point single-item scale ranging from 1 to 6, with anchors only at 1 = "Low arousal" and 6 = "High arousal."
PROS:
Quick response Minimize the respondent’s fatigue
CONS:
The rating range is small
Feling scale (FS; Hardy & Rejeski, 1989
PROS:
The rating scale is more intuitive (negative valence linked to the minus sign, neutral =0, and positive valence linked to the plus sign)
Minimize the respondent’s fatigue
CONS:
Not a pictorical instrument
FS & FAS
The FS and FAS have been adapted for children with the addition of a series of stylized drawings of faces ranging from very happy to very sad and from very sleepy to very alert (Hulley et al., 2008).
FS & FAS
The FS and FAS have been adapted for children with the addition of a series of stylized drawings of faces ranging from very happy to very sad and from very sleepy to very alert (Hulley et al., 2008).
PANAS(Multi-item instrument)
The PANAS (Watson et aI., 1988) was developed as the operationalization of the orthogonal dimensions of positive affect (now called positive activation) and negative affect (now called negative activation) that emerged from the analyses of Zevon and Tellegen (1982) and Watson and Tellegen (1985).
PANAS(Multi-item instrument)
It consists of 20 items, 10 for the PAscale (e.g., interested, excited) and 10 for the NA scale (e.g., distressed, upset). Each item is accompanied by a 5-point scale ranging from "Very slightly or not at all" to "Extremely."
PANAS(Multi-item instrument)
PROS:
A deeper understanding of the affective impact
CONS:
Takes a long time to fill up
PANAS(Multi-item instrument)
Discrete approach of emotions
The discrete emotions perspective contends that each emotion (e.g., anger, sadness, contempt) corresponds to a unique profile in experience, physiology, and behavior.
(Ekman, 1999; Panksepp, 2007).
Discrete approach of emotions
The DES instructions ask the respondents to consider the experience they described and to rate how often s/he experienced each emotion item during the experience.
The DES is formulated around ten emotions that are considered to be fundamental by Izard (1992): joy, surprise, anger, disgust, contempt, shame, guilt, fear, interest, and sadness. Each item is administered on a 5-point (never to very often) scale.
Differential Emotions Scale (DES)
Differential Emotions Scale (DES)
Never Very often
Interest
Enjoyment
Surprise
Distress
Anger
Disgust
Contempt
Shame
Fear
Guilt
Differential Emotions ScaleNever Very
oftenInterest
Enjoyment
Surprise
Distress
Anger
Disgust
Contempt
Shame
Fear
Guilt
Differential Emotions ScaleNever Very
oftenInterest
Enjoyment
Surprise
Distress
Anger
Disgust
Contempt
Shame
Fear
Guilt
Differential Emotions Scale
Self-reports of emotion are likely to be more valid to the extent that they relate to currently experienced emotions.
Even in this case, though, there are concerns that not all individuals are aware of and/or capable of reporting on their momentary emotional states.
AUTONOMIC MEASURES OF EMOTION
The autonomic nervous system (ANS) is a general-purpose physiological system responsible for modulating peripheral functions (Öhman, Hamm, & Hugdahl, 2000). This system consists of sympathetic and parasympathetic branches, which are generally associated with activation and relaxation, respectively.
AUTONOMIC MEASURES OF EMOTION
AUTONOMIC MEASURES OF EMOTION
The most commonly assessed indices of ANS activation are based on electrodermal (i.e., sweat gland) or cardiovascular (i.e., blood circulatory system) responses.
Electrodermal responding:
skin conductance level (SCL) short-duration skin conductance responses (SCRs).
Ohm’s LawR = V / I
AUTONOMIC MEASURES OF EMOTION
The most commonly used cardiovascular measures include heart rate (HR), blood pressure (BP) and heart rate variability (HRV).
For example, SCL predominantly reflect sympathetic activity, HR and BP reflect a combination of sympathetic and parasympathetic activity, and HRV has been closely linked to parasympathetic activity
(Cacioppo, Berntson, Larsen, Poehlmann, & Ito, 2000).
AUTONOMIC MEASURES OF EMOTION
Pupillary activity
More recent data have suggested that emotional arousal is akey element in modulating the pupil’s response.
(Lang et al, 2008; Rosa et al 2014, 2015)
AUTONOMIC MEASURES OF EMOTION
The pupil is a vegative-sensor. Pupil size at a given moment is the result of the antagonistic balance between the two components of the ANS .
Diameter depends on:
• Amount of light• Cognitive load• Emotions
Most investigated emotions
Kreibig, 2010)
• A large set of researchers has advocated that the physiological correlates of discrete emotions are likely to be found in the brain rather than in peripheral physiological responses
(Buck, 1999; Izard, 2007; Panksepp, 2007).
BRAIN STATES AS A MEASURE OF EMOTION
EEG
The most common EEG measure of this type is alpha power (8–13 Hz band), which is thought to be inversely related to regional cortical activation
(Allen, Urry, Hitt, & Coan, 2004).
BRAIN STATES AS A MEASURE OF EMOTION
Frontal asymmetry
• Davidson and Henriques (1990) found that greater left-sided activation at baseline predicted more intense experiences of positive than negative emotion.
• Along similar lines, Davidson, Ekman, Saron, Senulis, and Friesen (1990) a greater left-sided frontal activation subsequent to the emotional induction.
• Other sources of data converge on a similar model of frontal asymmetry. Of particular importance are studies that link anger, an unpleasant but approach-related emotion, to greater left-hemispheric activation (Harmon-Jones, 2006).
BRAIN STATES AS A MEASURE OF EMOTION
Neuroimaging studies
• fMRI (functional magnetic resonance imaging) or PET (positron emission tomography) technologies, can locate activation in far more specific brain regions than EEG.
• For this reason, it has been proposed that neuroimaging methods may be better suited than EEG to reveal emotion specificity in the brain (Panksepp, 1998).
• In both technologies, the assumption is that a greater signal reflects greater blood flow to a particular brain region, which in turn is thought to reflect activation of that region.
BRAIN STATES AS A MEASURE OF EMOTION
Neuroimaging studies
FEAR – Amygdala (Murphy et al., 2003; Phan et al., 2002).
DISGUST – Insula Phan et al. (2002)
SADNESS - mPFC Phan et al. (2002)
ANGER AND HAPPINESS – inconclusive studies
BRAIN STATES AS A MEASURE OF EMOTION
• Darwin (1965) suggested that emotions serve an evolved communicative function and thus should prime behaviours that reveal one’s emotional state to others.
Vocal characteristics
• The most consistent association reported in the literature is between arousal and vocal pitch, such that higher levels of arousal have been linked to higher-pitched vocal samples
(e.g. Kappas, Hess, & Scherer, 1991)• Emotions such as fear, joy, and anger, pitch is higher than lower arousal
emotions such as sadness.
Behavioral measurements
Facial behaviour
Darwin (1965) reasoned that facial displays are closely tied to the likely behaviour of the organism (e.g., biting in the case of anger, which would result in exposed teeth).
Observer ratings ( Manual FACS)
Face detection software ( e.g. NOLDUS, EMOtient)
Behavioral measurements
Facial behaviour
Darwin (1965) reasoned that facial displays are closely tied to the likely behaviour of the organism (e.g., biting in the case of anger, which would result in exposed teeth).
Observer ratings ( Manual FACS)
Face detection software ( e.g. NOLDUS, EMOtient)
Behavioral measurements
Electromyography (EMG)
Facial behaviours potentially indicative of emotion can also be assessed with facial EMG, which involves measuring electrical potential from facial muscles via the placement of electrodes on the face.
Corrugator muscle activity decreases linearly with the pleasantness of affective stimuli —responding to stimuli across the full valence spectrum, while zygomatic muscle activity increases linearly with the pleasantness of affective stimuli—responding to pleasant stimuli
Behavioral measurements
EYE tracking
• We move our eyes to particular area of the visual field (foveation).
• This process allow us a detailed information processing.
ATTENTION is closed linked to EMOTION !!!
(ROSA et al, 2014, 2015)
Behavioral measurements
• Measuring valid data on emotional response has been and remains to be a challenge to emotion research (e.g., Levenson, 1988; Stemmler, 2003).
• It is not possible to infer about a certain emotion only with a single measurement.
• Multimodal recording are needed to assure the robustness of data.
Conclusions
Thank you for your attention!pedro.rosa@ulusofona.pt
orpedrorosa.psi@gmail.com
JULIO 21-23