selected publications
-
book
-
chapter
- Dynamics of Visual Attention in Multiparty Collaborative Problem Solving using Multidimensional Recurrence Quantification Analysis 2019
- Investigating the Impact of a Real-time, Multimodal Student Engagement Analytics Technology in Authentic Classrooms 2019
- Language as Thought: Using Natural Language Processing to Model Noncognitive Traits that Predict College Success 2019
- Social Media as a Passive Sensor in Longitudinal Studies of Human Behavior andWellbeing 2019
- The Tesserae Project: Experiences with Large-Scale, Longitudinal, In Situ, Multimodal Sensing of Information Workers 2019
- Time to Scale: Generalizable Affect Detection for Tens of Thousands of Students across An Entire Schoolyear 2019
- An Open Vocabulary Approach for Detecting Authentic Questions in Classroom Discourse. 116-126. 2018
- Characteristics and Mechanisms of Team Effectiveness in Dynamic Environments. 161-168. 2018
- Connecting the Dots Towards Collaborative AIED: Linking Group Makeup to Process to Learning. 545-556. 2018
- Generative Multimodal Models of Nonverbal Synchrony in Close Relationships. 195-202. 2018
-
Multimodal Modeling of Coordination and Coregulation Patterns in Speech Rate during Triadic Collaborative Problem Solving.
21-30.
2018
- Multimodal, Multisensory Affect Detection. 167-202. 2018
- Prospectively Predicting 4-Year College Graduation from Student Applications. 280-289. 2018
- “Mind” TS: Testing a brief mindfulness intervention with an intelligent tutoring system. 176-181. 2018
- Assessing Teacher Questions in Classrooms. 261–274-261–274. 2017
- Emotional Learning Analytics 2017
-
Automated Mental State Detection for Mental Health Care.
117-136.
2016
- Attention in Educational Contexts: The Role of the Learning Task in Guiding Attention. 623-641. 2015
- CONFUSION. 289-310. 2014
- Conversational Agents Can Help Humans Identify Flaws in the Science Reported in Digital Media. 139-158. 2014
- EMOTIONS IN ADVANCED LEARNING TECHNOLOGIES. 473-493. 2014
-
EMOTIONS DURING THE LEARNING OF DIFFICULT MATERIAL.
Psychology of Learning and Motivation.
183-225.
2012
-
A Motivationally Supportive Affect-Sensitive AutoTutor.
113-126.
2011
- INSTRUCTION BASED ON TUTORING. 408-426. 2011
-
Significant Accomplishments, New Challenges, and New Perspectives.
255-271.
2011
-
Theoretical Perspectives on Affect and Deep Learning.
11-21.
2011
- AUTOTUTOR Learning through Natural Language Dialogue that Adapts to the Cognitive and Affective States of the Learner. 95-125. 2008
- MIKI: A Case Study of an Intelligent Kiosk and Its Usability. Studies in Computational Intelligence. 153-176. 2008
- Toward Socially Intelligent Interviewing Systems. 195-214. 2008
-
conference proceeding
- Is Student Frustration in Learning Games More Associated with Game Mechanics or Conceptual Understanding. 1385-1386. 2018
- Assessing the Dialogic Properties of Classroom Discourse: Proportion Models for Imbalanced Classes. 162-167. 2017
- Face Forward: Detecting Mind Wandering from Video During Narrative Film Comprehension. 359-370. 2017
- Gaze-based Detection of Mind Wandering during Lecture Viewing. 226-231. 2017
- Generalizability of Face-Based Mind Wandering Detection Across Task Contexts. 88-95. 2017
- MAP: Multimodal Assessment Platform for Interactive Communication Competency 2017
- Out of the Fr-Eye-ing Pan: Towards Gaze-Based Models of Attention during Learning with Technology in the Classroom. 94-103. 2017
- Put Your Thinking Cap On: Detecting Cognitive Load using EEG during Learning. 80-89. 2017
- Tracking Online Reading of College Students. 406-407. 2017
- Words Matter: Automatic Detection of Questions in Classroom Discourse using Linguistics, Paralinguistics, and Context. 218-227. 2017
- Zone out no more: Mitigating mind wandering during computerized reading. 8-15. 2017
- The Effect of Text Difficulty on Intentional and Unintentional Mind-Wandering. Canadian Journal of Experimental Psychology. 397-397. 2016
-
Multi-Sensor Modeling of Teacher Instructional Segments in Live Classrooms.
177-184.
2016
-
Investigating Boredom and Engagement during Writing Using Multiple Sources of Information: The Essay, The Writer, and Keystrokes.
114-123.
2016
-
Student Affect during Learning with a MOOC.
528-529.
2016
-
Accuracy vs. Availability Heuristic in Multimodal Affect Detection in the Wild.
267-274.
2015
-
Automatic Detection of Mind Wandering During Reading Using Gaze and Physiology.
299-306.
2015
-
Multimodal Capture of Teacher-Student Interactions for Automated Dialogic Analysis in Live Classrooms.
557-566.
2015
-
Automatic Gaze-Based Detection of Mind Wandering with Metacognitive Awareness.
Lecture Notes in Artificial Intelligence.
31-43.
2015
-
A Study of Automatic Speech Recognition in Noisy Classroom Environments for Automated Dialog Analysis.
Lecture Notes in Artificial Intelligence.
23-33.
2015
-
Mind Wandering During Learning with an Intelligent Tutoring System.
Lecture Notes in Artificial Intelligence.
267-276.
2015
- Toward Fully Automated Person-Independent Detection of Mind Wandering. Lecture Notes in Artificial Intelligence. 37-48. 2014
- Automated Physiological-Based Detection of Mind Wandering during Learning. Lecture Notes in Artificial Intelligence. 55-60. 2014
- Identifying Learning Conditions that Minimize Mind Wandering by Modeling Individual Attributes. Lecture Notes in Artificial Intelligence. 94-103. 2014
- It Takes Two: Momentary Co-occurrence of Affective States during Computerized Learning. Lecture Notes in Artificial Intelligence. 638-639. 2014
- It's Written on Your Face: Detecting Affective States from Facial Expressions while Learning Computer Programming. Lecture Notes in Artificial Intelligence. 39-44. 2014
- To Quit or Not to Quit: Predicting Future Disengagement from Reading Patterns. Lecture Notes in Artificial Intelligence. 19-28. 2014
-
Improving Automated Source Code Summarization via an Eye-Tracking Study of Programmers.
390-401.
2014
-
Affect Detection and Classification from the Non-Stationary Physiological Data.
240-245.
2013
-
Network analysis improves interpretation of affective physiological data.
465-472.
2013
- Consistent but Modest: A Meta-Analysis on Unimodal and Multimodal Affect Detection Accuracies from 30 Studies. 31-38. 2012
- PREDICTING INTEREST WHILE READING WITH WII FIT BALANCE BOARDS. INTED proceedings. 5315-5320. 2012
- Affective Modeling from Multichannel Physiology: Analysis of Day Differences. Lecture Notes in Artificial Intelligence. 4-+. 2011
- Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor. Lecture Notes in Artificial Intelligence. 131-138. 2011
- Does Topic Matter? Topic Influences on Linguistic and Rubric-Based Evaluation of Writing. Lecture Notes in Artificial Intelligence. 450-452. 2011
- Emotion Regulation during Learning. Lecture Notes in Artificial Intelligence. 566-568. 2011
- Inducing and Tracking Confusion with Contradictions during Critical Thinking and Scientific Reasoning. Lecture Notes in Artificial Intelligence. 171-178. 2011
- Training Emotion Regulation Strategies During Computerized Learning: A Method for Improving Learner Self-Regulation. Lecture Notes in Artificial Intelligence. 616-618. 2011
- Individual Differences as Predictors of Learning and Engagement. 308-313. 2010
- Modeling Cognitive-Affective Dynamics with Hidden Markov Models. 2721-2726. 2010
- A DIY Pressure Sensitive Chair for Intelligent Tutoring Systems. Lecture Notes in Artificial Intelligence. 456-456. 2010
- A Time for Emoting: When Affect-Sensitivity Is and Isn't Effective at Promoting Deep Learning. Lecture Notes in Artificial Intelligence. 245-254. 2010
- Collaborative Lecturing by Human and Computer Tutors. Lecture Notes in Artificial Intelligence. 178-187. 2010
- Predicting Student Knowledge Level from Domain-Independent Function and Content Words. Lecture Notes in Artificial Intelligence. 62-71. 2010
- The Impact of System Feedback on Learners' Affective and Physiological States. Lecture Notes in Artificial Intelligence. 264-+. 2010
- The Intricate Dance between Cognition and Emotion during Expert Tutoring. Lecture Notes in Artificial Intelligence. 1-+. 2010
- Responding to Learners' Cognitive-Affective States with Supportive and Shakeup Dialogues. Lecture Notes in Artificial Intelligence. 595-+. 2009
-
Antecedent-Consequent Relationships and Cyclical Patterns between Affective States and Problem Solving Outcomes.
Frontiers in Artificial Intelligence and Applications.
57-+.
2009
-
Cohesion Relationships in Tutorial Dialogue as Predictors of Affective States.
Frontiers in Artificial Intelligence and Applications.
9-+.
2009
-
The Relationship Between Modality and Metacognition While Interacting with AutoTutor.
Frontiers in Artificial Intelligence and Applications.
674-+.
2009
- Comparing learners' affect while using an intelligent tutoring system and a simulation problem solving game. Lecture Notes in Artificial Intelligence. 40-+. 2008
- Dialogue modes in expert tutoring. Lecture Notes in Artificial Intelligence. 470-+. 2008
- Self versus teacher judgments of learner emotions during a tutoring session with AutoTutor. Lecture Notes in Artificial Intelligence. 9-+. 2008
- The dynamics of self-regulatory processes within self-and externally regulated learning episodes during complex science learning with hypermedia. Lecture Notes in Artificial Intelligence. 260-269. 2008
- RFID tag characterization in a GHz transverse electromagnetic cell. 259-+. 2007
- Emotions and Learning with AutoTutor. Frontiers in Artificial Intelligence and Applications. 569-+. 2007
- Mind and Body: Dialogue and Posture for Affect Detection in Learning Environments. Frontiers in Artificial Intelligence and Applications. 161-+. 2007
- Finding information and finding locations in a multimodal interface: A case study of an intelligent kiosk. 111-+. 2007
- Cognitively inspired anticipatory adaptation and associated learning mechanisms tor autonomous agents. Lecture Notes in Artificial Intelligence. 108-127. 2006
- Affect detection from human-computer dialogue with an intelligent tutoring system. Lecture Notes in Artificial Intelligence. 54-67. 2006
- MIKI: A speech enabled Intelligent Kiosk. Lecture Notes in Artificial Intelligence. 132-144. 2006
- A mechanism for human - Robot interaction through informal voice commands. 184-189. 2005
- Modified sparse distributed memory as transient episodic memory for cognitive software agents. IEEE International Conference on Systems Man and Cybernetics. 5858-5863. 2004
-
journal article
-
A brief behavioral measure of frustration tolerance predicts academic achievement immediately and two years later..
Emotion.
2018
-
How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning.
Educational Research Review.
100-119.
2018
-
Automatically Measuring Question Authenticity in Real-World Classrooms.
Educational Researcher.
451-464.
2018
-
How the stimulus influences mind wandering in semantically rich task contexts.
Cognitive Research: Principles and Implications / Cognitive Research: Principles and Implications - a SpringerOpen journal.
2018
-
Re-Watching Lectures as a Study Strategy and Its Effect on Mind Wandering.
Experimental Psychology.
297-305.
2018
-
Gaze-Based Signatures of Mind Wandering During Real-World Scene Processing.
Journal of Experimental Psychology: General.
1111-1124.
2018
-
Instructor presence effect: Liking does not always lead to learning.
Computers and Education.
205-220.
2018
-
Too much of a good thing? Exploring the inverted-U relationship between self-control and happiness..
Journal of Personality.
380-396.
2018
-
Driven to distraction: A lack of change gives rise to mind wandering.
Cognition.
133-137.
2018
-
The Affective Computing Approach to Affect Measurement.
Emotion Review.
174-183.
2018
-
An automated behavioral measure of mind wandering during computerized reading.
Behavior Research Methods.
134-150.
2018
-
Enjoyment or involvement? Affective-motivational mediation during learning from a complex computerized simulation.
Computers and Education.
236-254.
2017
-
Cognitive Coupling During Reading.
Journal of Experimental Psychology: General.
872-883.
2017
-
The effect of disfluency on mind wandering during text comprehension.
Psychonomic Bulletin and Review.
914-919.
2017
-
The Affective Experience of Novice Computer Programmers.
International Journal of Artificial Intelligence in Education.
181-206.
2017
-
ETGraph: A graph-based approach for visual analytics of eye-tracking data.
Computers and Graphics.
1-14.
2017
-
Advanced, Analytic, Automated (AAA) Measurement of Engagement During Learning.
Educational Psychologist.
104-123.
2017
-
Automated Detection of Engagement Using Video-Based Estimation of Facial Expressions and Heart Rate.
IEEE Transactions on Affective Computing.
15-28.
2017
-
The influence of positive vs. negative affect on multitasking.
Acta Psychologica.
10-18.
2016
-
Using Video to Automatically Detect Learner Affect in Computer-Enabled Classrooms.
ACM Transactions on Interactive Intelligent Systems.
2016
-
Giving Eyesight to the Blind: Towards Attention-Aware AIED.
International Journal of Artificial Intelligence in Education.
645-659.
2016
-
Mind wandering during film comprehension: The role of prior knowledge and situational interest.
Psychonomic Bulletin and Review.
842-848.
2016
-
On the Influence of an Iterative Affect Annotation Approach on Inter-Observer and Self-Observer Reliability.
IEEE Transactions on Affective Computing.
136-149.
2016
-
Automatic gaze-based user-independent detection of mind wandering during computerized reading.
User Modeling and User-Adapted Interaction.
33-68.
2016
-
Predicting Individual Action Switching in Covert and Continuous Interactive Tasks Using the Fluid Events Model.
Frontiers in Psychology.
2016
-
On the influence of re-reading on mind wandering.
Quarterly Journal of Experimental Psychology.
2338-2357.
2016
-
The Impact of Modality on Mind Wandering during Comprehension.
Applied Cognitive Psychology.
29-40.
2016
-
The influence of consequence value and text difficulty on affect, attention, and learning while reading instructional texts.
Learning and Instruction.
9-20.
2015
-
When Technologies Manipulate Our Emotions.
Communications- ACM.
41-42.
2015
-
The fluid events model: Predicting continuous task action change.
Quarterly Journal of Experimental Psychology.
2051-2072.
2015
-
Motion Tracker: Camera-Based Monitoring of Bodily Movements Using Motion Silhouettes (vol 10, e0130293, 2015).
PLoS ONE.
2015
-
Motion Tracker: Camera-Based Monitoring of Bodily Movements Using Motion Silhouettes (vol 10, e0130293, 2015).
PLoS ONE.
2015
-
Modeling how incoming knowledge, persistence, affective states, and in-game progress influence student learning from an educational game.
Computers and Education.
224-235.
2015
-
Data mining and education.
Wiley Interdisciplinary Reviews: Cognitive Science.
333-353.
2015
-
Influencing the occurrence of mind wandering while reading.
Consciousness and Cognition.
52-62.
2015
-
Motion Tracker: Camera-Based Monitoring of Bodily Movements Using Motion Silhouettes.
PLoS ONE.
2015
-
Affect detection from non-stationary physiological data using ensemble classifiers.
Evolving Systems.
79-92.
2015
-
A Review and Meta-Analysis of Multimodal Affect Detection Systems.
ACM Computing Surveys.
2015
-
Interest-based text preference moderates the effect of text difficulty on engagement and learning.
Contemporary Educational Psychology.
98-110.
2015
-
Introduction to the "Best of ACII 2013" Special Section.
IEEE Transactions on Affective Computing.
84-85.
2015
-
Affect Regulation During Learning: The Enhancing Effect of Cognitive Reappraisal.
Applied Cognitive Psychology.
1-19.
2015
-
Boring but Important: A Self-Transcendent Purpose for Learning Fosters Academic Self-Regulation.
Journal of Personality and Social Psychology.
559-580.
2014
-
Boring but important: a self-transcendent purpose for learning fosters academic self-regulation..
Journal of Personality and Social Psychology.
559-580.
2014
-
The Academic Diligence Task (ADT): assessing individual differences in effort on tedious but important schoolwork.
Contemporary Educational Psychology.
314-325.
2014
-
Confusion and its dynamics during device comprehension with breakdown scenarios.
Acta Psychologica.
106-116.
2014
-
On the Validity of the Autobiographical Emotional Memory Task for Emotion Induction.
PLoS ONE.
2014
-
LIDA: A Systems-level Architecture for Cognition, Emotion, and Learning.
IEEE Transactions on Autonomous Mental Development.
19-41.
2014
-
Confusion can be beneficial for learning.
Learning and Instruction.
153-170.
2014
-
Emotions while writing about emotional and non-emotional topics.
Motivation and Emotion.
140-156.
2014
-
A Selective Meta-Analysis on the Relative Incidence of Discrete Affective States During Learning With Technology.
Journal of Educational Psychology.
1082-1099.
2013
-
Unimodal and Multimodal Human Perception of Naturalistic Non-Basic Affective States during Human-Computer Interactions.
IEEE Transactions on Affective Computing.
452-465.
2013
-
Recent Advances in Conversational Intelligent Tutoring Systems.
AI Magazine.
42-54.
2013
-
Individual Differences in Multitasking Ability and Adaptability.
Human Factors.
776-788.
2013
-
Mind wandering while reading easy and difficult texts.
Psychonomic Bulletin and Review.
586-592.
2013
-
Using a false biofeedback methodology to explore relationships between learners' affect, metacognition, and performance.
Contemporary Educational Psychology.
22-39.
2013
-
Frontiers of Affect-Aware Learning Technologies.
IEEE Intelligent Systems.
86-89.
2012
-
Moment-To-Moment Emotions During Reading.
Reading Teacher.
238-242.
2012
-
Language and Discourse Are Powerful Signals of Student Emotions during Tutoring.
IEEE Transactions on Learning Technologies.
304-317.
2012
-
Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals.
IEEE Transactions on Affective Computing.
298-310.
2012
-
Silent reading fluency using underlining: Evidence for an alternative method of assessment.
Psychology in the Schools.
606-618.
2012
-
Confusion and complex learning during interactions with computer learning environments.
Internet and Higher Education.
184-194.
2012
-
Gaze tutor: A gaze-reactive intelligent tutoring system.
International Journal of Human-Computer Studies.
377-398.
2012
-
Dynamics of affective states during complex learning.
Learning and Instruction.
145-157.
2012
-
Disequilibrium in the mind, disharmony in the body.
Cognition and Emotion.
362-374.
2012
-
Computational modeling/cognitive robotics complements functional modeling/experimental psychology.
New Ideas in Psychology.
217-227.
2011
-
Does It Really Matter Whether Students' Contributions Are Spoken Versus Typed in an Intelligent Tutoring System With Natural Language?.
Journal of Experimental Psychology: Applied.
1-17.
2011
-
A cognitive model's view of animal cognition.
Current Zoology.
499-513.
2011
-
The Temporal and Dynamic Nature of Self-Regulatory Processes During Independent and Externally Assisted Hypermedia Learning.
Cognition and Instruction.
471-504.
2011
-
The half-life of cognitive-affective states during complex learning.
Cognition and Emotion.
1299-1308.
2011
-
Transforming Nursing Workflow, Part 1 The Chaotic Nature of Nurse Activities.
JONA: The Journal of Nursing Administration.
366-373.
2010
-
Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features.
User Modeling and User-Adapted Interaction.
147-187.
2010
-
Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive affective states during interactions with three different computer-based learning environments.
International Journal of Human-Computer Studies.
223-241.
2010
-
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications.
IEEE Transactions on Affective Computing.
18-37.
2010
-
Toward Spoken Human-Computer Tutorial Dialogues.
Human-Computer Interaction.
289-323.
2010
-
AUTOMATIC DETECTION OF LEARNER'S AFFECT FROM GROSS BODY LANGUAGE.
Applied Artificial Intelligence.
123-150.
2009
-
Automatic detection of learner's affect from conversational cues.
User Modeling and User-Adapted Interaction.
45-80.
2008
-
Emote aloud during learning with AutoTutor: Applying the facial action coding system to cognitive-affective states during learning.
Cognition and Emotion.
777-788.
2008
-
Toward an affect-sensitive AutoTutor.
IEEE Intelligent Systems.
53-61.
2007
-
A brief behavioral measure of frustration tolerance predicts academic achievement immediately and two years later..
Emotion.
2018