We are investigating non-invasive methods for picking up additional signals that users naturally give off while using a computer system. If used with care, this additional information can lead to interfaces that respond to changes in the user's state. While humans can perceive visual and auditory cues, we are exploring the potential of using functional near-infrared spectroscopy (fNIRS) to catch signals within the brain that reveal feelings such as frustration or fatigue. This emerging device provides a window into the user's brain activity while remaining portable and non-invasive.
A. Sassaroli, F. Zheng, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, and S. Fantini, “Discrimination of Mental Workload Levels in Human Subjects with Functional Near-Infrared Spectroscopy,” Journal of Innovative Optical Health Sciences (2008) (in press). [link]
A. Sasaroli, Y. Tong, L. H. Hirshfield, A. Girouard, E. T. Solovey, R. J. K. Jacob, S. Fantini, "Real-time assessment of mental workload with near infrared spectroscopy: potential for human-computer interaction", OSA topical meeting, BIOMED BMD14(2008).
A. Girouard, L.M. Hirshfield, E. Solovey, and R.J.K. Jacob, “Using functional Near-Infrared Spectroscopy in HCI: Toward evaluation methods and adaptive interfaces,” Proc. ACM CHI 2008 Workshop on Brain-Computer Interfaces for HCI and Games (2008). [link]
L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, A. Sassaroli, Y. Tong, and S. Fantini , "Human-Computer Interaction and Brain Measurement Using Functional Near-Infrared Spectroscopy," ACM UIST 2007 Symposium on User Interface Software and Technology, ACM Press, Poster paper (2007). [link]
In the News:
"Mind-reading Computers: It may sound like sci-fi, but one day a computer may sense when you’re stressed and tell you to take a break," Tufts Journal Feb. 3, 2008. [link] [pdf]
"Tufts researchers delve into the human brain with cutting-edge 'light imaging' technology," Tufts Daily Oct. 18, 2007. [link] [pdf]
"Mind controls computer," EE Times Oct. 5, 2007. [link] [pdf]
"Computer Can Tell How Hard You're Working," Fox News Oct. 3, 2007. [link] [pdf]
"Mind-Reading Computers," BBC Focus Magazine Oct. 3, 2007. [link] [pdf]
"Building a computer that reads minds," MSNBC Oct. 2, 2007. [link] [pdf]
"Technology Could Enable Computers To 'Read The Minds' Of Users," Science Daily, Oct. 2, 2007. [link] [pdf]
J. C. Keller, "Technology May Bridge Emotion Gap between Humans and Computers," Engineering eNews, (May 2007). [link] [pdf]