PUBLICATIONS

Refereed Conference Proceedings

Z. Huang, L. Wang, G. Blaney, C. Slaughter, D.T. McKeon, Z. Zhou, R.J.K Jacob, and M.C. Hughes, “The Tufts fNIRS Mental Workload Dataset and Benchmark for Brain-Computer Interfaces that Generalize,” Proc. NeurIPS 2021 Conference on Neural Information Processing Systems, Datasets and Benchmarks Track (2021). [link]

L. Wang, Z. Huang, Z. Zhou, D.T. McKeon, G. Blaney, M.C. Hughes, and R.J.K Jacob, “Taming fNIRS-based BCI Input for Better Calibration and Broader Use,” Proc. ACM UIST 2021 Symposium on User Interface Software and Technology (2021). [link]

A. Kang, L. Wang, Z. Zhou, Z. Huang, and R.J.K Jacob, “Affective Color Fields: Reimagining Rothkoesque Artwork as an Interactive Companion for Artistic Self-Expression,” Proc. ACM Multimedia 2021 Conference, Interactive Arts track. [link] [alternate link]

T. Shibata, A. Borisenko, A. Hakone, T. August, L. Deligiannidis, C.H. Yu, M. Russell, A. Olwal, and R.J.K. Jacob, “An Implicit Dialogue Injection System for Interruption Management,” Proc. Tenth Augmented Human International Conference (2019). [link]

B.F. Yuksel, K.B. Oleson, R. Chang, and R.J.K. Jacob, “Detecting and Adapting to Users' Cognitive and Affective State to Develop Intelligent Musical Interfaces,” in New Directions in Music and Human-Computer Interaction, ed. by S. Holland, T. Mudd, K. Wilkie-McKenna, A. McPherson, and M. Wanderley, Springer (2019). [link]

S.W. Hincks, S. Bratt, S. Poudel, V. Phoha, R.J.K. Jacob, D.C. Dennett, and L.M. Hirshfield, “Entropic Brain-computer Interfaces - Using fNIRS and EEG to Measure Attentional States in a Bayesian Framework,” Proc. PhyCS 2017 International Conference on Physiological Computing Systems (2017). [link]

S.W. Hincks, M. DeBellis, E.Y. Lee, R. ten Brink, B. Moell, and R.J.K. Jacob, “Towards Bidirectional Brain-computer Interfaces that Use fNIRS and tDCS,” Proc. PhyCS 2017 International Conference on Physiological Computing Systems (2017). [link]

T. Shibata, D. Afergan, D. Kong, B.F. Yuksel, I.S. MacKenzie, and R.J.K. Jacob, “DriftBoard: A Panning-Based Text Entry Technique for Ultra-Small Touchscreens,” Proc. ACM UIST 2016 Symposium on User Interface Software and Technology, ACM Press (2016). [link]

B.F. Yuksel, K.B. Oleson, L. Harrison, E.M. Peck, D. Afergan, R. Chang, and R.J.K. Jacob, “Learn Piano with BACh: An Adaptive Learning Interface that Adjusts Task Difficulty based on Brain State,” Proc. ACM CHI 2016 Human Factors in Computing Systems Conference, ACM Press (2016) Best Paper Award. [link]

T. Shibata, D. Afergan, D. Kong, B.F. Yuksel, I.S. MacKenzie, and R.J.K. Jacob, “Text Entry for Ultra-Small Touchscreens Using a Fixed Cursor and Movable Keyboard,” ACM CHI 2016 Human Factors in Computing Systems Conference, ACM Press, Interactivity paper (2016). [link] [alternate link]

S.W. Hincks, D. Afergan, and R.J. Jacob, “Using fNIRS for Realtime Cognitive Workload Assessment,” HCI International 2016 International Conference on Human-Computer Interaction, Springer (2016). [link]

B.F. Yuksel, D. Afergan, E.M. Peck, G. Griffin, L. Harrison, N.W.B. Chen, R. Chang, and R.J.K. Jacob, “BRAAHMS: A Novel Adaptive Musical Interface Based on Users' Cognitive State,” Proc. NIME International Conference on New Interfaces for Musical Expression (2015). [link]

D. Afergan, S.W. Hincks, T. Shibata, and R.J.K. Jacob, “Phylter: A System for Modulating Notifications in Wearables Using Physiological Sensing,” HCI International 2015 International Conference on Human-Computer Interaction (2015) Also published in Foundations of Augmented Cognition, ed. D.D. Schmorrow and C.M. Fidopiastis, Springer, 2015, pp. 167-177. [link]

D. Afergan, T. Shibata, S.W. Hincks, E.M. Peck, B.F. Yuksel, R. Chang, and R.J.K. Jacob, “Brain-Based Target Expansion,” Proc. ACM UIST 2014 Symposium on User Interface Software and Technology, pp. 583-593, ACM Press (2014). [link]

D. Afergan, E.M. Peck, E.T. Solovey, A. Jenkins, S.W. Hincks, E.T. Brown, R. Chang, and R.J.K. Jacob, “Dynamic Difficulty Using Brain Metrics of Workload,” Proc. ACM CHI 2014 Human Factors in Computing Systems Conference, ACM Press (2014) Best Paper Honorable Mention Award. [link]

E.M. Peck, B.F. Yuksel, A. Ottley, R.J.K. Jacob, and R. Chang, “Using fNIRS Brain Sensing to Evaluate Information Visualization Interfaces,” Proc. ACM CHI 2013 Human Factors in Computing Systems Conference, ACM Press (2013). [link]

E.M. Peck, D. Afergan, and R.J.K. Jacob, “Investigation of fNIRS Brain Sensing as Input to Information Filtering Systems,” Proc. Fourth Augmented Human International Conference (2013). [link]

G. Griffin and R. Jacob, “Priming Creativity Through Improvisation on an Adaptive Musical Instrument,” Proc. ACM Conference on Creativity and Cognition, pp. 146-155 (2013). [link] [alternate link]

E.T. Solovey, P. Schermerhorn, M. Scheutz, A. Sassaroli, S. Fantini, and R.J.K. Jacob, “Brainput: Enhancing Interactive Systems with Streaming fNIRS Brain Input,” Proc. ACM CHI 2012 Human Factors in Computing Systems Conference, ACM Press (2012) Best Paper Honorable Mention Award. [link]

E.T. Solovey, F. Lalooses, K. Chauncey, D. Weaver, M. Parasi, M. Scheutz, A. Sassaroli, S. Fantini, P. Schermerhorn, A. Girouard, and R.J.K. Jacob, “Sensing Cognitive Multitasking for a Brain-Based Adaptive User Interface,” Proc. ACM CHI 2011 Human Factors in Computing Systems Conference, ACM Press (2011). [link]

L. Hirshfield, R. Gulotta, S. Hirshfield, S. Hincks, M. Russell, R. Ward, T. Williams, and R. Jacob, “This is Your Brain on Interfaces: Enhancing Usability Testing with Functional Near-Infrared Spectroscopy,” Proc. ACM CHI 2011 Human Factors in Computing Systems Conference, ACM Press (2011). [link]

G.M. Poor and R.J.K. Jacob, “Introducing Animatronics to HCI: Extending Reality-Based Interaction,” HCI International 2011 14th International Conference on Human-Computer Interaction, pp. 593-602, Springer (2011). [link]

E.T. Solovey, A. Girouard, K. Chauncey, L.M. Hirshfield, A. Sassaroli, F. Zheng, S. Fantini, and R.J.K. Jacob, “Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines,” Proc. ACM UIST 2009 Symposium on User Interface Software and Technology, ACM Press (2009). [link]

L.M. Hirshfield, E.T. Solovey, A. Girouard, J. Kebinger, R.J.K. Jacob, A. Sassaroli, and S. Fantini, “Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy,” Proc. ACM CHI 2009 Human Factors in Computing Systems Conference, ACM Press (2009). [link]

M.S. Horn, E.T. Solovey, R.J. Crouser, and R.J.K. Jacob, “Comparing the Use of Tangible and Graphical Programming Languages for Informal Science Education,” Proc. ACM CHI 2009 Human Factors in Computing Systems Conference, ACM Press (2009). [link]

A. Girouard, E.T. Solovey, L.M. Hirshfield, K. Chauncey, A. Sassaroli, S. Fantini, and R.J.K. Jacob, “Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements,” Proc. INTERACT 2009 Conference (2009). [link]

L. Hirshfield, K. Chauncey, R. Gulotta, A. Girouard, E. Solovey, R. Jacob, A. Sassaroli, and S. Fantini, “Combining Electroencephalograph and Near Infrared Spectroscopy to Explore Users' Instantaneous and Continuous Mental Workload States,” HCI International 2009 13th International Conference on Human-Computer Interaction, Springer (2009). [link]

R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum, “Reality-Based Interaction: A Framework for Post-WIMP Interfaces,” Proc. ACM CHI 2008 Human Factors in Computing Systems Conference, pp. 201-210, ACM Press (2008). [link]

M.S. Horn, E.T. Solovey, and R.J.K. Jacob, “Tangible Programming and Informal Science Learning: Making TUIs Work for Museums,” Proc. IDC 2008 Conference on Interaction Design for Children (2008). [link]

A. Bean, S. Siddiqi, A. Chowdhury, B. Whited, O. Shaer, and R.J.K. Jacob, “Marble Track Audio Manipulator: A Tangible User Interface for Music Composition,” Proc. TEI 2008 International Conference on Tangible and Embedded Interaction (2008). [link]

G. Christou, F.E. Ritter, and R.J.K. Jacob, “Modeling Prehensile Actions for the Evaluation of Tangible User Interfaces,” Proc. ITI 2008 30th International Conference on Information Technology Interfaces (2008). [link]

A.J. Afram, J. Briedis, D. Fujiwara, R.J.K. Jacob, C.G.L. Cao, and D. Kahle, “Evaluation of Semantic Fisheye Zooming to Provide Focus+Context,” Proc. 21st Annual Meeting of the Human Factors and Ergonomics Society, pp. 459-463, Baltimore, Md. (2007). [link]

R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M.S. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum, “Reality-Based Interaction: Unifying the New Generation of Interaction Styles,” ACM CHI 2007 Human Factors in Computing Systems Conference, pp. 2465-2470, ACM Press, Work in Progress paper (2007). [link]

M. Horn and R.J.K. Jacob, “Tangible Programming in the Classroom with Tern,” ACM CHI 2007 Human Factors in Computing Systems Conference, pp. 1965-1970, ACM Press, Interactivity paper (2007). [link]

J. Zigelbaum, M. Horn, O. Shaer, and R.J.K. Jacob, “The Tangible Video Editor: Collaborative Video Editing with Active Tokens,” Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 43-46 (2007). [link]

M. Horn and R.J.K. Jacob, “Designing Tangible Programming Languages for Classroom Use,” Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 159-162 (2007). [link]

A. Girouard, E.T. Solovey, L. Hirshfield, S. Ecott, O. Shaer, and R.J.K. Jacob, “Smart Blocks: A Tangible Mathematical Manipulative,” Proc. TEI 2007 First International Conference on Tangible and Embedded Interaction, pp. 183-186 (2007). [link]

M.S. Horn and R.J.K. Jacob, “Tangible Programming in the Classroom: A Practical Approach,” ACM CHI 2006 Human Factors in Computing Systems Conference, pp. 869-874, ACM Press, Work in Progress paper (2006). [link]

L. Deligiannidis and R.J.K. Jacob, “The VR Scooter: Wind and Tactile Feedback Improve User Performance,” IEEE VR 2006 Symposium on 3D User Interfaces (2006). [link]

L. Deligiannidis and R.J.K. Jacob, “An Immersive Environment for the Vase Museum,” HCI'05 International Conference on Human-Computer Interaction, 2005 World Congress in Applied Computing (2005). [link]

L. Deligiannidis and R.J.K. Jacob, “The London Walkthrough in an Immersive Digital Library Environment,” MSV'05 International Conference on Modeling, Simulation and Visualization Methods, 2005 International MultiConference in Computer Science and Computer Engineering (2005). [link]

E. Bahna and R.J.K. Jacob, “Augmented Reading: Presenting Additional Information Without Penalty,” Proc. ACM CHI 2005 Human Factors in Computing Systems Conference, pp. 1909-1912, ACM Press, Short paper (2005). [link]

G. Christou and R.J.K. Jacob, “Identifiability: A Predictive Quantitative Measure for the Comparison of a Task Designed in Different Interaction Styles,” HCI International 2005 11th International Conference on Human-Computer Interaction, Lawrence Erlbaum (2005). [link]

H.Y. Shiaw, R.J.K. Jacob, and G.R. Crane, “The 3D Vase Museum: A New Approach to Context in a Digital Library,” Proc. JCDL 2004 Joint Conference on Digital Libraries (2004). [link]

E.H. Calvillo-Gamez, N. Leland, O. Shaer, and R.J.K. Jacob, “The TAC Paradigm: Unified Conceptual Framework to Represent Tangible User Interfaces,” CLIHC 2003 Latin American Conference on Human-Computer Interaction (2003). [link]

B. Ullmer, H. Ishii, and R.J.K. Jacob, “Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries,” Proc. INTERACT 2003 Conference (2003). [link]

L. Deligiannidis, A.L. Couch, and R.J.K. Jacob, “Performance Characterization of Distributed Virtual-Reality Applications: A Case Study,” IC'2002 International Conference on Internet Computing, CSREA Press and IEEE Internet Computing Magazine (2002). [link]

R.J.K. Jacob, H. Ishii, G. Pangaro, and J. Patten, “A Tangible Interface for Organizing Information Using a Grid,” Proc. ACM CHI 2002 Human Factors in Computing Systems Conference, pp. 339-346, ACM Press (2002). [link]

A. Chang, S. O'Modhrain, R. Jacob, E. Gunther, and H. Ishii, “ComTouch: Design of a Vibrotactile Communication Device,” Proc. ACM DIS 2002 Designing Interactive Systems Conference, ACM Press (2002). [link]

L. Deligiannidis and R.J.K. Jacob, “DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality,” Proc. IEEE Virtual Reality 2002 Conference, IEEE Computer Society Press (2002). [link]

V. Tanriverdi and R.J.K. Jacob, “VRID: A Design Model and Methodology for Developing Virtual Reality Interfaces,” Proc. ACM VRST 2001 Symposium on Virtual Reality Software and Technology, ACM Press, Banff, Canada (2001). [link]

V. Tanriverdi and R.J.K. Jacob, “Interacting with Eye Movements in Virtual Environments,” Proc. ACM CHI 2000 Human Factors in Computing Systems Conference, pp. 265-272, Addison-Wesley/ACM Press (2000). [link]

L.E. Sibert and R.J.K. Jacob, “Evaluation of Eye Gaze Interaction,” Proc. ACM CHI 2000 Human Factors in Computing Systems Conference, pp. 281-288, Addison-Wesley/ACM Press (2000). [link]

R.J.K. Jacob, “A Visual Language for Non-WIMP User Interfaces,” Proc. IEEE Symposium on Visual Languages, pp. 231-238, IEEE Computer Society Press (1996). [link]

D. Hix, J.N. Templeman, and R.J.K. Jacob, “Pre-Screen Projection: From Concept to Testing of a New Interaction Technique,” Proc. ACM CHI'95 Human Factors in Computing Systems Conference, pp. 226-233, Addison-Wesley/ACM Press (1995). [link]

R.J.K. Jacob and L.E. Sibert, “The Perceptual Structure of Multidimensional Input Device Selection,” Proc. ACM CHI'92 Human Factors in Computing Systems Conference, pp. 211-218, Addison-Wesley/ACM Press (1992). [link]

R.J.K. Jacob, “What You Look At is What You Get: Eye Movement-Based Interaction Techniques,” Proc. ACM CHI'90 Human Factors in Computing Systems Conference, pp. 11-18, Addison-Wesley/ACM Press (1990). [link]

R.J.K. Jacob, “Executable Specifications for a Human-Computer Interface,” Proc. ACM CHI'83 Human Factors in Computing Systems Conference, pp. 28-34 (1983). [link]

R.J.K. Jacob, “Using Formal Specifications in the Design of a Human-Computer Interface,” Proc. ACM Human Factors in Computer Systems Conference, pp. 315-321 (1982). [link]

Journal Articles

J.B. Hollander, A.P. Lynch, L. Lynch, V. Foster, S. Perlo, R.J.K. Jacob, H.A. Taylor, and T.T. Brunye, “Cognitive Responses to Urban Environments: Behavioral Responses in Lab and Field Conditions,” Urban Design International, vol. 26, pp. 256-271 (2021). [link]

A. Girouard, O. Shaer, E.T. Solovey, G.M. Poor, and R.J.K. Jacob, “The Reality of Reality-Based Interaction: Understanding the Impact of a Framework as a Research Tool,” ACM Transactions on Computer-Human Interaction, vol. 26, no. 5 (2019) article no. 35. [link]

A. Bosworth, M. Russell, and R.J.K. Jacob, “Update of fNIRS as an Input to Brain-Computer Interfaces: A Review of Research from the Tufts Human-Computer Interaction Laboratory,” Photonics, vol. 6, no. 3 (2019) article no. 90. [link]

J.B. Hollander, A. Purdy, A. Wiley, V. Foster, R.J.K. Jacob, H.A. Taylor, and T.T. Brunye, “Seeing the city: Using eye-tracking technology to explore cognitive responses to the built environment,” Journal of Urbanism: International Research on Placemaking and Urban Sustainability, vol. 12, no. 2 (2018). [link]

E.M. Peck, E. Carlin, and R. Jacob, “Designing Brain-Computer Interfaces for Attention-Aware Systems,” IEEE Computer, vol. 48, no. 10, pp. 34-42 (October 2015). [link]

E.T. Solovey, D. Afergan, E.M. Peck, S.W. Hincks, and R.J.K. Jacob, “Designing Implicit Interfaces for Physiological Computing: Guidelines and Lessons Learned with fNIRS,” ACM Transactions on Computer-Human Interaction, vol. 21, no. 6 (2015) article no. 35. [link]

A. Girouard, E.T. Solovey, and R.J.K. Jacob, “Designing a Passive Brain Computer Interface using Real Time Classification of Functional Near-Infrared Spectroscopy,” International Journal of Autonomous and Adaptive Communications Systems, vol. 6, no. 1, pp. 26-44 (2013).

G. Christou, F.E. Ritter, and R.J.K. Jacob, “CODEIN - A new notation for GOMS to handle evaluations of reality based interaction style interfaces,” International Journal of Human-Computer Interaction, vol. 28, no. 3, pp. 189-201 (2012). [link] [alternate link]

E.M. Peck, E.T. Solovey, K. Chauncey, A. Sassaroli, S. Fantini, R.J.K. Jacob, A. Girouard, and L.M. Hirshfield, “Your Brain, Your Computer, and You,” IEEE Computer, vol. 43, no. 12, pp. 86-89 (December 2010). [link]

O. Shaer and R.J.K. Jacob, “A Specification Paradigm for the Design and Implementation of Tangible User Interfaces,” ACM Transactions on Computer-Human Interaction, vol. 16, no. 4 (2009). [link]

O. Shaer, M.S. Horn, and R.J.K. Jacob, “Tangible User Interface Laboratory: Teaching Tangible Interaction Design in Practice,” Journal of Artificial Intelligence for Engineering Design, Analysis and Manufacturing (AIEDAM), vol. 23, no. 3, pp. 251-261 (Spring 2009). [link]

A. Sassaroli, F. Zheng, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, and S. Fantini, “Discrimination of Mental Workload Levels in Human Subjects with Functional Near-Infrared Spectroscopy,” Journal of Innovative Optical Health Sciences, vol. 1, no. 2, pp. 227-237 (2008). [link]

B. Ullmer, H. Ishii, and R.J.K. Jacob, “Token+Constraint Systems for Tangible Interaction with Digital Information,” ACM Transactions on Computer-Human Interaction, vol. 12, no. 1, pp. 81-118 (March 2005). [link]

L. Deligiannidis and R.J.K. Jacob, “Improving Performance of Virtual Reality Applications Through Parallel Processing,” Journal of Supercomputing, vol. 33, no. 3, pp. 155-173 (September 2005). [link]

O. Shaer, N. Leland, E.H. Calvillo-Gamez, and R.J.K. Jacob, “The TAC Paradigm: Specifying Tangible User Interfaces,” Personal and Ubiquitous Computing, vol. 8, no. 5, pp. 359-369 (Sept. 2004). [link]

R.J.K. Jacob, L. Deligiannidis, and S. Morrison, “A Software Model and Specification Language for Non-WIMP User Interfaces,” ACM Transactions on Computer-Human Interaction, vol. 6, no. 1, pp. 1-46 (March 1999). [link]

R.J.K. Jacob, “Human-Computer Interaction: Input Devices,” ACM Computing Surveys, vol. 28, no. 1, pp. 177-179 (March 1996). [link]

R.J.K. Jacob, L.E. Sibert, D.C. McFarlane, and M.P. Mullen, Jr., “Integrality and Separability of Input Devices,” ACM Transactions on Computer-Human Interaction, vol. 1, no. 1, pp. 3-26 (March 1994). [link]

R.J.K. Jacob, “Eye-gaze Computer Interfaces: What You Look At is What You Get,” IEEE Computer, vol. 26, no. 7, pp. 65-67 (July 1993). [link]

R.J.K. Jacob, J.J. Leggett, B.A. Myers, and R. Pausch, “Interaction Styles and Input/Output Devices,” Behaviour and Information Technology, vol. 12, no. 2, pp. 69-79 (1993). [link]

M. Green and R.J.K. Jacob, “Software Architectures and Metaphors for Non-WIMP User Interfaces,” Computer Graphics, vol. 25, no. 3, pp. 229-235 (July 1991). [link]

R.J.K. Jacob, “The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is What You Get,” ACM Transactions on Information Systems, vol. 9, no. 3, pp. 152-169 (April 1991) Also reprinted with commentary in Readings in Intelligent User Interfaces, ed. M.T. Maybury and W. Wahlster, Morgan Kaufmann, San Francisco, 1998, pp. 65-83. [link]

R.J.K. Jacob and J.N. Froscher, “A Software Engineering Methodology for Rule-based Systems,” IEEE Transactions on Knowledge and Data Engineering, vol. 2, no. 2, pp. 173-189 (June 1990). [link]

R.J.K. Jacob, “A Specification Language for Direct Manipulation User Interfaces,” ACM Transactions on Graphics, vol. 5, no. 4, pp. 283-317 (1986). [link]

R.J.K. Jacob, “A State Transition Diagram Language for Visual Programming,” IEEE Computer, vol. 18, no. 8, pp. 51-59 (1985). [link]

R.J.K. Jacob, “Using Formal Specifications in the Design of a Human-Computer Interface,” Communications of the ACM, vol. 26, no. 4, pp. 259-264 (1983) Also reprinted in Software Specification Techniques, ed. N. Gehani and A.D. McGettrick, Addison-Wesley, Reading, Mass., 1986, pp. 209-222. [link]

R.J.K. Jacob, H.E. Egeth, and W. Bevan, “The Face as a Data Display,” Human Factors, vol. 18, pp. 189-199 (1976). [link]

Other Published Proceedings

E. Harvey, L. Wang, and R.J.K Jacob, “Improving fNIRS-based BCIs with Convex Optimization for Generalized Classification and Semi-supervised Learning,” Neuroadaptive Technology Conference NAT'22 (2022).

E.Y.J. Lee, B.F. Yuksel, D. Afergan, S.W. Hincks, T. Shibata, E.T. Solovey, A. Jenkins, K.B. Oleson, L. Harrison, E.M. Peck, R. Chang, and R.J.K. Jacob, “Using brain states to enhance user experience,” Fourth Seoul International Conference on Applied Science and Engineering (SICASE 2016), Poster paper (2016).

B.F. Yuksel, E.M. Peck, D. Afergan, S.W. Hincks, T. Shibata, J. Kainerstorfer, K. Tgavalekos, A. Sassaroli, S. Fantini, and R.J.K. Jacob, “Functional near-infrared spectroscopy for adaptive human-computer interfaces,” Proc. SPIE Conference on Optical Tomography and Spectroscopy of Tissue XI (2015). [link]

T. Shibata, E.M. Peck, D. Afergan, S.W. Hincks, B.F. Yuksel, and R.J.K. Jacob, “Building Implicit Interfaces for Wearable Computers with Physiological Inputs: Zero Shutter Camera and Phylter,” Proc. ACM UIST 2014 Symposium on User Interface Software and Technology, pp. 89-90, ACM Press, Poster paper (2014). [link]

E. Peck, E. Solovey, S. Su, R. Jacob, and R. Chang, “Near to the Brain: Functional Near-Infrared Spectroscopy as a Lightweight Brain Imaging Technique for Visualization,” IEEE InfoVis Conference on Information Visualization, Poster presentation (2011) Best Poster Award. [link]

A. Sassaroli, F. Zheng, M. Coutts, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, Y. Tong, B. deB. Frederick, and S. Fantini, “Application of near-infrared spectroscopy for discrimination of mental workloads,” Proc. SPIE Conference, vol. 7174, pp. 71741H 1-7 (2009). [link]

L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, A. Sassaroli, Y. Tong, and S. Fantini, “Human-Computer Interaction and Brain Measurement Using Functional Near-Infrared Spectroscopy,” Proc. ACM UIST 2007 Symposium on User Interface Software and Technology, ACM Press, Poster paper (2007). [link]

G. Christou, R.J.K. Jacob, and P.L. Cheng, “Modeling the Task: Leveraging Knowledge-in-the-Head at Design Time,” Proc. ICEIS 06 8th International Conference on Enterprise Information Systems, pp. 131-134 (2006).

E. Diep and R.J.K. Jacob, “Visualizing E-mail with a Semantically Zoomable Interface,” IEEE InfoVis 2004 Symposium on Information Visualization, Poster paper (2004). [link]

G. Christou and R.J.K. Jacob, “Evaluating and Comparing Interaction Styles,” DSV-IS'03 Eurographics Workshop on Design, Specification, Verification of Interactive Systems, Short paper (2003). [link]

R.J.K. Jacob, “Open Syntax: Improving Access for All Users,” Proc. WUAUC'01 Workshop on Universal Accessibility of Ubiquitous Computing: Providing for the Elderly, pp. 84-89, ACM Press (2001). [link]

R.J.K. Jacob and J.G. Schmolze, “A Human-Computer Interaction Framework for Media-Independent Knowledge,” AAAI Workshop on Representations for Multi-Modal Human-Computer Interaction, pp. 26-30, Position paper, Technical Report WS-98-09, AAAI Press, Menlo Park, Calif. (1998). [link]

S.A. Morrison and R.J.K. Jacob, “A Specification Paradigm for Design and Implementation of Non-WIMP User Interfaces,” ACM CHI'98 Human Factors in Computing Systems Conference, pp. 357-358, Addison-Wesley/ACM Press, Poster paper (1998). [link]

M.A. Perez and R.J.K. Jacob, “A UIMS Architecture for Focus Processing in a Graphical User Interface,” AAAI Symposium on Intelligent Multi-Media Multi-Modal Systems, pp. 87-92, AAAI, Stanford, Calif. (1994). [link]

R.J.K. Jacob, “What You Look At is What You Get: Using Eye Movements as Computer Input,” Proc. Virtual Reality Systems'93 Conference, pp. 164-166, SIG Advanced Applications, New York, N.Y. (1993). [link]

R.J.K. Jacob and J.N. Froscher, “Software Engineering for Rule-based Systems,” Proc. Fall Joint Computer Conference, pp. 185-189, Dallas, Tex. (1986). [link]

R.J.K. Jacob, “Direct Manipulation,” Proc. IEEE Conference on Systems, Man, and Cybernetics, pp. 384-388, Atlanta, Ga. (1986). [link]

J.N. Froscher and R.J.K. Jacob, “Designing Expert Systems for Ease of Change,” Proc. IEEE Symposium on Expert Systems in Government, pp. 246-251, Washington, D.C. (1985). [link]

R.J.K. Jacob and J.N. Froscher, “Developing a Software Engineering Methodology for Rule-based Systems,” Proc. 1985 Conference on Intelligent Systems and Machines, pp. 179-183, Oakland University (1985). [link]

M.R. Cornwell and R.J.K. Jacob, “Structure of a Rapid Prototype Secure Military Message System,” Seventh DOD/NBS Computer Security Conference, pp. 48-57, Gaithersburg, Md. (1984). [link]

R.J.K. Jacob, “User-Level Window Managers for UNIX,” Proc. UniForum International Conference on UNIX, pp. 123-133 (1984). [link]

R.J.K. Jacob, “Symbols for the Display of Multivariate Data: The Face,” Proceedings of the First General Conference on Social Graphics, Leesburg, Va. (1978) Census Bureau Technical Paper No. 49. [link]

Book Chapters

E.M. Peck, D. Afergan, B.F. Yuksel, F. Lalooses, and R.J.K. Jacob, “Using fNIRS to Measure Mental Workload in the Real World,” in Advances in Physiological Computing, ed. by S.H. Fairclough and K. Gilleade, pp. 117-139, Springer (2014). [link]

K. Hinckley, R.J.K. Jacob, C. Ware, J.O. Wobbrock, and D. Wigdor, “Input/output Devices and Interaction Techniques,” in Computing Handbook, Third Edition, ed. by T. Gonzalez, J. Diaz-Herrera, and A. Tucker, Chapman and Hall/CRC Press (2014).

A. Girouard, E. Solovey, L. Hirshfield, E. Peck, K. Chauncey, A. Sassaroli, S. Fantini, and R. Jacob, “From Brain Signals to Adaptive Interfaces: Using fNIRS in HCI,” in Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction, ed. by D.S. Tan and A. Nijholt, pp. 221-237, Springer (2010). [link]

K. Hinckley, R.J.K. Jacob, and C. Ware, “Input/output Devices and Interaction Techniques,” in The Computer Science Handbook, Second Edition, ed. by A.B. Tucker, pp. 20.1-20.32, Chapman and Hall/CRC Press (2004). [link]

R.J.K. Jacob and K.S. Karn, “Eye Tracking in Human-Computer Interaction and Usability Research: Ready to Deliver the Promises (Section Commentary),” in The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, ed. by J. Hyona, R. Radach, and H. Deubel, pp. 573-605, Amsterdam, Elsevier Science (2003). [link]

R.J.K. Jacob, “Input Devices and Techniques,” in The Computer Science and Engineering Handbook, ed. by A.B. Tucker, pp. 1494-1511, CRC Press (1996). [link]

R.J.K. Jacob, “Eye Tracking in Advanced Interface Design,” in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. Furness, pp. 258-288, Oxford University Press, New York (1995). [link]

R.J.K. Jacob, “Natural Dialogue in Modes other than Natural Language,” in Dialogue and Instruction, ed. by R.-J. Beun, M. Baker, and M. Reiner, pp. 289-301, Springer-Verlag, Berlin (1995). [link]

R.J.K. Jacob, “New Human-Computer Interaction Techniques,” in Human-Machine Communication for Educational Systems Design, ed. by M.D. Brouwer-Janse and T.L. Harrington, pp. 131-138, Springer-Verlag, Berlin (1994). [link]

R.J.K. Jacob, “Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces,” in Advances in Human-Computer Interaction, Vol. 4, ed. by H.R. Hartson and D. Hix, pp. 151-190, Ablex Publishing Co., Norwood, N.J. (1993). [link]

R.J.K. Jacob, “Direct Manipulation in the Intelligent Interface,” in Intelligent Interfaces: Theory, Research, and Design, ed. by P.A. Hancock and M.H. Chignell, pp. 165-212, North-Holland, Amsterdam (1989). [link]

R.J.K. Jacob and J.N. Froscher, “Facilitating Change in Rule-based Systems,” in Expert Systems: The User Interface, ed. by J.A. Hendler, pp. 251-286, Ablex Publishing Co., Norwood, N.J. (1988).

R.J.K. Jacob, “A Visual Programming Environment for Designing User Interfaces,” in Visual Languages, ed. by S.K. Chang, T. Ichikawa, and P.A. Ligomenides, pp. 87-107, Plenum Press, New York (1986).

R.J.K. Jacob, “An Executable Specification Technique for Describing Human-Computer Interaction,” in Advances in Human-Computer Interaction, Vol. 1, ed. by H.R. Hartson, pp. 211-242, Ablex Publishing Co., Norwood, N.J. (1985). [link]

R.J.K. Jacob, “Designing a Human-Computer Interface with Software Specification Techniques,” in Empirical Foundations of Information and Software Science, ed. by J.C. Agrawal and P. Zunde, pp. 139-156, Plenum Press, New York (1985). [link]

R.J.K. Jacob, “Investigating the Space of Chernoff Faces,” in Recent Advances in Statistics: Papers in Honor of Herman Chernoff on his Sixtieth Birthday, ed. by M.H. Rizvi, J.S. Rustagi, and D. Siegmund, pp. 449-468, Academic Press, New York (1983). [link]

R.J.K. Jacob, “Facial Representation of Multivariate Data,” in Graphical Representation of Multivariate Data, ed. by P.C.C. Wang, pp. 143-168, Academic Press, New York (1978). [link]

Books

B. Ullmer, A. Schmidt, E. Hornecker, C. Hummels, R.J.K. Jacob, and E. van den Hoven (Eds.), Proceedings of TEI'07 First International Conference on Tangible and Embedded Interaction (2007).

R.J.K. Jacob, Q. Limbourg, and J. Vanderdonckt (Eds.), Computer-Aided Design of User Interfaces IV, Kluwer Academic Publishers, Dordrecht (2005).

J. Jacko, A. Sears, M. Beaudouin-Lafon, and R.J.K. Jacob (Eds.), Proceedings of ACM CHI 2001 Human Factors in Computing Systems Conference, ACM Press (2001).

Other Publications

A. Girouard, R.J.K. Jacob, O. Shaer, E. Solovey, and M. Poor, “Reflecting on the Impact of HCI Frameworks,” Proc. ACM CHI 2018 Workshop on Rethinking Interaction, ACM Press (2018). [link]

A. Nijholt, M. Andujar, G. Leslie, R.J.K. Jacob, and B.F. Yuksel, “Brain-Computer Interfaces for Artistic Expression,” Proc. ACM CHI 2018 Human Factors in Computing Systems Conference Extended Abstracts, ACM Press, Workshop abstract (2018). [link]

R. Jacob and S. Stellmach, “What you look at is what you get: gaze-based user interfaces,” interactions, vol. 23, no. 5, pp. 62-65 (September 2016). [link]

B.F. Yuksel, K.B. Oleson, R. Chang, and R.J.K. Jacob, “Measuring Users' Cognitive and Affective State to Develop Intelligent Musical Interfaces,” Proc. ACM CHI 2016 Workshop on Music and HCI (HCIMUSIC) (2016). [link]

S. Hincks, D. Afergan, and R.J.K. Jacob, “Methods for Estimating User State from Real-time fNIRS Data,” Proc. ACM CHI 2016 Workshop on Human Centred Machine Learning (2016). [link]

H. Placido da Silva, S. Fairclough, A. Holzinger, R. Jacob, and D. Tan, “Introduction to Special Issue on Physiological Computing for Human-computer Interaction,” ACM Transactions on Computer-Human Interaction, vol. 21, no. 6 (2015) article no. 29.

D. Afergan, E.M. Peck, R. Chang, and R.J.K. Jacob, “Using Passive Input to Adapt Visualization Systems to the Individual,” Proc. ACM CHI 2013 Workshop on Many People, Many Eyes (2013). [link]

D. Afergan, E.T. Solovey, E.M. Peck, A.J. Jenkins, R. Chang, and R.J.K. Jacob, “Dynamic Difficulty using Brain Metrics of Workload for UAV Operators,” 2013 Student Conference, Human Factors and Ergonomics Society, New England Chapter (2013).

A. Nijholt, B.Z. Allison, and R.J.K. Jacob, “Brain-Computer Interaction: Can Multimodality Help?,” Proc. ICMI 13th International Conference on Multimodal Interaction, pp. 35-39 (2011). [link]

E. Peck, K. Chauncey, A. Girouard, R. Gulotta, F. Lalooses, E.T. Solovey, D. Weaver, and R. Jacob, “From Brains to Bytes,” XRDS: Crossroads, The ACM Magazine for Students, vol. 16, no. 4, pp. 42-47 (2010). [link]

A. Girouard, E.T. Solovey, R. Mandryk, D. Tan, L. Nacke, and R.J.K. Jacob, “Brain, Body and Bytes: Psychophysiological User Interaction,” Proc. ACM CHI 2010 Human Factors in Computing Systems Conference Extended Abstracts, pp. 4433-4436, ACM Press, Workshop abstract (2010). [link]

J. Jacobson, C.A. Wingrave, D. Bowman, F. Brooks, R. Jacob, E. Klopfer, J. LaViola, and S. Rizzo, “Reconceptualizing 'Virtual Reality': What is VR?,” Proc. IEEE Virtual Reality 2010 Conference (2010) Panel statement.

A. Sassaroli, F. Zheng, A. Girouard, E.T. Solovey, K. Chauncey, L.M. Hirshfield, E. Peck, R.J.K. Jacob, and S. Fantini, “Application of correlation analysis tools for the classification of mental workloads in functional near-infrared spectroscopy,” BIOMED OSA Topical Meeting, Poster presentation (2010).

O. Shaer, R.J.K. Jacob, M. Green, and K. Luyten, “Introduction to Special Issue on UIDL for Next-generation User Interfaces,” ACM Transactions on Computer-Human Interaction, vol. 16, no. 4 (2009) article no. 16. [link]

m.c. schraefel, P. Andre, R. White, D. Tan, T. Berners-Lee, S. Consolvo, R. Jacob, I. Kohane, C.A. LaDantec, L. Mamykina, G. Marsden, B. Shneiderman, P. Szolovits, and D. Weitzner, “Interacting with eHealth - Towards Grand Challenges for HCI,” Proc. ACM CHI 2009 Human Factors in Computing Systems Conference Extended Abstracts, pp. 3309-3312, ACM Press (2009) Panel statement.

M.S. Horn, M.U. Bers, and R.J.K. Jacob, “Tangible Programming in Education: A Research Approach,” Proc. ACM CHI 2009 Workshop on Tangibles for Children (2009). [link]

E.T. Solovey, O. Shaer, A. Girouard, L.M. Hirshfield, M.S. Horn, J. Zigelbaum, and R.J.K. Jacob, “Programming Reality within the Reality-Based Interaction Framework,” Proc. ACM CHI 2009 Workshop on Programming Reality: From Transitive Materials to Organic User Interfaces (2009). [link]

L.M. Hirshfield, E.T. Solovey, A. Girouard, J. Kebinger, M.S. Horn, O. Shaer, J. Zigelbaum, and R.J.K. Jacob, “Using Brain Measurement to Evaluate Reality Based Interactions,” Proc. ACM CHI 2009 Workshop on Challenges in Evaluating Usability and User Experience of Reality-Based Interaction (2009). [link]

M.G. Petersen, L. Hallnas, and R.J.K. Jacob, “Introduction to Special Issue on the Aesthetics of Interaction,” ACM Transactions on Computer-Human Interaction, vol. 15, no. 3 (2008).

E. Hornecker, R.J.K. Jacob, C. Hummels, B. Ullmer, A. Schmidt, E. van den Hoven, and A. Mazalek, “TEI Goes On: Tangible and Embedded Interaction,” IEEE Pervasive Computing, vol. 7, no. 2, pp. 91-96 (April-June 2008). [link]

O. Shaer, R.J.K. Jacob, M. Green, and K. Luyten, “User Interface Description Languages for Next Generation User Interfaces,” ACM CHI 2008 Human Factors in Computing Systems Conference, pp. 3949-3952, ACM Press, Workshop abstract (2008). [link]

A. Sasaroli, Y. Tong, L.M. Hirshfield, A. Girouard, E.T. Solovey, R.J.K. Jacob, and S. Fantini, “Real-time assessment of mental workload with near infrared spectroscopy: potential for human-computer interaction,” BIOMED OSA Topical Meeting, Poster presentation (2008). [link]

A. Girouard, L.M. Hirshfield, E. Solovey, and R.J.K. Jacob, “Using functional Near-Infrared Spectroscopy in HCI: Toward evaluation methods and adaptive interfaces,” Proc. ACM CHI 2008 Workshop on Brain-Computer Interfaces for HCI and Games (2008). [link]

R.J.K. Jacob, A. Girouard, L.M. Hirshfield, M. Horn, O. Shaer, E.T. Solovey, and J. Zigelbaum, “What Is the Next Generation of Human-Computer Interaction?,” interactions, vol. 14, no. 3, pp. 53-58 (May 2007). [link]

M.S. Horn, O. Shaer, A. Girouard, L.M. Hirshfield, E.T. Solovey, J. Zigelbaum, and R.J.K. Jacob, “Putting Tangible User Interfaces in Context: A Unifying Framework for Next Generation HCI,” Proc. ACM CHI 2007 Workshop on Tangible User Interfaces in Context and Theory (2007). [link]

O. Shaer and R.J.K. Jacob, “A Visual Language for Programming Reality-Based Interaction,” 2006 IEEE Symposium on Visual Languages and Human-Centric Computing, Graduate Student Consortium (2006). [link]

R.J.K. Jacob, “What is the Next Generation of Human-Computer Interaction?,” ACM CHI 2006 Human Factors in Computing Systems Conference, ACM Press, Workshop abstract (2006). [link]

R.J.K. Jacob and Y. Guiard, “What you look at is what you get: Eye movement-based object selection,” in The Interaction Museum, ed. by M. Beaudouin-Lafon and W. Mackay (2005). [link]

O. Shaer and R.J.K. Jacob, “Toward a Software Model and a Specification Language for Next-Generation User Interfaces,” Proc. ACM CHI 2005 Workshop on The Future of User Interface Software Tools (2005). [link]

N. Leland, O. Shaer, and R.J.K. Jacob, “TUIMS: Laying the Foundations for a Tangible User Interface Management System,” Pervasive 2004 Conference Workshop on Toolkit Support for Interaction in the Physical World (2004). [link]

R.J.K. Jacob, “The SIGCHI Budget for Dummies Or, What Happened to the Coffee Breaks at CHI 2002?,” ACM SIGCHI Bulletin, p. 13 (July/August 2002). [link]

R.J.K. Jacob, “Computers in Human-Computer Interaction (Section Introduction),” in The Human-Computer Interaction Handbook, ed. by J.A. Jacko and A. Sears, pp. 147-149, Lawrence Erlbaum, Mahwah, N.J. (2002). [link]

L. Leventhal, M. Zajicek, R. Heller, J. Jorge, K. Coleman, R. Jacob, P. Branco, D. Novick, J. Abascal, and E. Mynatt, “When I'm Sixty-Four...: Are there Real Strategies for Providing Universal Accessibility for the Elderly?,” Proc. ACM CHI 2002 Human Factors in Computing Systems Conference Extended Abstracts, pp. 694-695, ACM Press (2002) Panel statement. [link]

R.J.K. Jacob, “User Interface,” in Encyclopedia of Computer Science, Fourth Edition, ed. by A. Ralston, E.D. Reilly, and D. Hemmendinger, pp. 1821-1826, Nature Publishing Group, London (2000). [link]

R.J.K. Jacob, S.K. Feiner, J.D. Foley, J.D. Mackinlay, and D.R. Olsen, “UIST'007: Where Will We Be Ten Years From Now?,” Proc. ACM UIST'97 Symposium on User Interface Software and Technology, pp. 115-118, Addison-Wesley/ACM Press, Banff, Canada (1997) Panel statement. [link]

R.J.K. Jacob, “The Future of Input Devices,” ACM Computing Surveys, vol. 28A (Annex) (December 1996) (ACM electronic publication incorporated into December 1996 issue of ACM Computing Surveys at www.acm.org). [link]

J. Durbin, R. Jacob, and K. Hinckley, “Laying the Foundation for the Information Super Highway: Human-Computer Interaction Research,” SIGCHI Bulletin, vol. 26, no. 4, pp. 56-58 (1994). [link]

R.J.K. Jacob, “Human-computer Interaction,” in Encyclopedia of Artificial Intelligence, Second Edition, ed. by S.C. Shapiro, pp. 618-625, John Wiley, New York (1992).

R.J.K. Jacob, “Envisioning Information, by E.R. Tufte (Book review),” Color Research and Application, vol. 16, no. 4, pp. 283-284 (August 1991).

R.J.K. Jacob, “Human-computer Interaction,” in Encyclopedia of Artificial Intelligence, ed. by S.C. Shapiro, pp. 383-388, John Wiley, New York (1987).

R.J.K. Jacob, “Comment on Representing Points in Many Dimensions by Trees and Castles,” Journal of the American Statistical Association, vol. 76, pp. 270-272 (1981). [link]

R.J.K. Jacob, “Letter to the Editor (Technical Correspondence),” The American Statistician, vol. 34, p. 252 (1980). [link]

R.J.K. Jacob, “Tic Tac Toe (programmable calculator program),” in PPX-52 Software Catalog, Texas Instruments, Dallas (1977).

Technical Reports

B.F. Yuksel, D. Afergan, E.M. Peck, G. Griffin, L. Harrison, N.W.B. Chen, R. Chang, and R.J.K. Jacob, “Implicit Brain-Computer Interaction Applied to a Novel Adaptive Musical Interface,” Technical Report 2015-01, Department of Computer Science, Tufts University, Medford, Mass. (2015). [link]

A. Girouard, E.T. Solovey, L.M. Hirshfield, K. Chauncey, A. Sassaroli, S. Fantini, and R.J.K. Jacob, “Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements,” Technical Report 2008-3, Department of Computer Science, Tufts University, Medford, Mass. (2008). [link]

O. Shaer, R.J.K. Jacob, M. Green, and K. Luyten, “User Interface Description Languages for Next Generation User Interfaces,” Technical Report 2008-2, Department of Computer Science, Tufts University, Medford, Mass. (2008). [link]

R.J.K. Jacob, “CHI 2006 Workshop Proceedings: What is the Next Generation of Human-Computer Interaction?,” Technical Report 2006-3, Department of Computer Science, Tufts University, Medford, Mass. (2006). [link]

J. Zigelbaum, M. Horn, O. Shaer, and R.J.K. Jacob, “Tangible Video Editor: Designing for Collaboration, Exploration, and Engagement,” Technical Report 2005-9, Department of Computer Science, Tufts University, Medford, Mass. (2005). [link]

O. Shaer and R.J.K. Jacob, “TUIMS: Laying the Foundations for a Tangible User Interface Management System,” Technical Report 2005-2, Department of Computer Science, Tufts University, Medford, Mass. (2005). [link]

E. Bahna and R.J.K. Jacob, “Augmented Reading: An Experimental Study on Presenting Additional Information Without Penalty,” Technical Report 2005-1, Department of Computer Science, Tufts University, Medford, Mass. (2005). [link]

R.J.K. Jacob, H.Y. Shiaw, and G.R. Crane, “New Human-computer Interaction Techniques for the Digital Library,” Technical Report 2001-1, Department of Computer Science, Tufts University, Medford, Mass. (Jan 9, 2001). [link]

L.E. Sibert, J.N. Templeman, and R.J.K. Jacob, “Evaluation and Analysis of Eye Gaze Interaction,” NRL Report NRL/FR/5513--01-9990, Naval Research Laboratory, Washington, D.C. (2001). [link]

R.J.K. Jacob (Ed.), “Interactive Systems Grantees Workshop Proceedings,” , Tufts University/National Science Foundation (Nov. 10, 1995). [link]

L.A. Dievendorf, Jr., D.P. Brock, Jr., and R.J.K. Jacob, “Extending the User Action Notation (UAN) for Specifying Interfaces with Multiple Input Devices and Parallel Path Structure,” Report NRL/FR/5510-95-9777, Naval Research Laboratory, Washington, D.C. (May 12, 1995).

J.N. Templeman, D. Hix, and R.J.K. Jacob, “A Software Architecture for Adding New Interaction Techniques to a Command and Control Based Testbed,” Memorandum Report NRL/MR/5530-94-7464, Naval Research Laboratory, Washington, D.C. (1994).

R.J.K. Jacob and J.N. Froscher, “Developing a Software Engineering Methodology for Knowledge-based Systems,” NRL Report 9019, Naval Research Laboratory, Washington, D.C. (1987).

R.J.K. Jacob, “Survey and Examples of Specification Techniques for User-Computer Interfaces,” NRL Report 8948, Naval Research Laboratory, Washington, D.C. (1986). [link]

B.T. Tretick, M.R. Cornwell, C.E. Landwehr, R.J.K. Jacob, and J.M. Tschohl, “User's Manual for the Secure Military Message System M2 Prototype,” Memorandum Report 5757, Naval Research Laboratory, Washington, D.C. (1986).

R.J.K. Jacob, “Installing and Using the User Interface Specification Tools,” Naval Research Laboratory, Washington, D.C. (1984).

R.J.K. Jacob, “Formal Specification of the User Interface of a Receive-only Secure Military Message System Prototype,” Naval Research Laboratory Technical Memorandum 7590-203:RJ:rj (11 August 1983).

R.J.K. Jacob, “A Window Manager for Unix,” Computer Science and Systems Branch, Naval Research Laboratory (1982).

R.J.K. Jacob, “Examples of Specifications of User Interfaces,” Naval Research Laboratory Technical Memorandum 7590-008:RJ:rj (6 January 1982).

R.J.K. Jacob, “Survey of Specification Techniques for User Interfaces,” Naval Research Laboratory Technical Memorandum 7590-303:RJ:rj (21 August 1981).

R.J.K. Jacob, “Computer-produced Faces as an Iconic Display for Complex Data,” Doctoral dissertation, Johns Hopkins University (1976) University Microfilms Inc. Order No. 76-22926.

R.J.K. Jacob, H.E. Egeth, and W. Bevan, “The Face as a Data Display,” Technical Report No. 79, Department of Psychology, Johns Hopkins University (1975).

Patents

T. Shibata, R.J.K. Jacob, D. Afergan, and D. Kong, “Drifting Keyboard,” U.S. Patent 10,254,900 (April 9, 2019). [link]

Research or comments also reported in the following:

B. Shneiderman, Encounters with HCI Pioneers: A Personal History and Photo Journal, Morgan and Claypool (2019).

C. Wolf, “Computer an Grosshirn,” MIT Technology Review (German edition), pp. 48-49 (June 2018).

E. Shein, “Overcoming Disabilities,” Communications of the ACM (November 2017). [link]

R. Metz, “Mind-Controlled VR Game Really Works,” MIT Technology Review (August 9, 2017). [link]

“Brain Sensors for Better Learning,” ACM SIGCHI TechNews (March 7, 2017).

A. Nowogrodzki, “Maestro: A new artificial intelligence system designed at tufts has made it faster and easier to learn to play the piano. Is it the future of education?,” Tufts Magazine (Fall 2016). [link]

L. Serfaty, “Hyperconnectes, le Cerveau en Surcharge [Brain Overload],” ARTE TV (3 September 2016) Documentary film by Laurence Serfaty, broadcast on ARTE TV. [link]

A. DeNisco, “MIT and Microsoft create tattoos that turn your skin into a UI for your phone,” TechRepublic (August 15, 2016). [link]

Y. Tai, “The Wintrust Business Lunch: Andrea Hanis, Beste Yuksel, Ian Sherr, and Jennifer Matsuzawa,” WGN Radio (March 1, 2016). [link]

J. Hullinger, “This Brain-Reading Tool Can Teach You A New Skill In No Time,” Fast Company (February 25, 2016). [link]

A. Nowogrodzki, “Mind-reading tech helps beginners quickly learn to play Bach,” New Scientist (9 February 2016). [link]

G. Jacucci, S. Fairclough, E.T. Solovey, and R. Jacob, “Interview: IEEE Computer Special Issue on Physiological Computing,” IEEE Computer, vol. 48, no. 10 (October 2015) Web audio feature. [link]

“Software checks if your brain is busy before it interrupts you,” New Scientist (5 August 2015). [link]

A. Ossola, “Brain-scanning software blocks your notifications while you re busy,” Popular Science (August 6, 2015). [link]

M. Plenke, “This amazing new software reads your brain to tune out all your digital distractions,” mic.com (August 6, 2015). [link]

J. Strickland, “Are Notifications Ruining Your Life?,” Tech News 2Night, no. 412 (27 August 2015). [link]

“Tufts Researchers Develop Mind-Reading Headband,” ACM TechNews (June 14, 2014). [link]

C. Borchers, “Headband could help brain communicate with computers,” Boston Globe, p. B5 (March 3, 2014). [link]

R. Vaidyanathan, “The headband that measures boredom,” BBC News (May 27, 2014). [link]

A. Brooks, “Tufts Researchers Develop Mind-Reading Headband,” WBUR Radio Boston (May 16, 2014). [link]

“Full Frame Essay: Brain Power,” CCTV America Television (May 14, 2014). [link]

W. Pavia, “Warning: your brain is overheating,” The Times (London) (March 5, 2014). [link]

“New headband can detect when your brain is overloaded,” New York Post (March 4, 2014). [link]

M. Blanding, “A Load Off Your Mind,” Tufts Now (online) (February 4, 2014) Video by Steffan Hacker. [link]

C. Gueidan, “Optimiser sa Charge Mentale,” Le Monde de L'Intelligence, no. 30, pp. 64-69 (April 2013). [link]

H. Hodson, “Mind-reading Light Helps You Stay in the Zone,” New Scientist, vol. 2948 (December 17, 2013). [link]

H. Hodson, “Brain-Scanning Headset Monitors Your Mental Workload,” New Scientist, vol. 2905, pp. 19-20 (February 20, 2013). [link]

E. Niiler, “Brain Scanner Customizes Web Surfing for You,” Discovery News (February 28, 2013). [link]

“Brain-Scanning Headset Monitors Your Mental Workload,” ACM TechNews (February 22, 2013). [link]

A. Bleicher, “Rise of the Eye Phones,” IEEE Spectrum, p. 9 (May 2013). [link]

B. Bosker, “Meet The iPad 13: Imagining The iPad, Decades From Now,” Huffington Post (March 8, 2012). [link]

P. Nowak, “CES: Death of the TV remote control,” New Scientist blog (January 9, 2012). [link]

R.J.K. Jacob, “The Legacy of Steve Jobs,” Tufts Now (online) (October 6, 2011). [link]

A. Eisenberg, “Remote Control, With a Wave of a Hand,” New York Times, p. BU3 (Sept 11, 2011).

L. Sandhana, “The robot that reads your mind to train itself,” BBC Online (Oct 24, 2010). [link]

K. Grifantini, “Eye Tracking for Mobile Control,” MIT Technology Review (May 24, 2010). [link]

K. Greene, “Mixing Real and Virtual Controls,” MIT Technology Review (March 9, 2009). [link]

G. Anthes, “Give your computer the finger: Touch-screen tech comes of age,” Computerworld (February 1, 2008). [link] [alternate link]

P.A. Monteiro, “The Changing Face of Human-Computer Interaction,” i.t. Magazine, pp. 71-74 (January 2008).

K. Greene, “An Alternative to the Computer Mouse,” MIT Technology Review (March 2, 2007). [link]

Technology Research News (September 4, 2002 and July 10, 2002). [link]

P. Doyle, “Computers as Humans,” Graduating Engineer, pp. 40-43 (April 1997).

V. Spedding, “Eyes to Control PC Operations,” Scientific Computing World, p. 11 (October 1996).

A. Joch, “What Pupils Teach Computers,” Byte, pp. 99-100 (July 1996).

C. Joslin, “Move Eyes to Command Computer,” Inside R and D, vol. 25, no. 29, p. 2, Technical Insights, Inc., Fort Lee, N.J. (July 17, 1996).

Signal, pp. 18-19 (July 1993).

NRL Labstracts, vol. 28, p. 1 (July 16, 1990).

N.C. Shu, Visual Programming, Van Nostrand Reinhold, New York (1988).

B. Shneiderman, Designing the User Interface: Strategies for Effective Human-Computer Interaction, Addison-Wesley, Reading, Mass. (1987).

Science News, vol. 128, pp. 108-109 (August 17, 1985).

NRL Labstracts, vol. 19, p. 2 (Feb. 9, 1979).

America Illustrated (USIA publication in Russian), p. 13 (August, 1975).

W.H. Huggins and D.R. Entwisle, Iconic Communication, Johns Hopkins Press, Baltimore (1974).

Computer Medicine, vol. 4, p. 5 (October, 1974).

J. Rousuck, “Computer Faces that Talk,” The Sun Magazine, Baltimore (August 25, 1974).

Johns Hopkins Journal, vol. 8, p. 3 (Spring, 1974).