Computer Science 250-HCI
Some Initial Readings and Topics

Examples of Implicit and other Next Generation User Interfaces (from Tufts HCI group)

• E.M. Peck, E. Carlin, and R. Jacob, "Designing Brain-Computer Interfaces for Attention-Aware Systems," IEEE Computer, vol. 48, no. 10, pp. 34-42 (October 2015). [link]
• D. Afergan, T. Shibata, S.W. Hincks, E.M. Peck, B.F. Yuksel, R. Chang, and R. Jacob, "Brain-Based Target Expansion," Proc. ACM UIST 2014 Symposium on User Interface Software and Technology, pp. 583-593, ACM Press (2014). [link]
• D. Afergan, E.M. Peck, E.T. Solovey, A. Jenkins, S.W. Hincks, E.T. Brown, R. Chang, and R. Jacob, "Dynamic Difficulty Using Brain Metrics of Workload," Proc. ACM CHI 2014 Human Factors in Computing Systems Conference, ACM Press (2014) Best Paper Honorable Mention Award. [link]
• And/or others listed here

Examples of Implicit and other Next Generation User Interfaces (others)

• Anind K. Dey, Gregory D. Abowd, and Andrew Wood. 1998. CyberDesk: a framework for providing self-integrating context-aware services. In Proceedings of the 3rd international conference on Intelligent user interfaces (IUI '98). ACM, New York, NY, USA, 47-54. [link] (context-aware)
• Daniel Chen and Roel Vertegaal. 2004. Using mental load for managing interruptions in physiologically attentive user interfaces. In Proc. CHI EA '04. ACM, 1513-1516. [link] (An implementation of attentive UI)
• Gabor Aranyi, Fred Charles, and Marc Cavazza. 2015. Anger-based BCI Using fNIRS Neurofeedback. In Proc. UIST '15. ACM, 511-521. [link] (BCI, somewhere between direct- and passive-BCI)
• Hiroshi Ishii and Brygg Ullmer. 1997. Tangible bits: towards seamless interfaces between people, bits and atoms. In Proc. CHI '97. ACM, 234-241. [link] (Tangible User Interface concept)
• Chris Harrison, Desney Tan, and Dan Morris. 2011. Skinput: appropriating the skin as an interactive canvas. Commun. ACM 54, 8 (August 2011), 111-118. [link] (Skin surface for input)
• Krzysztof Z. Gajos, Katherine Everitt, Desney S. Tan, Mary Czerwinski, and Daniel S. Weld. 2008. Predictability and accuracy in adaptive user interfaces. In Proc. CHI '08. ACM, , 1271-1274. [link] (An implementation of adaptive UI (GUI) based on command history (direct input))
• Eric Horvitz, Carl Kadie, Tim Paek, and David Hovel. 2003. Models of attention in computing and communication: from principles to applications. Commun. ACM 46, 3 (March 2003), 52-59. [link] (Model of attention)
• Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proc. CHI '99. ACM, 159-166. [link] (Describing computer- and user- initiated action)

Languages and Tools for User Interface Software

• Robert J. K. Jacob, Leonidas Deligiannidis, and Stephen Morrison. 1999. A software model and specification language for non-WIMP user interfaces. ACM Trans. Comput.-Hum. Interact. 6, 1 (March 1999), 1-46. [link] [link]
• O. Shaer and R. Jacob, "A Specification Paradigm for the Design and Implementation of Tangible User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 16, no. 4 (2009). [link] [link] (TUIML)
• Orit Shaer, and Robert J. K. Jacob. 2006. A Visual Language for Programming Reality-Based Interaction. In Proc. VL/HCC'06, Brighton, 244-245. [link] [link]
• Orit Shaer, and Robert J. K. Jacob. 2005. Toward a software model and a specification language for next-generation user interfaces. In ACM CHI 2005 Workshop: The Future of User Interface Design Tools. [link]
• Kris Luyten, Marc Abrams, Jean Vanderdonckt, and Quentin Limbourg. 2004. Developing user interfaces with XML: advances on user interface description languages. In Advanced Visual Interfaces (Vol. 2004, pp. 25-28). [link]
• D.R. Olsen, Propositional production systems for dialog description. CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 57-64, 1990. [link]

• Dan R. Olsen, Jr. and Scott R. Klemmer. 2005. The future of user interface design tools. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 2134-2135. [link] [link]
• O. Shaer, R. Jacob, M. Green, and K. Luyten, "Introduction to Special Issue on UIDL for Next-generation User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 16, no. 4 (2009). [link]
• R. Jacob, L. Deligiannidis, and S. Morrison, "A Software Model and Specification Language for Non-WIMP User Interfaces," ACM Transactions on Computer-Human Interaction, vol. 6, no. 1, pp. 1-46 (March 1999). [link] [link]
• R. Jacob, "A Specification Language for Direct Manipulation User Interfaces," ACM Transactions on Graphics, vol. 5, no. 4, pp. 283-317 (1986). [link] [link]
• R. Jacob, "A State Transition Diagram Language for Visual Programming," IEEE Computer, vol. 18, no. 8, pp. 51-59 (1985). [link]
• R. Jacob, "Executable Specifications for a Human-Computer Interface," Proc. ACM CHI'83 Human Factors in Computing Systems Conference, pp. 28-34 (1983). [link] [link]
• R. Jacob, "Using Formal Specifications in the Design of a Human-Computer Interface," Proc. ACM Human Factors in Computer Systems Conference, pp. 315-321 (1982). [link]
• D. R. Olsen and Bradley W. Halversen. 1988. "Interface usage measurements in a user interface management system" In Proceedings of the 1st annual ACM SIGGRAPH symposium on User Interface Software (UIST '88). ACM, New York, NY, USA, 102-108. [link] (early UIMS)
• D.R. Olsen and E.P. Dempsey, "SYNGRAPH: A Graphical User Interface Generator," Computer Graphics, vol. 17, no. 3, pp. 42-50 (1983). [link] (BNF, BNF-based UIMS)
• P. Reisner, "Formal Grammar and Human Factors Design of an Interactive Graphics System," IEEE Transactions on Software Engineering, vol. SE-7, no. 2, pp. 229-240 (1981). [link] (Predict user performance from BNF UIDL and experimentally verify)
• W.M. Newman, "A System for Interactive Graphical Programming," Proc. Spring Joint Computer Conference, pp. 47-54, AFIPS (1968). [link] (STATE TRANSITION DIAGRAMS AND VARIANTS, The Reaction Handler, first UIMS, based on state diagrams)
• B.A. Myers, "A New Model for Handling Input," ACM Transactions on Information Systems, vol. 8, no. 3, pp. 289-320 (1990). [link] (Generalized input handler based on state diagram)
• D. Harel, "On Visual Formalisms," Comm. ACM, vol. 31, no. 5, pp. 514-530 (May 1988). [link] (Statechart, adds useful features to state diagram)
• A.I. Wasserman and D.T. Shewmake, "The Role of Prototypes in the User Software Engineering (USE) Methodology," in Advances in Human-Computer Interaction, Vol. 1, ed. by H.R. Hartson, pp. 191-209, Ablex Publishing Co., Norwood, N.J. (1985). (Software prototyping methodology)
• J.D. Foley and V.L. Wallace, "The Art of Natural Graphic Man-Machine Conversation," Proceedings of the IEEE, vol. 62, no. 4, pp. 462-471 (1974). [link] (First paper on semantic/syntactic levels)
• D.L. Parnas, "On the Use of Transition Diagrams in the Design of a User Interface for an Interactive Computer System," Proc. 24th National ACM Conference, pp. 379-385 (1969). [link] (Early state diagram use)
• M.A. Flecchia and R.D. Bergeron, "Specifying Complex Dialogs in ALGAE," Proc. ACM CHI+GI'87 Human Factors in Computing Systems Conference, pp. 229-234 (1987). [link] (Event Languages, ALGAE: Simple event language)
• R.D. Hill, "Supporting Concurrency, Communication and Synchronization in Human-Computer Interaction-The Sassafras UIMS," ACM Transactions on Graphics, vol. 5, no. 3, pp. 179-210 (1986). [link] (Concurrent)
• P.J. Hayes, "Executable Interface Definitions using Form-Based Interface Abstractions," in Advances in Human-Computer Interaction, Vol. 1, ed. by H.R. Hartson, pp. 161-189, Ablex Publishing Co., Norwood, N.J. (1985). (DECLARATIVE LANGUAGES, COUSIN: Frame-like language)
• D.R. Olsen, "Mike: The Menu Interaction Kontrol Environment," ACM Transactions on Graphics, vol. 5, no. 4, pp. 318-344 (1986). [link] (MIKE: Declarative description of application data types)
• R.D. Hill, "The Abstraction-Link-View Paradigm: Using Constraints to Connect User Interfaces to Applications," Proc. ACM CHI'92 Human Factors in Computing Systems Conference, pp. 335-342, Addison-Wesley/ACM Press (1992). [link] (CONSTRAINT-BASED)
• S.E. Hudson, "Graphical Specification of Flexible User Interface Displays," Proc. ACM UIST'89 Symposium on User Interface Software and Technology, pp. 105-114, Addison-Wesley/ACM Press, Williamsburg, Va. (1989). [link]
• B.A. Myers, D.A. Giuse, R.B. Dannenberg, B. Vander Zanden, D.S. Kosbie, E. Pervin, A. Mickish, and P. Marchal, "Garnet: Comprehensive Support for Graphical, Highly-Interactive User Interfaces," IEEE Computer, vol. 23, no. 11, pp. 71-85 (November 1990). [link]
• A. Borning and R. Duisberg, "Constraint-Based Tools for Building User Interfaces," ACM Transactions on Graphics, vol. 5, no. 4, pp. 345-374 (1986). [link]
• H.R. Hartson, A.C. Siochi, and D. Hix, "The UAN: a user-oriented representation for direct manipulation interface designs," ACM Transactions on Information Systems, vol. 8, no. 3, pp. 181-203 (July 1990). [link] (USER- AND COMPUTER-ORIENTED UIDLS, User Action Notation)
• T.P. Moran, "The Command Language Grammar: A Representation for the User Interface of Interactive Computer Systems," International Journal of Man-Machine Studies, vol. 15, pp. 3-50 (1981). [link] (Command Language Grammar)
• L. Cardelli, "Building User Interfaces by Direct Manipulation," Proc. ACM SIGGRAPH Symposium on User Interface Software, pp. 152-166, Banff, Canada (1988). [link] (INTERACTIVE EDITOR, Layout editor with graphical representation of constraints)
• K. Bharat and M.H. Brown, "Building Distributed, Multi-User Applications by Direct Manipulation," Proc. ACM UIST'94 Symposium on User Interface Software and Technology, pp. 71-81, Addison-Wesley/ACM Press, Marina del Rey, Calif. (1994). [link] (Direct manipulation editor for multi-user interfaces)
• B.A. Myers and W. Buxton, "Creating Highly-Interactive and Graphical User Interfaces by Demonstration," Computer Graphics, vol. 20, no. 4, pp. 249-258 (1986). [link] (BY DEMONSTRATION, Peridot)
• L. Cardelli and R. Pike, "Squeak: A Language for Communicating with Mice," Computer Graphics, vol. 19, no. 3, pp. 199-204 (1985). [link] (Language for low-level device interactions)
• S. Chatty, "Extending a Graphical Toolkit for Two-Handed Interaction," Proc. ACM UIST'94 Symposium on User Interface Software and Technology, pp. 195-204, Addison-Wesley/ACM Press, Marina del Rey, Calif. (1994). [link] (Toolkit support for two-handed interaction)
• W. Buxton, M.R. Lamb, D. Sherman, and K.C. Smith, "Towards a Comprehensive User Interface Management System," Computer Graphics, vol. 17, no. 3, pp. 35-42 (1983).
• J. Foley, "Transformations on a Formal Specification of User-Computer Interfaces," Computer Graphics, vol. 21, no. 2, pp. 109-113 (April 1987). [link]
• E.A. Bier and S. Freeman, "MMM: A User Interface Architecture for Shared Editors on a Single Screen," Proc. ACM UIST'91 Symposium on User Interface Software and Technology, pp. 79-86, Addison-Wesley/ACM Press, Hilton Head, S.C. (1991). [link] (MULTI-USER INTERFACES, Multi-user interface for editing)
• Kenrick Kin, Bjorn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton: multitouch gestures as regular expressions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2885-2894. [link] (constraint programming, event languages)
• Julia Schwarz, Scott Hudson, Jennifer Mankoff, and Andrew Wilson, "A Framework for Robust and Flexible Handling of Inputs with Uncertainty", Proceedings of the ACM Symposium on User Interface Software and Technology, pp. 47-56, October, 2010. [link]
• Marco Manca and Fabio Paternò. 2016. Customizable dynamic user interface distribution. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS '16). ACM, New York, NY, USA, 27-37. [link]
• CHI 2016 SIG on Usability of programming languages [link] [link] (pointers to precise research on usability of language features)

Notes

You are very welcome to suggest other topics and papers.

See the course home page for how to access the ACM Digital Library and other subscriptions from Tufts.