Computational sensing, machine learning, and user interface systems for preventive medicine; persuasive user interfaces for motivating behavior change; sensor-enabled mobile health technologies; context-aware ecological momentary assessment; experimental ubiquitous computing; living laboratories; perceptually-based interactive environments for home and educational settings; pattern recognition and dynamic scene understanding; artificial intelligence; health technology and policy.
Massachusetts Institute of Technology, Cambridge, MA
Massachusetts Institute of Technology, Cambridge, MA
University of Pennsylvania, Philadelphia, PA (May 1992)
MIT House_n Consortium, Cambridge, MA
Penn General Robotics and Sensory Perception (GRASP) Laboratory
MIT Principal Investigator, Lead Duke Medical School (NIH U01), "Cellphone Intervention Trial for Young Adults (CITY)." A five-year study to develop and evaluate (in a randomized clinical trial) sensor-enabled mobile phone technology to assist young adults with long-term weight loss and weight management (2009).
Principal Investigator (NIH GEI Opportunity Fund Program), "Encouraging GEI Activity Monitor Adoption: Demonstrating Device Equivalency." A one-year study using custom-designed mechanical shakers and pattern recognition algorithms to demonstrate how phones can be used to produce output nearly equivalent to existing physical activity monitors (2009).
MIT Principal Investigator, Lead USC Medical (Robert Wood Johnson Foundation), "Development of a Time Use Intervention Using Mobile Phones to Promote Physical Activity in Youth." Several projects to explore the use of experience sampling on mobile phones for physical activity data gathering in children and adults (2009).
MIT Principal Investigator, Lead RTI International (NIH NIEHS), "Development of Optimal Monitor Placement and Accelerometer Algorithms for Personal Contaminant Sensor Platforms with a Focus on Children's Activities." A one-year NIH-funded project with RTI International, Stanford School of Medicine, UC San Diego, LDEO/Columbia, and Battelle/PNNL to study the use of accelerometry-based motion monitoring to improve a wearable, personal contaminant sensing in children (2009).
MIT Principal Investigator, Lead RTI International (NIH NIEHS), "Development of Optimal Monitor Placement and Accelerometer Algorithms for Personal Contaminant Sensor Platforms." A one-year NIH-funded project with RTI International, Stanford School of Medicine, UC San Diego, LDEO/Columbia, and Battelle/PNNL to study the use of accelerometry-based motion monitoring to improve a wearable, personal contaminant sensing in adults (2008).
Principal Investigator (NSF), "CRI:CRD Development of Longitudinal Home Activity Datasets as a Shared Resource." A three-year study to develop portable sensor tools that can be used in typical homes to collect data for computer science and health research, as well as to generate shared datasets on home activity from actual homes to be used as a community resource to accelerate research (2007).
Principal Investigator (NIH NHLBI U01), "Enabling Population-Scale Physical Activity Measurement on Common Mobile Phones." A four-year study with Stanford School of Medicine to create novel health monitoring tools for mobile phones. Includes a supplement to develop mobile context-sensitive ecological momentary assessment software for mobile phones ("Extensible Platform for Implementing Experience Sampling on Mobile Phones") (2007).
Investigator (Intel AIM Grant Program), "AIM Proposal: End-User-Driven Training of Activity Recognition Algorithms." A three-year study on the use of in-home context sensing, where end-users drive the algorithm training process, as applied towards proactive
health care (2007).
Investigator, Lead Vanderbilt University (NIH NHLBI), "Physical activity energy expenditure and adolescent obesity." A two-year collaboration where House_n sensors were provided to Vanderbilt researchers for energy expenditure measurement experiments in a room calorimeter (2007).
MIT Principal Investigator, Lead Groden Center (National Alliance for Autism), "Telemetric Assessment of Movement Stereotypy in Children with ASD." A two-year study with the Groden Center, a school for autistic children, and the University of Rhode Island to explore the use of wireless accelerometers for automatic detection of autistic stereotypies (2006). An extension of this project is ongoing.
Principal Investigator (Microsoft Digital Memories (Memex) grant award), "Integration of Memex and PlaceLab Datasets for Personal Investigations of Health and Living Patterns". A one-year study to add Microsoft SenseCam technology to the PlaceLab. The technology has since been added to the BoxLab system used in a current NSF grant (2006).
MIT Principal Investigator, Lead Northeastern University (NIH NLM R21), "Just in Time Health Information for Exercise Adoption." A two-year study with Northeastern University and Harvard University to develop and test a PDA-based system for motivating brisk walking (2005).
MIT Principal Investigator, Lead UNC School of Public Health (Gatorade Seed Funds), "Development of an Objective Measure of Television Watching." A one-year exploratory study with University of North Carolina School of Public Health to adapt a wireless sensor toolkit (MITes) to detect television watching behavior and sedentary activity (2005).
MIT Principal Investigator, Lead Boston Medical Center (NIH NCI R21), "Context-Sensitive Measurement of Physical Activity." A two-year study with Boston Medical Center and Stanford School of Medicine to develop and test sensor technology for measuring physical activity (2004).
Investigator (Intel AIM Grant Program), "AIM Proposal: Detecting Idle Moments for Proactive
Health Activities Using Personal and Environmental Sensors and
Interfaces." A three-year study on context-aware computing for proactive
health care (2003).
Principal Investigator (NSF), "ITR: Detecting Activity in Homes with Ubiquitous Sensing to Support Aging in Place." A two-year study on activity of daily living (ADL) recognition from home sensors (2003).
Faculty Award (IBM). An award to investigate ubiquitous computing technology (2003).
Principal Investigator (NSF), "ITR/PE: Using context-recognition for preventative medicine in the home." A two-year study with Boston Medical Center to develop and test sensors for home activity recognition (2001).
Principal Investigator (Robert Wood Johnson Foundation), "Measuring and Motivating Stair Use in Public Spaces." A one-year study to develop a system to measure and motivate stair use with digital point of decision prompting in a subway station (2002).
Publications and Presentations
Publications in refereed journals
K. Patrick, W. G. Griswold, F. Raab, and S. S. Intille, "Health and the mobile phone," American Journal of Preventive Medicine, 35(2), pp. 177-181, 2008.
P. Kaushik, S. S. Intille, and K. Larson, "User-adaptive reminders for home-based medical tasks. A case study," Methods of Information in Medicine, 47(3), pp. 203-7, 2008.
M.S. Goodwin, W.F. Velicer, and S.S. Intille, "Telemetric monitoring in the behavior sciences," Behavior Research Methods, 40(1), pp. 328-341, 2008.
Beaudin, J.S., S.S. Intille, and M.E. Morris, "To track or not to track: User reaction to concepts in longitudinal health monitoring," Journal of Medical Internet Research, 8(4):e29, 2006.
K. Patrick, S. Intille, and M. Zabinski, "An ecological framework for cancer communication: implications for research," Journal of Medical Internet Research, 7(3):e23, 2005.
S. S. Intille, "A new research challenge: Persuasive technology to motivate healthy aging," Transactions on Information Technology in Biomedicine, 8(3), pp. 235-237, 2004.
S.S. Intille, "Designing a home of the future," IEEE Pervasive Computing, 1(2), pp. 76-82, 2002.
S.S. Intille and A.F. Bobick, "Recognizing planned, multi-person
Vision and Image Understanding, vol. 81(3), pp. 414-445,
A.F. Bobick, S.S. Intille, J.W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y. Ivanov, A. Schütte, and A. Wilson, "The KidsRoom: a perceptually-based interactive immersive story environment," PRESENCE: Teleoperators and Virtual Environments, 8(4), pp. 367-391, 1999.
A.F. Bobick and S.S. Intille, "Large occlusion stereo," International Journal of Computer Vision, 33(3), pp. 181-200, 1999.
Invited publications in refereed journals
K. Larson, S. Intille, T. J. McLeish, J. Beaudin, and R. E. Williams, "Open source building — Reinventing places of living," BT Technology Journal, 22(4), pp. 187-200, 2004.
A.F. Bobick, S.S. Intille, W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y. Ivanov, A. Schütte, and A. Wilson, "Perceptual user interfaces: The KidsRoom," Communications of the ACM, 43(3), pp. 60-61, 2000.
Paper presentations at refereed conferences
F. Albinali, M. S. Goodwin, and S. S. Intille, "Recognizing stereotypical motor movements in the laboratory and classroom: A case study with children on the autism spectrum," in Proceedings of the 11th International Conference on Ubiquitous Computing, New York: ACM Press, 2009, pp. 71-80. Best paper award.M. Gupta, S. S. Intille, and K. Larson, "Adding GPS-control to traditional thermostats: An exploration of potential energy savings and design challenges," in Proceedings of the Seventh International Conference on Pervasive Computing, vol. LNCS 5538, Berlin / Heidelberg: Springer, 2009, pp. 95-114.
P. Kaushik, S. S. Intille, and K. Larson, "Observations from a case study on user adaptive reminders for medication adherence," in Proceedings of the Second International Conference on Pervasive Computing Technologies for Healthcare, IEEE Press, 2008, pp. 250-253.
E. M. Tapia, S. S. Intille, and K. Larson, "Portable wireless sensors for object usage sensing in the home: Challenges and practicalities," in Proceedings of the European Ambient Intelligence Conference, vol. LNCS 4794, Berlin Heidelberg: Springer-Verlag, 2007, pp. 19-37.
E. Munguia Tapia, S. S. Intille, W. Haskell, K. Larson, J. Wright, A. King, and R. Friedman, "Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor" in Proceedings of the 11th IEEE International Symposium on Wearable Computers, IEEE Press, 2007, pp. 37-40.
B. Logan, J. Healey, Matthai Philipose, E. Munguia Tapia, and S. Intille, "A long-term evaluation of sensing modalities for activity recognition," in Proceedings of the International Conference on Ubiquitous Computing, vol. LNCS 4717, Berlin Heidelberg: Springer-Verlag, 2007, pp. 483–500.
J. Nawyn, S. S. Intille, and K. Larson, "Embedding behavior modification strategies into a consumer electronics device: A case study," in Proceedings of UbiComp 2006, vol. LNCS 4206, P. Dourish and A. Friday, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 297-314.
S. S. Intille, K. Larson, E. Munguia Tapia, J. Beaudin, P. Kaushik, J. Nawyn, and R. Rockinson, "Using a live-in laboratory for ubiquitous computing research," in Proceedings of PERVASIVE 2006, vol. LNCS 3968, K. P. Fishkin, B. Schiele, P. Nixon, and A. Quigley, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 349-365.
E. Munguia Tapia, S. S. Intille, L. Lopez, and K. Larson, "The design of a portable kit of wireless sensors for naturalistic data collection," in Proceedings of PERVASIVE 2006, vol. LNCS 3968, K. P. Fishkin, B. Schiele, P. Nixon, and A. Quigley, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 117-134.
J. Ho and S. S. Intille, "Using context-aware computing to reduce the perceived burden of interruptions from mobile devices," in Proceedings of CHI 2005 Connect: Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2005, pp. 909-918.
S. S. Intille, K. Larson, J. S. Beaudin, J. Nawyn, E. Munguia Tapia, P. Kaushik, "A living laboratory for the design and evaluation of ubiquitous computing technologies," in Extended Abstracts of the 2005 Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2005, pp. 1941-1944.
M. Morris, S. S. Intille, and J. S. Beaudin, "Embedded Assessment: overcoming barriers to early detection with pervasive computing," in Proceedings of PERVASIVE 2005, H. W. Gellersen, R. Want, and A. Schmidt, Eds. Berlin Heidelberg: Springer-Verlag, 2005, pp. 333-346.
J. Beaudin, S. Intille, and E. Munguia Tapia, "Lessons learned using ubiquitous sensors for data collection in real homes," in Extended Abstracts of the 2004 Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2004, pp. 1359-1362.
L. Bao and S. S. Intille, "Activity recognition from user-annotated acceleration data," in Proceedings of PERVASIVE 2004, vol. LNCS 3001, A. Ferscha and F. Mattern, Eds., Berlin Heidelberg: Springer-Verlag, 2004, pp. 1-17.
E. Munguia Tapia, S. S. Intille, and K. Larson, "Activity recognition in the home setting using simple and ubiquitous sensors," in Proceedings of PERVASIVE 2004, vol. LNCS 3001, A. Ferscha and F. Mattern, Eds. Berlin Heidelberg: Springer-Verlag, 2004, pp. 158-175.
S. S. Intille, L. Bao, E. Munguia Tapia, and J. Rondoni, "Acquiring in situ training data for context-aware ubiquitous computing applications," in Proceedings of CHI 2004 Connect: Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2004, pp. 1-9.
S.S. Intille and K. Larson, "Designing and evaluating technology for independent aging in the home," in Proceedings of the International Conference on Aging, Disability and Independence, December 2003. Accessible via: http://www.icadi.phhp.ufl.edu/2003/proceedings.php.
S. S. Intille, C. Kukla, R. Farzanfar, and W. Bakr, "Just-in-time technology to encourage incremental, dietary behavior change," in Proceedings of the AMIA Annual Symposium: Wiley, 2003.
S.S. Intille, E. Munguia Tapia J. Rondoni, J. Beaudin, C. Kukla, S. Agarwal, and L. Bao, "Tools for studying behavior and technology in natural settings," in Proceedings of UBICOMP 2003: Ubiquitous Computing, vol. LNCS 2864, A.K. Dey, A. Schmidt, and J.F. McCarthy, Eds., Berlin Heidelberg: Springer, 2003, pp. 157-174.
S. S. Intille, J. Rondoni, C. Kukla, I. Anacona, and L. Bao, "A context-aware experience sampling tool," in Proceedings of CHI '03 Extended Abstracts on Human Factors in Computing Systems, New York, NY: ACM Press, 2003, pp. 972-973.
S.S. Intille, "Change blind information display for ubiquitous computing environments," in Proceedings of the Fourth International Conference Ubiquitous Computing, G. Borriello and L.E. Holmquist, Eds., vol. LNCS 2498. Berlin: Springer-Verlag, 2002, pp. 91-106.
S. S. Intille, C. Kukla, and X. Ma, "Eliciting user preferences using image-based experience sampling and reflection," in Proceedings of the CHI '02 Extended Abstracts on Human Factors in Computing Systems, New York, NY: ACM Press, 2002, pp. 738-739.
S. S. Intille and A. F. Bobick, "A framework for recognizing multi-agent action from visual evidence," in Proceedings of the Sixteenth National Conference on Artificial Intelligence, Menlo Park, CA: AAAI Press, 1999, pp. 518-525.
S.S. Intille and A.F. Bobick, "Visual recognition of multi-agent action using binary temporal relations," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 1999, pp. 56-62.
S. S. Intille, J. Davis, and A. Bobick, "Real-time closed-world tracking," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition: IEEE Press, 1997, pp. 697-703.
S. S. Intille and A. F. Bobick, "Closed-world tracking," in Proceedings of the Fifth International Conference on Computer Vision: IEEE Press, 1995, pp. 672-678.
S. S. Intille and A. F. Bobick, "Incorporating intensity edges in the recovery of occlusion regions," in Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1, IEEE Press, 1994, pp. 674-677.
S. S. Intille and A. F. Bobick, "Disparity-space images and large occlusion stereo," in Proceedings of the Third European Conference on Computer Vision, vol. 2, J.-O. Eklundh, Ed., Secaucus, NJ: Springer-Verlag, 1994, pp. 179-186.
Invited papers for keynotes at refereed conferences
Demo presentations at refereed conferences
Video presentations at refereed conferences
Abstract presentations at refereed conferences
Paper presentations at refereed workshops
S.S. Intille, "Cognition for Healthy People: Some Challenges," in Proceedings of the Assisted Cognition Workshop, 2007.
S.S. Intille, "Ubiquitous computing technology for just-in-time motivation of behavior change," in Proceedings of the UbiHealth Workshop, 2003.
S.S. Intille, K. Larson, and C. Kukla, "Just-in-time context-sensitive questioning for preventative health care," in Proceedings of the AAAI 2002 Workshop on Automation as Caregiver: The Role of Intelligent Technology in Elder Care, AAAI Technical Report WS-02-02. Menlo Park, CA: AAAI Press, 2002.
S. S. Intille and A. F. Bobick, "Recognizing team plans from visual primitives," in Proceedings of the IJCAI'99 Workshop on Team Modeling and Plan Recognition, 1999.
S.S. Intille and A.F. Bobick, "Representation and visual recognition of complex, multi-agent actions using belief networks," in Proceedings of the IEEE Computer Society Workshop on the Interpretation of Visual Motion, 1998. Also appears in Proceedings of the ECCV '98 Workshop on the Perception of Human Action, 1998.
A. F. Bobick, S. S. Intille, J. W. Davis, F. Baird, L. W. Campbell, Y. Ivanov, C. S. Pinhanez, A. Schütte, and A. Wilson, "Design decisions for interactive environments: Evaluating the KidsRoom," in Proceedings of the AAAI Spring Symposium on Intelligent Environments, AAAI Technical Report SS-98-02, 1998, pp. 7-16.
A.F. Bobick, J.W. Davis, and S.S. Intille, "The KidsRoom: an example application using a deep perceptual interface," in Proceedings of the Workshop on Perceptual User Interfaces, M. Turk, Ed., 1997, pp. 1-4.
S.S. Intille and A.F. Bobick, "Exploiting contextual information for tracking by using closed-worlds," in Proceedings of the Workshop on Context-Based Vision, 1995, pp. 87-98.
Ph.D. thesis (September 1999)
Title: Visual recognition of multi-agent action
In this work, a framework for the representation and visual recognition of multi-agent action is presented, implemented, and evaluated. This project's thesis can be stated most succinctly as follows: that many interesting multi-agent actions can be represented and recognized from noisy perceptual data using visually grounded goal-based primitives and explicit but low-order reasoning about temporal relationships. A primary contribution of this work is an analysis of the issues and tradeoffs involved when selecting a representation for multi-agent collaborative action recognition. The input to the system described in this work is trajectories of object movements obtained from real video scenes.
S.S. Intille and A.F. Bobick, "Le suivi visuel à l'aide des mondes clos," in Proceedings of the Informatique et Sports Collectifs, 1999, pp. 31-56. (translated to French).
S.S. Intille, "Sport online," http://www.media.mit.edu/~intille/papers/sp.html, 1996.
S. S. Intille, "Tracking Using a Local Closed-World Assumption," Massachusetts Institute of Technology, Cambridge, MA, 1994. Advisor: Prof. Aaron F. Bobick.
Invited participation as expert panelist or consultant
3rd International Congress on Physical Activity and Public Health
American Public Health Association Annual Meeting
Facilitating Interdisciplinary Research: Methodological and Technological Innovation in the Behavioral and Social Sciences
Science of Behavior Change
International Conference on Dietary and Physical Activity Assessment Methods (ICDAM)
Keynote: Persuasion, Sensors, and Everyday Life: Some Challenges
Invited Talk: Science Meeting on Physical Activity and Substance Abuse
Invited Talk: Emerging Mobile Technologies for Health Monitoring
Invited Talk: Using Technology to Support Preventive Care Outside of the Hospital
Instructor: 3rd IEEE-EMBS International Summer School and Symposium
on Medical Devices and Biosensors
Create New Business Models By Making Health Fun
Keynote: The Goal: Smart People, Not Smart Homes
Invited Talk: Using Ubiquitous Computing Technology to Create Smart
People, Not Smart Homes
Using a Live-In Laboratory to Study Novel Proactive Health
Invited Talk: The PlaceLab
Honorary Gilbreth Lecture: Ubiquitous Computing Technologies to Encourage Aging in Place
Invited Demonstration of Technology
Consumer-Based Health Tracking Using Sensor-Enabled Homes and Phones
Keynote Address: Proactive Health Systems for the Home Using
Ubiquitous and Wearable Computing
Tools for Studying and Developing Context-Aware, Proactive Health
Systems for the Home
Innovative Technology to Advance eHealth Measurement and Methods
Real-Time, Automatic Activity Recognition from Accelerometers:
Challenges and Health Applications
Tools for Studying and Developing Just-in-Time Proactive Health
Tools for Studying and Developing Context-Aware Systems for the Home
Ubiquitous Computing Technologies to Encourage Aging in Place
Panel: Video Visions of the Future: A Critical Review
Keynote Address: Ubiquitous Computing Technologies to Encourage Aging
Tools for Studying and Developing Context-Aware Systems for the Home
Technological Innovations Real-Time Data Capture
Tools for Studying and Motivating Health Behavior Change in Natural
Tools for Studying and Developing Context-Aware Systems for the Home
Keynote: Designing and Evaluating Technology for Supportive Homes
Preventive Health Care
Future Computing Environments and Proactive Health Care
The House_n Living Laboratory
Designing Perceptually-Based Interactive Environments
Adaptive Interfaces Entrepreneurial Workshop Case Presentation
Sports and Technology: Dynamic Scene Understanding
Workshop organization (reviewed)
Invited workshop participation
Selected Ongoing Projects
Computers Motivating Behavior Change. Various projects on the use of sensor-driven context-aware computing to motivate behavior change in health behavior and energy consumption behavior. A current focus is motivating physical activity via large-scale studies using mobile phones.
Wockets. Miniature, low-cost open-source sensors that communicate with common mobile phones being developed for continuous, longitudinal measurement of physical activity. Enable real-time activity-sensitive health interventions on phones. http://web.mit.edu/wockets
BoxLab. A low-cost, multi-sensor in-home monitoring system for home health research. http://boxlab.wikispaces.com
Context-sensitive experience sampling and the National Experience Sampling project. Development of new ecological momentary assessment techniques that use activity detection to provide tools for ubiquitous computing and health researchers. Also, exploration of potential of expanding experiencing sampling to a national program that might allow data-driven health behavior research with remote recruiting and monitoring of large study participant cohorts. http://web.mit.edu/nesp/
MITes: MIT Environmental Sensors. A portable sensor kit used for mobile and in-home ubiquitous computing research. http://web.mit.edu/wockets/MITes/
Selected Past Projects
PlaceLab. A MIT House_n and TIAX LLC initiative. A unique live-in residential observational facility for studying people and technology in the context of the home. The environment was used for ubiquitous computing and proactive health pilot experiments. http://architecture.mit.edu/house_n/placelab.html
Microlearning. Embedding learning into everyday activities in short bursts delivered at appropriate moments. Example systems designed include Whozit, for incremental learning of names and faces on mobile phones, and a Language Learning Tool using in-home sensing and mobile phones to incrementally learn a language. A related project, KinQuery, explored the use of idle moments for cognitive assessment using a novel form of family-based social networking.
House_n prototype environment. A collaboration with House_n students that includes vision systems to track people in a room and track objects on a "digital table," a ubiquitous display device, and visual tracking of laser pointer input. The environment is being used as a research platform to study ubiquitous computing, sensing technologies, and technologies for motivating behavior change.
The KidsRoom: An Interactive, Narrative Environment. Chief architect (with J. Davis). A perceptually-based, interactive environment using computer vision technology to track people and recognize human action. The system explored how the context of a story can be used to improve vision recognition algorithms and how perceptual recognition and automatic control of an environment can be used to design interactive experiences that do not require users to wear any special sensors, displays, or clothing. A simplified version of the system was constructed by NearLife (http://www.nearlife.com) for Britain's Millennium Dome 2000 event.
Computers Watching Football. System for the automatic annotation of video of football plays. Used to study problems and test algorithms in multi-agent action recognition and tracking.
Inducting Indy (with A. Wilson). A demonstration of a software agent that learns to recognize activity in a video game environment. Using video game environments may provide an interesting domain for some types of action recognition research and a platform for class projects on recognition.
Peer-reviewed seminar courses
Other teaching experiences
Cooking, canine clicker training, and hiking and other outdoor activities.
Citizenship: United States of America