Computational sensing, machine learning, and user interface systems for preventive medicine; persuasive user interfaces for motivating behavior change; sensor-enabled mobile health technologies; context-aware ecological momentary assessment; experimental ubiquitous computing; living laboratories; perceptually-based interactive environments for home and educational settings; pattern recognition and dynamic scene understanding; artificial intelligence; health technology and policy. 

Massachusetts Institute of Technology, Cambridge, MA
The Media Laboratory
Ph.D. Media Arts and Sciences (September 1999)
Dissertation title: Visual recognition of multi-agent action
Area of specialization: computer vision action recognition and interactive vision systems

Massachusetts Institute of Technology, Cambridge, MA
The Media Laboratory
S.M. in Media Arts and Sciences (August 1994)
Thesis title: Tracking using a local closed-world assumption
Area of specialization: computer vision

University of Pennsylvania, Philadelphia, PA (May 1992)
School of Engineering and Applied Sciences
B.S.E. in Computer Science and Engineering, summa cum laude

MIT House_n Consortium, Cambridge, MA
(September 1999 - present)
Research Scientist with PI status. Research and teaching on topics related to computational sensing for health technologies, interactive environments, and future human-computer interface design. Supervision of postdoctoral associates, technical staff, and graduate and undergraduate students. Technology Director of the House_n Consortium (since 2002). Grant-writing and corporate fundraising for research efforts and support of the industry/academic consortium. MIT Principal Investigator on NSF, NIH, Intel, CIMIT, Microsoft Research, IBM, and Robert Wood Johnson Foundation grants.  

MIT Media Laboratory, Cambridge, MA
(September 1992 - August 1999)
Research Assistant. Published research in computer vision and interactive vision systems.

Penn General Robotics and Sensory Perception (GRASP) Laboratory
(Summer 1991)
Research Assistant. Developed a visual interface for a range image recognition system.

MIT Principal Investigator, Lead Duke Medical School (NIH U01), "Cellphone Intervention Trial for Young Adults (CITY)." A five-year study to develop and evaluate (in a randomized clinical trial) sensor-enabled mobile phone technology to assist young adults with long-term weight loss and weight management (2009).

Principal Investigator (NIH GEI Opportunity Fund Program), "Encouraging GEI Activity Monitor Adoption: Demonstrating Device Equivalency." A one-year study using custom-designed mechanical shakers and pattern recognition algorithms to demonstrate how phones can be used to produce output nearly equivalent to existing physical activity monitors (2009).

MIT Principal Investigator, Lead USC Medical (Robert Wood Johnson Foundation), "Development of a Time Use Intervention Using Mobile Phones to Promote Physical Activity in Youth." Several projects to explore the use of experience sampling on mobile phones for physical activity data gathering in children and adults (2009).

MIT Principal Investigator, Lead RTI International (NIH NIEHS), "Development of Optimal Monitor Placement and Accelerometer Algorithms for Personal Contaminant Sensor Platforms with a Focus on Children's Activities." A one-year NIH-funded project with RTI International, Stanford School of Medicine, UC San Diego, LDEO/Columbia, and Battelle/PNNL to study the use of accelerometry-based motion monitoring to improve a wearable, personal contaminant sensing in children (2009).

MIT Principal Investigator, Lead RTI International (NIH NIEHS), "Development of Optimal Monitor Placement and Accelerometer Algorithms for Personal Contaminant Sensor Platforms." A one-year NIH-funded project with RTI International, Stanford School of Medicine, UC San Diego, LDEO/Columbia, and Battelle/PNNL to study the use of accelerometry-based motion monitoring to improve a wearable, personal contaminant sensing in adults (2008).

Principal Investigator (NSF), "CRI:CRD Development of Longitudinal Home Activity Datasets as a Shared Resource." A three-year study to develop portable sensor tools that can be used in typical homes to collect data for computer science and health research, as well as to generate shared datasets on home activity from actual homes to be used as a community resource to accelerate research (2007).

Principal Investigator (NIH NHLBI U01), "Enabling Population-Scale Physical Activity Measurement on Common Mobile Phones." A four-year study with Stanford School of Medicine to create novel health monitoring tools for mobile phones. Includes a supplement to develop mobile context-sensitive ecological momentary assessment software for mobile phones ("Extensible Platform for Implementing Experience Sampling on Mobile Phones") (2007).

Principal Investigator (Intel AIM Grant Program), "AIM Proposal: End-User-Driven Training of Activity Recognition Algorithms." A three-year study on the use of in-home context sensing, where end-users drive the algorithm training process, as applied towards proactive health care (2007).

MIT Principal Investigator, Lead Vanderbilt University (NIH NHLBI), "Physical activity energy expenditure and adolescent obesity." A two-year collaboration where House_n sensors were provided to Vanderbilt researchers for energy expenditure measurement experiments in a room calorimeter (2007).

MIT Principal Investigator, Lead Groden Center (National Alliance for Autism), "Telemetric Assessment of Movement Stereotypy in Children with ASD." A two-year study with the Groden Center, a school for autistic children, and the University of Rhode Island to explore the use of wireless accelerometers for automatic detection of autistic stereotypies (2006). An extension of this project is ongoing.

Principal Investigator (Microsoft Digital Memories (Memex) grant award), "Integration of Memex and PlaceLab Datasets for Personal Investigations of Health and Living Patterns". A one-year study to add Microsoft SenseCam technology to the PlaceLab. The technology has since been added to the BoxLab system used in a current NSF grant (2006).

MIT Principal Investigator, Lead Northeastern University (NIH NLM R21), "Just in Time Health Information for Exercise Adoption." A two-year study with Northeastern University and Harvard University to develop and test a PDA-based system for motivating brisk walking (2005). 

MIT Principal Investigator, Lead UNC School of Public Health (Gatorade Seed Funds), "Development of an Objective Measure of Television Watching." A one-year exploratory study with University of North Carolina School of Public Health to adapt a wireless sensor toolkit (MITes) to detect television watching behavior and sedentary activity (2005). 

MIT Principal Investigator, Lead Boston Medical Center (NIH NCI R21), "Context-Sensitive Measurement of Physical Activity." A two-year study with Boston Medical Center and Stanford School of Medicine to develop and test sensor technology for measuring physical activity (2004).

Principal Investigator (Intel AIM Grant Program), "AIM Proposal: Detecting Idle Moments for Proactive Health Activities Using Personal and Environmental Sensors and Interfaces." A three-year study on context-aware computing for proactive health care (2003).

Principal Investigator (NSF), "ITR: Detecting Activity in Homes with Ubiquitous Sensing to Support Aging in Place." A two-year study on activity of daily living (ADL) recognition from home sensors (2003).

Faculty Award (IBM). An award to investigate ubiquitous computing technology (2003).

Principal Investigator (NSF), "ITR/PE: Using context-recognition for preventative medicine in the home." A two-year study with Boston Medical Center to develop and test sensors for home activity recognition (2001). 

Principal Investigator (Robert Wood Johnson Foundation), "Measuring and Motivating Stair Use in Public Spaces." A one-year study to develop a system to measure and motivate stair use with digital point of decision prompting in a subway station (2002).  

K. Patrick, W. G. Griswold, F. Raab, and S. S. Intille, "Health and the mobile phone," American Journal of Preventive Medicine, 35(2), pp. 177-181, 2008.

P. Kaushik, S. S. Intille, and K. Larson, "User-adaptive reminders for home-based medical tasks. A case study," Methods of Information in Medicine, 47(3), pp. 203-7, 2008.

M.S. Goodwin, W.F. Velicer, and S.S. Intille, "Telemetric monitoring in the behavior sciences," Behavior Research Methods, 40(1), pp. 328-341, 2008.

Beaudin, J.S., S.S. Intille, and M.E. Morris, "To track or not to track: User reaction to concepts in longitudinal health monitoring," Journal of Medical Internet Research, 8(4):e29, 2006.

K. Patrick, S. Intille, and M. Zabinski, "An ecological framework for cancer communication: implications for research," Journal of Medical Internet Research, 7(3):e23, 2005.

S. S. Intille, "A new research challenge: Persuasive technology to motivate healthy aging," Transactions on Information Technology in Biomedicine, 8(3), pp. 235-237, 2004.

S.S. Intille, "Designing a home of the future," IEEE Pervasive Computing, 1(2), pp. 76-82, 2002.

S.S. Intille and A.F. Bobick, "Recognizing planned, multi-person action," Computer Vision and Image Understanding, vol. 81(3), pp. 414-445, 2001.

C.S. Pinhanez, J.W. Davis, S.S. Intille, M. Johnson, A. Wilson, A.F. Bobick, and B. Blumberg, "Physically interactive story environments," IBM Systems Journal, 39(3/4), pp. 438-455, 2000. 

A.F. Bobick, S.S. Intille, J.W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y. Ivanov, A. Schütte, and A. Wilson, "The KidsRoom: a perceptually-based interactive immersive story environment," PRESENCE: Teleoperators and Virtual Environments, 8(4), pp. 367-391, 1999.

A.F. Bobick and S.S. Intille, "Large occlusion stereo," International Journal of Computer Vision, 33(3), pp. 181-200, 1999.

K. Larson, S. Intille, T. J. McLeish, J. Beaudin, and R. E. Williams, "Open source building — Reinventing places of living," BT Technology Journal, 22(4), pp. 187-200, 2004.

A.F. Bobick, S.S. Intille, W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y. Ivanov, A. Schütte, and A. Wilson, "Perceptual user interfaces: The KidsRoom," Communications of the ACM, 43(3), pp. 60-61, 2000.

F. Albinali, M. S. Goodwin, and S. S. Intille, "Recognizing stereotypical motor movements in the laboratory and classroom: A case study with children on the autism spectrum," in Proceedings of the 11th International Conference on Ubiquitous Computing, New York: ACM Press, 2009, pp. 71-80. Best paper award.

P. Kaushik, S. S. Intille, and K. Larson, "Observations from a case study on user adaptive reminders for medication adherence," in Proceedings of the Second International Conference on Pervasive Computing Technologies for Healthcare, IEEE Press, 2008, pp. 250-253.

E. M. Tapia, S. S. Intille, and K. Larson, "Portable wireless sensors for object usage sensing in the home: Challenges and practicalities," in Proceedings of the European Ambient Intelligence Conference, vol. LNCS 4794, Berlin Heidelberg: Springer-Verlag, 2007, pp. 19-37.

J. S. Beaudin, S. S. Intille, E. Munguia Tapia, R. Rockinson, and M. Morris, "Context-sensitive microlearning of foreign language vocabulary on a mobile device," in Proceedings of the European Ambient Intelligence Conference, vol. LNCS 4794, Berlin Heidelberg: Springer-Verlag, 2007, pp. 55-72.

E. Munguia Tapia, S. S. Intille, W. Haskell, K. Larson, J. Wright, A. King, and R. Friedman, "Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor" in Proceedings of the 11th IEEE International Symposium on Wearable Computers, IEEE Press, 2007, pp. 37-40.

B. Logan, J. Healey, Matthai Philipose, E. Munguia Tapia, and S. Intille, "A long-term evaluation of sensing modalities for activity recognition," in Proceedings of the International Conference on Ubiquitous Computing, vol. LNCS 4717, Berlin Heidelberg: Springer-Verlag, 2007, pp. 483–500.

J. Nawyn, S. S. Intille, and K. Larson, "Embedding behavior modification strategies into a consumer electronics device: A case study," in Proceedings of UbiComp 2006, vol. LNCS 4206, P. Dourish and A. Friday, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 297-314.

S. S. Intille, K. Larson, E. Munguia Tapia, J. Beaudin, P. Kaushik, J. Nawyn, and R. Rockinson, "Using a live-in laboratory for ubiquitous computing research," in Proceedings of PERVASIVE 2006, vol. LNCS 3968, K. P. Fishkin, B. Schiele, P. Nixon, and A. Quigley, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 349-365.

E. Munguia Tapia, S. S. Intille, L. Lopez, and K. Larson, "The design of a portable kit of wireless sensors for naturalistic data collection," in Proceedings of PERVASIVE 2006, vol. LNCS 3968, K. P. Fishkin, B. Schiele, P. Nixon, and A. Quigley, Eds., Berlin Heidelberg: Springer-Verlag, 2006, pp. 117-134.

J. Ho and S. S. Intille, "Using context-aware computing to reduce the perceived burden of interruptions from mobile devices," in Proceedings of CHI 2005 Connect: Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2005, pp. 909-918.

S. S. Intille, K. Larson, J. S. Beaudin, J. Nawyn, E. Munguia Tapia, P. Kaushik, "A living laboratory for the design and evaluation of ubiquitous computing technologies," in Extended Abstracts of the 2005 Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2005, pp. 1941-1944.

M. Morris, S. S. Intille, and J. S. Beaudin, "Embedded Assessment: overcoming barriers to early detection with pervasive computing," in Proceedings of PERVASIVE 2005, H. W. Gellersen, R. Want, and A. Schmidt, Eds. Berlin Heidelberg: Springer-Verlag, 2005, pp. 333-346.

J. Beaudin, S. Intille, and E. Munguia Tapia, "Lessons learned using ubiquitous sensors for data collection in real homes," in Extended Abstracts of the 2004 Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2004, pp. 1359-1362. 

L. Bao and S. S. Intille, "Activity recognition from user-annotated acceleration data," in Proceedings of PERVASIVE 2004, vol. LNCS 3001, A. Ferscha and F. Mattern, Eds., Berlin Heidelberg: Springer-Verlag, 2004, pp. 1-17. 

E. Munguia Tapia, S. S. Intille, and K. Larson, "Activity recognition in the home setting using simple and ubiquitous sensors," in Proceedings of PERVASIVE 2004, vol. LNCS 3001, A. Ferscha and F. Mattern, Eds. Berlin Heidelberg: Springer-Verlag, 2004, pp. 158-175.

S. S. Intille, L. Bao, E. Munguia Tapia, and J. Rondoni, "Acquiring in situ training data for context-aware ubiquitous computing applications," in Proceedings of CHI 2004 Connect: Conference on Human Factors in Computing Systems, New York, NY: ACM Press, 2004, pp. 1-9.

S.S. Intille and K. Larson, "Designing and evaluating technology for independent aging in the home," in Proceedings of the International Conference on Aging, Disability and Independence, December 2003. Accessible via: http://www.icadi.phhp.ufl.edu/2003/proceedings.php.

S. S. Intille, C. Kukla, R. Farzanfar, and W. Bakr, "Just-in-time technology to encourage incremental, dietary behavior change," in Proceedings of the AMIA Annual Symposium: Wiley, 2003.

S.S. Intille, E. Munguia Tapia J. Rondoni, J. Beaudin, C. Kukla, S. Agarwal, and L. Bao, "Tools for studying behavior and technology in natural settings," in Proceedings of UBICOMP 2003: Ubiquitous Computing, vol. LNCS 2864, A.K. Dey, A. Schmidt, and J.F. McCarthy, Eds., Berlin Heidelberg: Springer, 2003, pp. 157-174.

S. S. Intille, J. Rondoni, C. Kukla, I. Anacona, and L. Bao, "A context-aware experience sampling tool," in Proceedings of CHI '03 Extended Abstracts on Human Factors in Computing Systems, New York, NY: ACM Press, 2003, pp. 972-973.

S.S. Intille, "Change blind information display for ubiquitous computing environments," in Proceedings of the Fourth International Conference Ubiquitous Computing, G. Borriello and L.E. Holmquist, Eds., vol. LNCS 2498. Berlin: Springer-Verlag, 2002, pp. 91-106. 

S. S. Intille, C. Kukla, and X. Ma, "Eliciting user preferences using image-based experience sampling and reflection," in Proceedings of the CHI '02 Extended Abstracts on Human Factors in Computing Systems, New York, NY: ACM Press, 2002, pp. 738-739.

S. S. Intille and A. F. Bobick, "A framework for recognizing multi-agent action from visual evidence," in Proceedings of the Sixteenth National Conference on Artificial Intelligence, Menlo Park, CA: AAAI Press, 1999, pp. 518-525.

S.S. Intille and A.F. Bobick, "Visual recognition of multi-agent action using binary temporal relations," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, 1999, pp. 56-62.

S. S. Intille, J. Davis, and A. Bobick, "Real-time closed-world tracking," in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition: IEEE Press, 1997, pp. 697-703.

S. S. Intille and A. F. Bobick, "Closed-world tracking," in Proceedings of the Fifth International Conference on Computer Vision: IEEE Press, 1995, pp. 672-678.

S. S. Intille and A. F. Bobick, "Incorporating intensity edges in the recovery of occlusion regions," in Proceedings of the 12th IAPR International Conference on Pattern Recognition, vol. 1, IEEE Press, 1994, pp. 674-677.

S. S. Intille and A. F. Bobick, "Disparity-space images and large occlusion stereo," in Proceedings of the Third European Conference on Computer Vision, vol. 2, J.-O. Eklundh, Ed., Secaucus, NJ: Springer-Verlag, 1994, pp. 179-186.

S.S. Intille, "Cognition for Healthy People: Some Challenges," in Proceedings of the Assisted Cognition Workshop, 2007. 

S.S. Intille, "Ubiquitous computing technology for just-in-time motivation of behavior change," in Proceedings of the UbiHealth Workshop, 2003. 

S.S. Intille, K. Larson, and C. Kukla, "Just-in-time context-sensitive questioning for preventative health care," in Proceedings of the AAAI 2002 Workshop on Automation as Caregiver: The Role of Intelligent Technology in Elder Care, AAAI Technical Report WS-02-02. Menlo Park, CA: AAAI Press, 2002.

S. S. Intille and A. F. Bobick, "Recognizing team plans from visual primitives," in Proceedings of the IJCAI'99 Workshop on Team Modeling and Plan Recognition, 1999.

S.S. Intille and A.F. Bobick, "Representation and visual recognition of complex, multi-agent actions using belief networks," in Proceedings of the IEEE Computer Society Workshop on the Interpretation of Visual Motion, 1998. Also appears in Proceedings of the ECCV '98 Workshop on the Perception of Human Action, 1998.

A. F. Bobick, S. S. Intille, J. W. Davis, F. Baird, L. W. Campbell, Y. Ivanov, C. S. Pinhanez, A. Schütte, and A. Wilson, "Design decisions for interactive environments: Evaluating the KidsRoom," in Proceedings of the AAAI Spring Symposium on Intelligent Environments, AAAI Technical Report SS-98-02, 1998, pp. 7-16.

A.F. Bobick, J.W. Davis, and S.S. Intille, "The KidsRoom: an example application using a deep perceptual interface," in Proceedings of the Workshop on Perceptual User Interfaces, M. Turk, Ed., 1997, pp. 1-4.

S.S. Intille and A.F. Bobick, "Exploiting contextual information for tracking by using closed-worlds," in Proceedings of the Workshop on Context-Based Vision, 1995, pp. 87-98.

Title: Visual recognition of multi-agent action
Advisor:
   Professor Aaron Bobick
    Massachusetts Institute of Technology Media Lab, USA
Additional committee members:
    Professor Eric Grimson
    Massachusetts Institute of Technology AI Lab, USA
    Professor Hans-Hellmut Nagel
    University of Karlsruhe, Germany

In this work, a framework for the representation and visual recognition of multi-agent action is presented, implemented, and evaluated. This project's thesis can be stated most succinctly as follows: that many interesting multi-agent actions can be represented and recognized from noisy perceptual data using visually grounded goal-based primitives and explicit but low-order reasoning about temporal relationships. A primary contribution of this work is an analysis of the issues and tradeoffs involved when selecting a representation for multi-agent collaborative action recognition. The input to the system described in this work is trajectories of object movements obtained from real video scenes.

S.S. Intille and A.F. Bobick, "Le suivi visuel à l'aide des mondes clos," in Proceedings of the Informatique et Sports Collectifs, 1999, pp. 31-56. (translated to French).

S.S. Intille, "Sport online," http://www.media.mit.edu/~intille/papers/sp.html, 1996.

S. S. Intille, "Tracking Using a Local Closed-World Assumption," Massachusetts Institute of Technology, Cambridge, MA, 1994. Advisor: Prof. Aaron F. Bobick.

3rd International Congress on Physical Activity and Public Health
Toronto, Canada, May 5-8, 2010

American Public Health Association Annual Meeting
Philadelphia, PA, November, 2009

Facilitating Interdisciplinary Research: Methodological and Technological Innovation in the Behavioral and Social Sciences
National Institutes of Health
Bethesda, MD, October, 2009

Science of Behavior Change
National Institutes of Health
Bethesda, MD, June 15-16, 2009

International Conference on Dietary and Physical Activity Assessment Methods (ICDAM)
Washington, DC, June 2009

Keynote: Persuasion, Sensors, and Everyday Life: Some Challenges
The Fourth International Conference on Persuasive Technology
Claremont, CA, April, 2009

Invited Talk: Science Meeting on Physical Activity and Substance Abuse
National Institute of Drug Abuse, National Institutes of Health
Bethesda, MD, June 5-6, 2008

Invited Talk: Emerging Mobile Technologies for Health Monitoring
In session: New Technologies for Energy Balance Measurement and Intervention Research
Food and Nutrition Conference and Expo (FNCE)
Philadelphia, PA, October 2, 2007

Invited Talk: Using Technology to Support Preventive Care Outside of the Hospital
HomeCentric Industrial Liaison Conference
Cambridge, MA, September 25, 2007

Instructor: 3rd IEEE-EMBS International Summer School and Symposium on Medical Devices and Biosensors
Boston, MA, September 4-5, 2006

Create New Business Models By Making Health Fun
Healthcare Unbound: A Conference & Exhibition on the Convergence of Consumer and Healthcare Technologies
Boston, MA, July 17-18, 2006.

Keynote: The Goal: Smart People, Not Smart Homes
International Conference on Smart Homes & Beyond (ICOST 2006)
Belfast, UK, June, 2006.

Invited Talk: Using Ubiquitous Computing Technology to Create Smart People, Not Smart Homes
Duke University
Durham, NC, April 10, 2006.

Using a Live-In Laboratory to Study Novel Proactive Health Technologies
Distributed Diagnostics and Home Healthcare Conference 
Washington, DC, April 3, 2006.

Invited Talk: The PlaceLab
Harvard University AI Group
Cambridge, MA, March 16, 2006.

Honorary Gilbreth Lecture: Ubiquitous Computing Technologies to Encourage Aging in Place
National Academy of Engineering Annual Meeting
Washington, DC, October 9, 2005.

Invited Demonstration of Technology
National Commission for Quality Long-term Care
Washington, DC, July 22, 2005.

Consumer-Based Health Tracking Using Sensor-Enabled Homes and Phones
Smart Homes and Smart Phones: Emerging Clinical and Business Models
Boston, MA, July 12, 2005.

Keynote Address: Proactive Health Systems for the Home Using Ubiquitous and Wearable Computing 
Healthcare Unbound: A Conference & Exhibition on the Convergence of Consumer and Healthcare Technologies
Boston, MA, July 11-12, 2005.

Tools for Studying and Developing Context-Aware, Proactive Health Systems for the Home
Intel Corporation
Hillsboro, OR, April 9, 2005

Innovative Technology to Advance eHealth Measurement and Methods
Critical Issues in eHealth Research Conference
Sponsored by the National Cancer Institute
Bethesda, MD, June 9-10, 2005

Real-Time, Automatic Activity Recognition from Accelerometers: Challenges and Health Applications
University of Massachusetts
Amherst, MA, March 21, 2005

Tools for Studying and Developing Just-in-Time Proactive Health Technologies
Stanford School of Medicine
February 9, 2005

Tools for Studying and Developing Context-Aware Systems for the Home
Intel Research Berkeley
February 8, 2005

Ubiquitous Computing Technologies to Encourage Aging in Place
Japan-America Frontiers of Engineering Symposium
(Sponsored, in part, by the National Academy of Engineering)
Keihanna, Japan, November 2004

Panel: Video Visions of the Future: A Critical Review
With Eric Bergman, Arnold Lund, Hugh Dubberly, Bruce Tognazzini
CHI 2004
Vienna Austria, April 2004

Keynote Address: Ubiquitous Computing Technologies to Encourage Aging in Place
Healthcare Unbound: A Conference & Exhibition on the Convergence of Consumer and Healthcare Technologies
Cambridge, MA, July 8-9, 2004.

Tools for Studying and Developing Context-Aware Systems for the Home
IBM Research
Yorktown, NY, May 24, 2004.

Technology Demonstration
Center for Aging Services Technologies (CAST) Congressional Demo
Washington, DC, March, 2004

Technological Innovations Real-Time Data Capture
National Cancer Institute Working Group Meeting: Capturing Physical Activity and Diet in Real-Time
Arlington, VA, January 22, 2004.

Tools for Studying and Motivating Health Behavior Change in Natural Settings
Boston Medical Center
Boston, MA, December 17, 2003.

Tools for Studying and Developing Context-Aware Systems for the Home
Boston University
Boston, MA, November 6, 2003.

Technological Innovations
The Science of Real-Time Data Capture Self-Reports in Health Research Conference
Charleston, SC, September 2003.

Keynote: Designing and Evaluating Technology for Supportive Homes
IEEE/ASME International Conference on Advanced Intelligent Mechatronics
Kobe, Japan, July 2003

Preventive Health Care
eHealth Institute's eHealth Developers' Summit
Tempe, Arizona, November 2002

Future Computing Environments and Proactive Health Care
Center for Future Health, University of Rochester
Rochester, NY, October 2002

The House_n Living Laboratory
Greater Boston SIGCHI
Boston, MA, September 2001

Designing Perceptually-Based Interactive Environments
Brandeis University
Waltham, MA, March 1999.

Adaptive Interfaces Entrepreneurial Workshop Case Presentation
The Harvard Cyberposium
Cambridge, MA, February 1998.

Sports and Technology: Dynamic Scene Understanding
The National Institute of Sport and Physical Education (INSEP), Campus Olympique
Paris, France, June 1996.

Computers Motivating Behavior Change. Various projects on the use of sensor-driven context-aware computing to motivate behavior change in health behavior and energy consumption behavior. A current focus is motivating physical activity via large-scale studies using mobile phones.

Wockets.  Miniature, low-cost open-source sensors that communicate with common mobile phones being developed for continuous, longitudinal measurement of physical activity. Enable real-time activity-sensitive health interventions on phones. http://web.mit.edu/wockets

BoxLab. A low-cost, multi-sensor in-home monitoring system for home health research. http://boxlab.wikispaces.com

Context-sensitive experience sampling and the National Experience Sampling project. Development of new ecological momentary assessment techniques that use activity detection to provide tools for ubiquitous computing and health researchers. Also, exploration of potential of expanding experiencing sampling to a national program that might allow data-driven health behavior research with remote recruiting and monitoring of large study participant cohorts. http://web.mit.edu/nesp/

MITes: MIT Environmental Sensors. A portable sensor kit used for mobile and in-home ubiquitous computing research. http://web.mit.edu/wockets/MITes/

PlaceLab. A MIT House_n and TIAX LLC initiative. A unique live-in residential observational facility for studying people and technology in the context of the home. The environment was used for ubiquitous computing and proactive health pilot experiments. http://architecture.mit.edu/house_n/placelab.html 

Microlearning. Embedding learning into everyday activities in short bursts delivered at appropriate moments. Example systems designed include Whozit, for incremental learning of names and faces on mobile phones, and a Language Learning Tool using in-home sensing and mobile phones to incrementally learn a language. A related project, KinQuery, explored the use of idle moments for cognitive assessment using a novel form of family-based social networking.

House_n prototype environment. A collaboration with House_n students that includes vision systems to track people in a room and track objects on a "digital table," a ubiquitous display device, and visual tracking of laser pointer input. The environment is being used as a research platform to study ubiquitous computing, sensing technologies, and technologies for motivating behavior change.

The KidsRoom: An Interactive, Narrative Environment. Chief architect (with J. Davis). A perceptually-based, interactive environment using computer vision technology to track people and recognize human action. The system explored how the context of a story can be used to improve vision recognition algorithms and how perceptual recognition and automatic control of an environment can be used to design interactive experiences that do not require users to wear any special sensors, displays, or clothing. A simplified version of the system was constructed by NearLife (http://www.nearlife.com) for Britain's Millennium Dome 2000 event.

Computers Watching Football. System for the automatic annotation of video of football plays. Used to study problems and test algorithms in multi-agent action recognition and tracking.

Inducting Indy (with A. Wilson). A demonstration of a software agent that learns to recognize activity in a video game environment. Using video game environments may provide an interesting domain for some types of action recognition research and a platform for class projects on recognition.

Courses

4.208: Designing Persuasive Environments and Technologies, Fall 2002, 2003, 2004
A new multi-disciplinary graduate seminar course on the development of computer technologies and ubiquitous computing environments that measure and motivate behavior change. 

4.208: User Interface Design Studio, Fall 2001, Fall 2000
A new undergraduate and graduate course for computer scientists, engineers, architects, and designers teaching methods of user interface design applied to next-generation physical and digital environments and future interactive user interfaces.

4.185: Home/Community of the Future, Fall 1999
Co-taught with K. Larson. Multi-disciplinary graduate seminar. Taught sessions on technology and computational sensing. 

Advising

Postdocs: Fahd Albinali (current), Jonathan Lester (current).
Research Staff: Jason Nawyn (current), Yi Han (current), Jennifer Beaudin (2003-09).
Graduate Students (advising/co-advising): Selene Mota (Computation and Design, Ph.D. current), Ned Burns (MAS S.M. current), Anh Dang Viet Nguyen (EECS M.Eng. current), Clay Williams (EECS M.Eng. 2009), Hyon Lee (EECS M.Eng. 2009), Emmanuel Munguia Tapia (MAS Ph.D. 2008, MAS S.M. 2003),  Randy Rockinson (MAS S.M. 2008), Kenneth Cheung (Arch S.M. 2008), Manu Gupta (MAS S.M. 2008), Louis Lopez (EECS M.Eng. 2005), Jason Nawyn (MAS, 2005), Pallavi Kausik (MAS, 2005), Joyce Ho (EECS M.Eng. 2004), Jacob Hyman (EECS M.Eng. 2003), Ling Bao (EECS M.Eng. 2003), John Rondoni (EECS M.Eng. 2003), Reid Williams (EECS M.Eng. 2003), Neil Chungfat (EECS M.Eng. 2002), Rania Khalaf (EECS M.Eng. 2001), Joseph Su (MechE S.M. 2001), Byron Stigge (Arch S.M. 2001).
M.S. thesis reader: Charlie DeTar (MAS, 2009), John Moore (MAS, 2009), Sean Wheeler (MAS 2009), Karen Liu (MAS, 2004).
Ph.D. Committee: Ari Benbasat (MAS, 2004).
Visiting or special students: Vincent Zheng (2010), Noah MacNeil (2009), Bruno Lepri (2008), Aydin Oztoprak (2008), Antonio Rodriguez (2008), Till Pieper (2006), Jon Lin (2002), Joachim Bottger (2000)
Senior project advisor: MIT EECS Senior projects: Pamela Hollingsworth (EECS 2006), Bill Walsh (EECS 2006), Alex Mekelburg (MechE, 2005).
MIT undergraduate research students: Matt Falk (2009), Peter McKee (2009), Tobe Nwanna (2009), Anh Dang Viet Nguyen (2008), David Wen (2007), Aiko Nakano (2006), Katie Zarroli (2006), Eleojo Ocholi (2005-6), Melinda Tang (2005), Leevar Williams (2005-6), Mikala Streeter (2006), Kevin Luu (2005), Qian Wang (2005), Dan Guarda (2004), Amanda Seybold (2004), Christina Hawkes (2004), Armando Valdes Samaniego (2003), Jesse Lacika (2003), Michael Ehrenberg (2003), Vivienne Lee (2002-3), Peter Sung (2003), Sachin Gupta (2003), Tian He (2003), Alan Mcconnel (2003), Waseem Bakr (2002-3), Isaac Rosmarin (2002), Folu Okunseinde (2001-2002), Brian Theisen (2001), Jacob Kitz (2000), Anthony Hui (1999), Kamal Mokeddem (1998), Qian Wang and Nick Lesica (1997-98), Ann Bui and Andreas Argyriou (1995), and Salil Pitroda (1994).
Other undergraduate research students: Collette Whitaker (Wellesley, 2009), Shyam Srinivasan (CalTech, 2008), Alex Higuera (2006).
Internships: David Cheff (2005-2006), Evelyn Kapusta (2003), Isabel Ancona (2002), Meghann Evershed (2002), Suzanne Seale (2002).

Peer-reviewed seminar courses

SIGGRAPH course: "Building Interactive Spaces" (with C. Pinhanez)
Summer 2002 (full-day) and 2003 (half-day).  

Seminars

MIT Independent Activities Period '04
Visions of the Future: Screening and Making Concept Videos.

MIT Independent Activities Period '03
Movie Making: Inventing the Future of Ubiquitous Computing.

MIT Independent Activities Period '02
Designing a User Interface "Age Suit."

MIT Independent Activities Period '01
Hack a Home of the Future Computer Interface.

MIT Independent Activities Period '00 lunchtime seminar series
Inventing a Home of the Future.  

Other teaching experiences

Taught occasional graduate seminar class meetings on topics in computer vision (1993-1999).

Tutored small groups of undergraduates in introductory computer science, University of Pennsylvania (1991-92).

Selected as a residential advisor.  Organized educational, cultural, and social programming for a floor of 80 students. Other responsibilities included dispute resolution and counseling (1990-1992).

Engineering Committee Representative, University of Pennsylvania. Undergraduate student representative on faculty committee investigating ways to improve teaching. Introduced several proposals (1991-92).

Student Committee on Undergraduate Education, University of Pennsylvania. Advanced proposals to the administration for improving undergraduate academic and residential life (1991-92).

Cooking, canine clicker training, and hiking and other outdoor activities.