Skip to content
Interagency Autism Coordinating Committee (IACC)
Autism Research Database
Office of Autism Research Coordination (OARC)
 
Project Element Element Description

Project Title

Project Title

Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior

Principal Investigator

Principal Investigator

Sclaroff, Stan

Description

Description

This Expedition will develop novel computational methods for measuring and analyzing the behavior of children and adults during face-to-face social interactions. Social behavior plays a key role in the acquisition of social and communicative skills during childhood. Children with developmental disorders, such as autism, face great challenges in acquiring these skills, resulting in substantial lifetime risks. Current best practices for evaluating behavior and assessing risk are based on direct observation by highly-trained specialists, and cannot be easily scaled to the large number of individuals who need evaluation and treatment. For example, autism affects 1 in 110 children in the U.S., with a lifetime cost of care of $3.2 million per person. By developing methods to automatically collect fine-grained behavioral data, this project will enable large-scale objective screening and more effective delivery and assessment of therapy. Going beyond the treatment of disorders, this technology will make it possible to automatically measure behavior over long periods of time for large numbers of individuals in a wide range of settings. Many disciplines, such as education, advertising, and customer relations, could benefit from a quantitative, data-drive approach to behavioral analysis. Human behavior is inherently multi-modal, and individuals use eye gaze, hand gestures, facial expressions, body posture, and tone of voice along with speech to convey engagement and regulate social interactions. This project will develop multiple sensing technologies, including vision, speech, and wearable sensors, to obtain a comprehensive, integrated portrait of expressed behavior. Cameras and microphones provide an inexpensive, noninvasive means for measuring eye, face, and body movements along with speech and nonspeech utterances. Wearable sensors can measure physiological variables such as heart-rate and skin conductivity, which contain important cues about levels of internal stress and arousal that are linked to expressed behavior. This project is developing unique capabilities for synchronizing multiple sensor streams, correlating these streams to measure behavioral variables such as affect and attention, and modeling extended interactions between two or more individuals. In addition, novel behavior visualization methods are being developed to enable real-time decision support for interventions and the effective use of repositories of behavioral data. Methods are also under development for reflecting the capture and analysis process to users of the technology. The long-term goal of this project is the creation of a new scientific discipline of computational behavioral science, which draws equally from computer science and psychology in order to transform the study of human behavior. A comprehensive education plan supports this goal through the creation of an interdisciplinary summer school for young researchers and the development of new courses in computational behavior. Outreach activities include significant and on-going collaborations with major autism research centers in Atlanta, Boston, Pittsburgh, Urbana-Champaign, and Los Angeles.

Funder

Funder

National Science Foundation

Fiscal Year Funding

Fiscal Year Funding

0

Current Award Period

Current Award Period

2010-2017

Strategic Plan Question

Strategic Plan Question

Question 1: When Should I Be Concerned?

Strategic Plan Objective

Strategic Plan Objective

Yellow dot: Objective has some degree of funding, but less than the recommended amount. 1LB. Develop at least five measures of behavioral and/or biological heterogeneity in children or adults with ASD, beyond variation in intellectual disability, that clearly relate to etiology and risk, treatment response and/or outcome by 2015. IACC Recommended Budget: $71,100,000 over 5 years.

Project Link

Project Link

Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior (External web link)

Institution

Institution

Trustees of Boston University

State/Country

State/Country

Massachusetts

Project Number

Project Number

1029430

Federal or Private?

Federal or Private?

Federal

Received ARRA Funding?

Received ARRA Funding?

No

History/Related Projects

History/Related Projects

Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2011 | 1029035
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2011 | 1029373
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2011 | 1029430
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2011 | 1029585
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 24000 | 2011 | 1029679
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 16000 | 2011 | 1029549
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 600000 | 2012 | 1029373
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 1314749 | 2012 | 1029679
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 600000 | 2012 | 1029585
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 600658 | 2012 | 1029549
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 313753 | 2012 | 1029430
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 600000 | 2012 | 1029035
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2013 | 1029035
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2013 | 1029373
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2013 | 1029430
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2013 | 1029549
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2013 | 1029585
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 19200 | 2013 | 1029679
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2015 | 1029035
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2015 | 1029373
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2015 | 1029430
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 22000 | 2015 | 1029679
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2015 | 1029549
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2014 | 1029585
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 24000 | 2014 | 1029679
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 16000 | 2014 | 1029549
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2014 | 1029035
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2014 | 1029373
Collaborative research: Computational behavioral science: Modeling, analysis, and visualization of social and communicative behavior | 0 | 2015 | 1029585

 
Back to Top