Skip to content
Interagency Autism Coordinating Committee (IACC)
Autism Research Database
Office of Autism Research Coordination (OARC)
 
Project Element Element Description

Project Title

Project Title

Characterizing ASD phenotypes by multimedia signal and natural language processing

Principal Investigator

Principal Investigator

Elhadad, Noemie

Description

Description

A major challenge facing autism research is the lack of objective measures to characterize the disorder’s various phenotypes. More quantitative phenotypic measures, derived objectively from biological measurements, would facilitate genetic association studies by allowing biologically heterogeneous populations to be categorized into subgroups. They could also help refine diagnostic procedures. Noémie Elhadad from Columbia University and Partha Mitra from Cold Spring Harbor Laboratory plan to address this issue using data from the Simons Simplex Collection (SSC), a cohort of families that have one child with autism and unaffected siblings and parents. The SSC includes video recordings of patients undergoing the Autism Diagnosis Observation Schedule (ADOS) protocol, a standardized interview for assessing and diagnosing autism. The researchers plan to analyze these recordings using two techniques: natural language processing, which evaluates linguistic features of the subjects’ speech, such as intonation and use of unusual word combinations, and multimedia signal processing, which assesses audiovisual elements of the recordings such as the speakers’ facial emotions and where they are looking. They will then combine the findings with the subjects’ ADOS scores and other demographic and clinical features to develop a set of quantitative phenotypic measures for autism. The processed data will be added to the SSC knowledge base for use by other researchers. Elhadad and Mitra also plan to make their linguistic and audiovisual analysis platform publicly available.

Funder

Funder

Simons Foundation

Fiscal Year Funding

Fiscal Year Funding

0

Current Award Period

Current Award Period

2009-2012

Strategic Plan Question

Strategic Plan Question

Question 1: When Should I Be Concerned?

Strategic Plan Objective

Strategic Plan Objective

Yellow dot: Objective has some degree of funding, but less than the recommended amount. 1LC. Identify and develop measures to assess at least three "continuous dimensions" (e.g., social reciprocity, communication disorders, and repetitive/restrictive behaviors) of ASD symptoms and severity that can be used by practitioners and/or families to assess response to intervention for people with ASD across the lifespan by 2016. IACC Recommended Budget: $18,500,000 over 5 years.

Project Link

Project Link

Characterizing ASD phenotypes by multimedia signal and natural language processing (External web link)

Institution

Institution

Columbia University

State/Country

State/Country

New York

Project Number

Project Number

137297

Federal or Private?

Federal or Private?

Private

Received ARRA Funding?

Received ARRA Funding?

No

History/Related Projects

History/Related Projects

Characterizing ASD phenotypes by multimedia signal and natural language processing | 263303 | 2010 | 137297
Characterizing ASD phenotypes by multimedia signal and natural language processing | 65726 | 2009 | 137297
Characterizing ASD phenotypes by multimedia signal and natural language processing | 339498 | 2011 | 137297

 
Back to Top