The team has developed the MultiModal MultiDimensional (M3D) labeling scheme for the annotation of multimodal corpora, which offers a dimensionalized approach to the annotation of communicative body movements (i.e., manual gestures, head movements, and other articulators) in terms of their form, their semantic and pragmatic contributions to speech, and their relationship to speech prosody.

In collaboration with:

• Dr. Patrick Louis Rohrer (Radboud University)

• Dr. Ingrid Vilà-Giménez (UdG)

• Dr. Núria Esteve-Gibert (UOC)

• Ada Ren (MIT)

• Dr. Stefanie Shattuck-Hufnagel (MIT)

• Dr. Pilar Prieto (ICREA/UPF)