{"id":1754,"date":"2020-10-16T19:54:45","date_gmt":"2020-10-16T19:54:45","guid":{"rendered":"http:\/\/sites.rutgers.edu\/lgsa\/?p=1754"},"modified":"2022-05-24T13:43:45","modified_gmt":"2022-05-24T13:43:45","slug":"prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language","status":"publish","type":"post","link":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/","title":{"rendered":"Prof. D’Imperio Receives NSF Grant for AI Facial Analytics in Language"},"content":{"rendered":"

Prof. Mariapaola D’Imperio<\/a><\/strong><\/span> has been awarded a one-year, interdisciplinary NSF grant<\/strong> <\/span>as a co-PI with Dimitris Metaxas<\/a><\/span><\/strong> (Rutgers CS), Caron Neidle<\/a><\/span><\/strong> (Boston University), and Matt Huenerfauth<\/a><\/span><\/strong> (Rochester IT). Additional information is below:<\/p>\n

Project Title:<\/strong><\/span> “NSF Convergence Accelerator\u2013Track D: Data & AI Methods for Modeling Facial Expressions in Language with Applications to Privacy for the Deaf, ASL Education & Linguistic Research<\/a>“<\/span><\/strong><\/p>\n

Summary<\/strong><\/span>:<\/p>\n

There are currently no reliable\u00a0AI methods for facial analytics<\/strong>\u00a0that can be widely used across do\u00admains and applications (signed & spoken lan\u00adguag\u00ades, military security, detection of deception & emo\u00adtion). We have been developing such AI meth\u00adods, algorithms, and related data infrastructure\u00a0(with\u00a0NSF\u00a0support)\u00a0for American Sign Language (ASL).<\/p>\n

We have assembled an\u00a0interdisciplinary team<\/strong>\u00a0of\u00a0linguists, computer scientists, Deaf and hearing experts on ASL, and potential industry partners.<\/p>\n

We propose to leverage and extend our work to date in order to\u00a0address research and societal challenges through four\u00a0types\u00a0of\u00a0deliverables<\/strong>,\u00a0targeted to\u00a0diverse<\/strong>\u00a0<\/strong>user<\/strong>\u00a0<\/strong>and<\/strong>\u00a0<\/strong>research<\/strong>\u00a0<\/strong>communities<\/strong>:<\/p>\n

1) Modifications and extension of our ASL-based tools, methods, and data sharing to encompass spoken language. Although facial expressions and head gestures, which are essential to the grammar of signed languages, also play an important role in speech, this is currently not well-understood, because resources of the kind we will provide have not been available to researchers. The new data and analyses will also enable comparative study of the role of facial ex\u00adpres\u00adsions across modalities, as well as the role of facial expressions in sign language vs. prosody in spoken language. The raw data, analyses, and visualizations that we will be share for our signed and (new) spoken language, linguistically annotated, video corpora will open up vast new avenues for linguistic and computer science research on spoken and signed languages aimed at understanding the role and spatiotemporal synchronization of facial expressions and head gestures in conjunction with speech and signing. The results of such research will have a broad set of impacts and applications.<\/p>\n

2) An application to help ASL learners produce facial expressions and head gestures to convey grammatical information in signed languages; and<\/p>\n

3) Development of a tool for real-time anonymization of ASL videos to preserve grammatical information expressed non-manually, while de-identifying the signer.”<\/p>\n","protected":false},"excerpt":{"rendered":"

Prof. Mariapaola D’Imperio has been awarded a one-year, interdisciplinary NSF grant as a co-PI with Dimitris Metaxas (Rutgers CS), Caron Neidle (Boston University), and Matt Huenerfauth (Rochester IT). Additional information … Read More<\/a><\/p>\n","protected":false},"author":39,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1754","post","type-post","status-publish","format-standard","hentry","category-news"],"acf":[],"yoast_head":"\nProf. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Prof. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association\" \/>\n<meta property=\"og:description\" content=\"Prof. Mariapaola D’Imperio has been awarded a one-year, interdisciplinary NSF grant as a co-PI with Dimitris Metaxas (Rutgers CS), Caron Neidle (Boston University), and Matt Huenerfauth (Rochester IT). Additional information … Read More\" \/>\n<meta property=\"og:url\" content=\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/\" \/>\n<meta property=\"og:site_name\" content=\"Linguistics Graduate Students Association\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-16T19:54:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-05-24T13:43:45+00:00\" \/>\n<meta name=\"author\" content=\"Kristen Syrett\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kristen Syrett\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/\",\"url\":\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/\",\"name\":\"Prof. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association\",\"isPartOf\":{\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/#website\"},\"datePublished\":\"2020-10-16T19:54:45+00:00\",\"dateModified\":\"2022-05-24T13:43:45+00:00\",\"author\":{\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/bb4ed38640aa23e784e84e1a1068acf3\"},\"breadcrumb\":{\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/sites.rutgers.edu\/lgsa\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Prof. D’Imperio Receives NSF Grant for AI Facial Analytics in Language\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/#website\",\"url\":\"https:\/\/sites.rutgers.edu\/lgsa\/\",\"name\":\"Linguistics Graduate Students Association\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/sites.rutgers.edu\/lgsa\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/bb4ed38640aa23e784e84e1a1068acf3\",\"name\":\"Kristen Syrett\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8d7308ea82969062f62882199d743d13?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8d7308ea82969062f62882199d743d13?s=96&d=mm&r=g\",\"caption\":\"Kristen Syrett\"},\"url\":\"https:\/\/sites.rutgers.edu\/lgsa\/author\/syrettk\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Prof. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/","og_locale":"en_US","og_type":"article","og_title":"Prof. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association","og_description":"Prof. Mariapaola D’Imperio has been awarded a one-year, interdisciplinary NSF grant as a co-PI with Dimitris Metaxas (Rutgers CS), Caron Neidle (Boston University), and Matt Huenerfauth (Rochester IT). Additional information … Read More","og_url":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/","og_site_name":"Linguistics Graduate Students Association","article_published_time":"2020-10-16T19:54:45+00:00","article_modified_time":"2022-05-24T13:43:45+00:00","author":"Kristen Syrett","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kristen Syrett","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/","url":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/","name":"Prof. D'Imperio Receives NSF Grant for AI Facial Analytics in Language - Linguistics Graduate Students Association","isPartOf":{"@id":"https:\/\/sites.rutgers.edu\/lgsa\/#website"},"datePublished":"2020-10-16T19:54:45+00:00","dateModified":"2022-05-24T13:43:45+00:00","author":{"@id":"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/bb4ed38640aa23e784e84e1a1068acf3"},"breadcrumb":{"@id":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/sites.rutgers.edu\/lgsa\/prof-dimperio-receives-nsf-grant-for-ai-facial-analytics-in-language\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/sites.rutgers.edu\/lgsa\/"},{"@type":"ListItem","position":2,"name":"Prof. D’Imperio Receives NSF Grant for AI Facial Analytics in Language"}]},{"@type":"WebSite","@id":"https:\/\/sites.rutgers.edu\/lgsa\/#website","url":"https:\/\/sites.rutgers.edu\/lgsa\/","name":"Linguistics Graduate Students Association","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/sites.rutgers.edu\/lgsa\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/bb4ed38640aa23e784e84e1a1068acf3","name":"Kristen Syrett","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/sites.rutgers.edu\/lgsa\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8d7308ea82969062f62882199d743d13?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8d7308ea82969062f62882199d743d13?s=96&d=mm&r=g","caption":"Kristen Syrett"},"url":"https:\/\/sites.rutgers.edu\/lgsa\/author\/syrettk\/"}]}},"_links":{"self":[{"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/posts\/1754"}],"collection":[{"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/comments?post=1754"}],"version-history":[{"count":1,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/posts\/1754\/revisions"}],"predecessor-version":[{"id":1755,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/posts\/1754\/revisions\/1755"}],"wp:attachment":[{"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/media?parent=1754"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/categories?post=1754"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.rutgers.edu\/lgsa\/wp-json\/wp\/v2\/tags?post=1754"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}