{"id":573092,"date":"2025-06-02T11:06:40","date_gmt":"2025-06-02T15:06:40","guid":{"rendered":"https:\/\/engineering.jhu.edu\/ece\/?post_type=news&p=573092"},"modified":"2025-06-02T11:06:40","modified_gmt":"2025-06-02T15:06:40","slug":"ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size","status":"publish","type":"news","link":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/","title":{"rendered":"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size"},"content":{"rendered":"

AI systems used to identify people in images and video may rely too much on body size, potentially affecting their accuracy and performance, according to a new study<\/a> by Johns Hopkins researchers. The researchers analyzed person re-identification (ReID) models\u2014 widely used in public safety and surveillance applications\u2014and introduced a framework called expressivity to measure how strongly attributes like body mass index (BMI), pose, and gender are reflected in the system\u2019s decision-making. Their results<\/span><\/a> appear on the preprint site arXiv.<\/p>\n

Person ReID models are trained to recognize individuals across video frames or camera views by analyzing visual body features. But because they often rely heavily on physical traits that can change, like weight or posture, these models risk making errors, misidentifying people of similar height but different body compositions or not identifying someone if their weight changes.<\/p>\n

\u201cIn deep learning, what you don\u2019t train for can be just as impactful as what you do,\u201d said co-author Rama Chellappa, Bloomberg Distinguished Professor in electrical and computer engineering and biomedical engineering and Interim Co-director of the Data Science and AI Institute. \u201cOur goal was to measure how much identity recognition models rely on body attributes they weren\u2019t explicitly taught to recognize.\u201d<\/p>\n

To do this, the researchers adapted a concept known as expressivity, a statistical method originally developed for face recognition models, to evaluate how body-based ReID systems translate physical features into data for identifying people.<\/p>\n

\u201cExpressivity measures how much information about a specific attribute, such as BMI or pose angle, is embedded in the model\u2019s internal feature representations,\u201d said co-author Siyuan Huang, a PhD student in electrical and computer engineering. \u201cWe used this method to analyze SemReID, a state-of-the-art vision transformer model for person ReID.\u201d<\/p>\n

Their findings were striking: BMI emerged as the most influential factor encoded in the model\u2019s deepest layers, even though it was never an explicit training feature. BMI consistently ranked higher in expressivity than head orientation (pitch and yaw) and gender.<\/p>\n

\u201cThe model is making identity predictions that rely heavily on body shape,\u201d said co-author Basudha Pal, a PhD student in electrical and computer engineering. \u201cPose and even gender were secondary.\u201d<\/p>\n

While body size is part of how people appear, the researchers note that over-reliance on it can lead to inaccurate results, especially since BMI can fluctuate over time and often varies across different ages, genders, or racial groups.<\/p>\n

To trace how these attributes evolved during learning, the researchers examined different parts\u2014called layers\u2014of the transformer model and how it assessed physical features. They found that in early layers, the models focused on pose-related details, like head angle or body position, reflecting the network\u2019s attention to how people are oriented in space. But as training progressed, those pose-related cues became less important, and BMI became the main feature used and considered.<\/p>\n

\"\"

Integrating the MINE block with the ViT based SemReID backbone to compute the expressivity of features with respect to attributes such as BMI, gender, pitch and yaw. The internal structure of the MINE block employs a simple MLP with two hidden layers to compute the expressivity of m<\/em>-dimensional features F.<\/em> By augmenting these features with an attribute vector A<\/em>, the input to the network is extended to (m<\/em>+1) -dimensions.<\/p><\/div>\n

In contrast, gender was much less important. While gender expression can play a role in how people are perceived, the researchers caution that even subtle cues can still influence a model\u2019s predictions\u2014especially when training data is not balanced across different groups.<\/p>\n

The team said that their expressivity framework offers several advantages over traditional tools used to evaluate AI models. It can handle both fixed traits, like gender, and more variable ones, like BMI or head angle. It also works with pre-trained models, eliminating the need for retraining. This makes it especially valuable for evaluating AI systems already in use in real-world settings.<\/p>\n

\u201cThis approach helps us not only interpret what these models are learning but also understand the correlations they rely on,\u201d said Pal. \u201cWith person ReID being used in sensitive applications, we need tools like this to make sure we\u2019re building systems that are fair and robust.\u201d<\/p>\n

The study was supported by the Intelligence Advanced Research Projects Activity<\/a> (IARPA) as part of the BRIAR project. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of ODNI, IARPA, or the U.S. Government.<\/em><\/p>\n","protected":false},"template":"","class_list":["post-573092","news","type-news","status-publish","hentry","news_categories-research"],"acf":[],"yoast_head":"\nAI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size - Department of Electrical and Computer Engineering<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size - Department of Electrical and Computer Engineering\" \/>\n<meta property=\"og:description\" content=\"AI systems used to identify people in images and video may rely too much on body size, potentially affecting their accuracy and performance, according to a new study by Johns…\" \/>\n<meta property=\"og:url\" content=\"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/\" \/>\n<meta property=\"og:site_name\" content=\"Department of Electrical and Computer Engineering\" \/>\n<meta property=\"og:image\" content=\"https:\/\/engineering.jhu.edu\/ece\/wp-content\/uploads\/2025\/06\/mainteaser-1.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"4262\" \/>\n\t<meta property=\"og:image:height\" content=\"1993\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size - Department of Electrical and Computer Engineering","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/","og_locale":"en_US","og_type":"article","og_title":"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size - Department of Electrical and Computer Engineering","og_description":"AI systems used to identify people in images and video may rely too much on body size, potentially affecting their accuracy and performance, according to a new study by Johns…","og_url":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/","og_site_name":"Department of Electrical and Computer Engineering","og_image":[{"width":4262,"height":1993,"url":"https:\/\/engineering.jhu.edu\/ece\/wp-content\/uploads\/2025\/06\/mainteaser-1.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/","url":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/","name":"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size - Department of Electrical and Computer Engineering","isPartOf":{"@id":"https:\/\/engineering.jhu.edu\/ece\/#website"},"primaryImageOfPage":{"@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/#primaryimage"},"image":{"@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/#primaryimage"},"thumbnailUrl":"https:\/\/engineering.jhu.edu\/ece\/wp-content\/uploads\/2025\/06\/mainteaser-1.jpg","datePublished":"2025-06-02T15:06:40+00:00","breadcrumb":{"@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/#primaryimage","url":"https:\/\/engineering.jhu.edu\/ece\/wp-content\/uploads\/2025\/06\/mainteaser-1.jpg","contentUrl":"https:\/\/engineering.jhu.edu\/ece\/wp-content\/uploads\/2025\/06\/mainteaser-1.jpg","width":4262,"height":1993},{"@type":"BreadcrumbList","@id":"https:\/\/engineering.jhu.edu\/ece\/news\/ai-puts-too-much-weight-where-it-shouldnt-on-your-body-size\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/engineering.jhu.edu\/ece\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/engineering.jhu.edu\/ece\/news\/"},{"@type":"ListItem","position":3,"name":"AI Puts Too Much Weight Where It Shouldn\u2019t: On Your Body Size"}]},{"@type":"WebSite","@id":"https:\/\/engineering.jhu.edu\/ece\/#website","url":"https:\/\/engineering.jhu.edu\/ece\/","name":"Department of Electrical and Computer Engineering","description":"Department of Electrical and Computer Engineering","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/engineering.jhu.edu\/ece\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Department of Electrical and Computer Engineering","distributor_original_site_url":"https:\/\/engineering.jhu.edu\/ece","push-errors":false,"_links":{"self":[{"href":"https:\/\/engineering.jhu.edu\/ece\/wp-json\/wp\/v2\/news\/573092","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/engineering.jhu.edu\/ece\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/engineering.jhu.edu\/ece\/wp-json\/wp\/v2\/types\/news"}],"wp:attachment":[{"href":"https:\/\/engineering.jhu.edu\/ece\/wp-json\/wp\/v2\/media?parent=573092"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}