{"id":47395,"date":"2024-02-06T14:56:18","date_gmt":"2024-02-06T19:56:18","guid":{"rendered":"https:\/\/engineering.jhu.edu\/ams\/?post_type=news&p=47395"},"modified":"2025-09-17T13:35:00","modified_gmt":"2025-09-17T17:35:00","slug":"breaking-dimensional-limits-in-ai","status":"publish","type":"news","link":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/","title":{"rendered":"Breaking dimensional limits in AI\u00a0"},"content":{"rendered":"

Machine learning has revolutionized data processing, making possible innovations such as self-driving vehicles and medical artificial intelligence systems that can spotlight disease in vast collections of medical images. However, most current machine learning models can only process data sets with the same dimension as those they were trained on, restricting their real-world usefulness.<\/span>\u00a0<\/span>\u00a0<\/span><\/p>\n

Mateo D\u00edaz<\/span><\/a>, an assistant professor in the <\/span>Whiting School of Engineering\u2019s<\/span><\/a> Department of Applied Mathematics and Statistics, and his collaborator <\/span>Eitan Levin<\/span><\/a>, a graduate student at the California Institute of Technology, offer a new approach:<\/a> an innovative machine learning method that allows neural networks trained on a dataset of one size or dimension to process another, unlocking potential applications in domains ranging from physics to social networks.\u202f(In the world of machine learning, \u201cdimension\u201d refers to the number of features or attributes in a data set. For example, a dataset used to analyze housing prices could include dimensions like square footage, property age, number of bedrooms, and distance from good public schools.)<\/span>\u00a0<\/span><\/p>\n

The team\u2019s results will be presented at the <\/span>27<\/span>th<\/span> International Conference on Artificial Intelligence and Statistics (AISTATS)<\/span><\/a> in Valencia, Spain in May.\u00a0<\/span>\u00a0<\/span><\/p>\n

\u201cWe figured out a way to teach models to tackle problems in dimensions much higher than the one used for learning. Imagine we trained a computer to tell us the most efficient way to visit every bar in Baltimore and then asked the computer the same question for New York City, which is more than 10 times bigger. Current machine learning methods would only be able to handle cities of the same size as Baltimore; ours, on the other hand, can scale,\u201d said D\u00edaz.<\/span>\u00a0<\/span><\/p>\n

The key to the team\u2019s approach was the discovery of what D\u00edaz called \u201can unexpected link\u201d between traditional machine learning techniques and an abstract algebraic concept called \u201crepresentational stability,\u201d which says that certain mathematical objects\u2014numbers, vectors, matrices, and tensors\u2014 behave in the same way even when their underlying coordinate systems change.\u00a0<\/span>\u00a0<\/span>\u202f<\/span>\u00a0<\/span><\/p>\n

\u201cRepresentation stability lets us design \u2018equivariant\u2019 neural networks that keep their capabilities even when the dimension or size of the data inputs changes,\u201d he said. \u201cThis general stability phenomenon is rather flexible and allows us to do any-dimensional learning in graphs or networks, in particle systems, and more.\u201d<\/span>\u00a0<\/span><\/p>\n

\u202fThe team first determined characteristics that make neural networks across various dimensions compatible, allowing them to be parameterized using a finite amount of <\/span>information. The researchers used this connection to develop an algorithm and test it. D\u00edaz said this not only made the implementation feasible but also paved the way for any-dimensional learning.\u202f<\/span>\u00a0<\/span><\/p>\n

\u201cOur approach is one of the first to point out that representation stability can be leveraged this way, and our preliminary experimental results are encouraging,\u201d he said.\u00a0<\/span>\u00a0<\/span><\/p>\n

The team hopes to improve the method\u2019s efficiency by exploring ad hoc solutions for specific scenarios and delving deeper into statistical questions regarding the limits of any-dimensional learning.\u202f\u202f<\/span>\u00a0<\/span><\/p>\n

\u201cThis study not only forges a novel connection between representation stability and machine learning but potentially unlocks new avenues for exploration and introduces the concept of any-dimensional learning, laying the groundwork for addressing previously unexplored questions in the field,\u201d he said.\u00a0<\/span>\u00a0<\/span><\/p>\n

\u00a0<\/span><\/p>\n","protected":false},"template":"","class_list":["post-47395","news","type-news","status-publish","hentry","news_categories-applied-mathematics","news_categories-data-science","news_categories-research"],"acf":[],"yoast_head":"\nBreaking dimensional limits in AI\u00a0 | Department of Applied Mathematics and Statistics<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Breaking dimensional limits in AI\u00a0 | Department of Applied Mathematics and Statistics\" \/>\n<meta property=\"og:description\" content=\"Machine learning has revolutionized data processing, making possible innovations such as self-driving vehicles and medical artificial intelligence systems that can spotlight disease in vast collections of medical images. However, most…\" \/>\n<meta property=\"og:url\" content=\"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/\" \/>\n<meta property=\"og:site_name\" content=\"Department of Applied Mathematics and Statistics\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-17T17:35:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/engineering.jhu.edu\/ams\/wp-content\/uploads\/2024\/02\/Mateo-Diaz-Story-Photo-1024x683.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"683\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/engineering.jhu.edu\/ams\/wp-content\/uploads\/2024\/02\/Mateo-Diaz-Story-Photo.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Breaking dimensional limits in AI\u00a0 | Department of Applied Mathematics and Statistics","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/","og_locale":"en_US","og_type":"article","og_title":"Breaking dimensional limits in AI\u00a0 | Department of Applied Mathematics and Statistics","og_description":"Machine learning has revolutionized data processing, making possible innovations such as self-driving vehicles and medical artificial intelligence systems that can spotlight disease in vast collections of medical images. However, most…","og_url":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/","og_site_name":"Department of Applied Mathematics and Statistics","article_modified_time":"2025-09-17T17:35:00+00:00","og_image":[{"width":1024,"height":683,"url":"https:\/\/engineering.jhu.edu\/ams\/wp-content\/uploads\/2024\/02\/Mateo-Diaz-Story-Photo-1024x683.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_image":"https:\/\/engineering.jhu.edu\/ams\/wp-content\/uploads\/2024\/02\/Mateo-Diaz-Story-Photo.jpg","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/","url":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/","name":"Breaking dimensional limits in AI\u00a0 | Department of Applied Mathematics and Statistics","isPartOf":{"@id":"https:\/\/engineering.jhu.edu\/ams\/#website"},"datePublished":"2024-02-06T19:56:18+00:00","dateModified":"2025-09-17T17:35:00+00:00","breadcrumb":{"@id":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/engineering.jhu.edu\/ams\/news\/breaking-dimensional-limits-in-ai\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/engineering.jhu.edu\/ams\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/engineering.jhu.edu\/ams\/news\/"},{"@type":"ListItem","position":3,"name":"Breaking dimensional limits in AI\u00a0"}]},{"@type":"WebSite","@id":"https:\/\/engineering.jhu.edu\/ams\/#website","url":"https:\/\/engineering.jhu.edu\/ams\/","name":"Hopkins Applied Math & Statistics","description":"Department of Applied Mathematics and Statistics","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/engineering.jhu.edu\/ams\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Department of Applied Mathematics and Statistics","distributor_original_site_url":"https:\/\/engineering.jhu.edu\/ams","push-errors":false,"_links":{"self":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/news\/47395","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/types\/news"}],"wp:attachment":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/media?parent=47395"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}