{"id":51043,"date":"2025-01-23T11:04:09","date_gmt":"2025-01-23T16:04:09","guid":{"rendered":"https:\/\/engineering.jhu.edu\/ams\/?post_type=tribe_events&#038;p=51043"},"modified":"2025-01-27T15:02:20","modified_gmt":"2025-01-27T20:02:20","slug":"ams-weekly-seminar-shiqian-ma","status":"publish","type":"tribe_events","link":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/","title":{"rendered":"AMS Weekly Seminar | Shiqian Ma"},"content":{"rendered":"<p><strong>Location:\u00a0<\/strong>Gilman 50<\/p>\n<p><strong>When:<\/strong>\u00a0January, 23rd at 1:30 p.m.<\/p>\n<p><strong>Title:\u00a0<\/strong><span>Decentralized Bilevel Optimization<\/span><\/p>\n<p><strong>Abstract:\u00a0<\/strong>Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. In this talk we focus on bilevel optimization in decentralized networks. In particular, we propose two algorithms for solving decentralized bilevel optimization. The first algorithm is a hypergradient method in the decentralized network environment, which is the first decentralized algorithm for bilevel optimization. The second algorithm is a novel single-loop algorithm that approximates the hypergradient using only two matrix-vector multiplications per iteration. Our single-loop algorithm does not require any gradient heterogeneity assumptions, which is a significant improvement over existing methods for decentralized bilevel optimization. Our analysis demonstrates that the proposed algorithm achieves the best-known convergence rate for decentralized bilevel optimization algorithms. We present experimental results on hyperparameter optimization and data hyper-cleaning problems to demonstrate the efficiency of our proposed algorithms.<\/p>\n<p style=\"font-weight: 400;\"><strong>Bio:<\/strong> Shiqian Ma is a professor in the Department of Computational Applied Mathematics and Operations Research and Department of Electrical and Computer Engineering at Rice University. He received his PhD in Industrial Engineering and Operations Research from Columbia University. His main research areas are optimization and machine learning. His research has been supported by ONR and NSF Grants from the DMS, CCF, and ECCS programs. Shiqian received the 2024 INFORMS Computing Society Prize and the 2024 SIAM Review SIGEST Award, among many other awards from both academia and industry. Shiqian is an Associate Editor of SIAM Journal on Optimization, Journal of Machine Learning Research, Journal of Optimization Theory and Applications, Pacific Journal of Optimization, and IISE Transactions, a Senior Area Chair of NeurIPS, an Area Chair of ICML, ICLR and AISTATS, and a Senior Program Committee of AAAI. He is a plenary speaker of the Texas Colloquium on Distributed Learning in 2023 and a semi-plenary speaker of the International Conference on Stochastic Programming in 2023. Shiqian is the elected Secretary\/Treasurer of the INFORMS Optimization Society in 2023-2025, and is the General Chair of the INFORMS Optimization Society Conference 2024.<\/p>\n<p><strong>Zoom link:<\/strong> https:\/\/wse.zoom.us\/j\/96299385386?pwd=HvOzDnw7A2SOQkMrbBbr5AXjqurdj0.1<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Location:\u00a0Gilman 50 When:\u00a0January, 23rd at 1:30 p.m. Title:\u00a0Decentralized Bilevel Optimization Abstract:\u00a0Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. In this talk&hellip;<\/p>\n","protected":false},"author":69,"featured_media":0,"template":"","meta":{"_acf_changed":false,"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"","_relevanssi_noindex_reason":"","_tribe_events_status":"","_tribe_events_status_reason":"","footnotes":""},"tags":[],"tribe_events_cat":[260],"class_list":["post-51043","tribe_events","type-tribe_events","status-publish","hentry","tribe_events_cat-seminars-and-endowed-lectures","cat_seminars-and-endowed-lectures"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>AMS Weekly Seminar | Shiqian Ma | Department of Applied Mathematics and Statistics<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AMS Weekly Seminar | Shiqian Ma | Department of Applied Mathematics and Statistics\" \/>\n<meta property=\"og:description\" content=\"Location:\u00a0Gilman 50 When:\u00a0January, 23rd at 1:30 p.m. Title:\u00a0Decentralized Bilevel Optimization Abstract:\u00a0Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. In this talk&hellip;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/\" \/>\n<meta property=\"og:site_name\" content=\"Department of Applied Mathematics and Statistics\" \/>\n<meta property=\"article:modified_time\" content=\"2025-01-27T20:02:20+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AMS Weekly Seminar | Shiqian Ma | Department of Applied Mathematics and Statistics","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/","og_locale":"en_US","og_type":"article","og_title":"AMS Weekly Seminar | Shiqian Ma | Department of Applied Mathematics and Statistics","og_description":"Location:\u00a0Gilman 50 When:\u00a0January, 23rd at 1:30 p.m. Title:\u00a0Decentralized Bilevel Optimization Abstract:\u00a0Bilevel optimization has gained significant attention in recent years due to its broad applications in machine learning. In this talk&hellip;","og_url":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/","og_site_name":"Department of Applied Mathematics and Statistics","article_modified_time":"2025-01-27T20:02:20+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/","url":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/","name":"AMS Weekly Seminar | Shiqian Ma | Department of Applied Mathematics and Statistics","isPartOf":{"@id":"https:\/\/engineering.jhu.edu\/ams\/#website"},"datePublished":"2025-01-23T16:04:09+00:00","dateModified":"2025-01-27T20:02:20+00:00","breadcrumb":{"@id":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/engineering.jhu.edu\/ams\/event\/ams-weekly-seminar-shiqian-ma\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/engineering.jhu.edu\/ams\/"},{"@type":"ListItem","position":2,"name":"Events","item":"https:\/\/engineering.jhu.edu\/ams\/events\/"},{"@type":"ListItem","position":3,"name":"AMS Weekly Seminar | Shiqian Ma"}]},{"@type":"WebSite","@id":"https:\/\/engineering.jhu.edu\/ams\/#website","url":"https:\/\/engineering.jhu.edu\/ams\/","name":"Hopkins Applied Math & Statistics","description":"Department of Applied Mathematics and Statistics","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/engineering.jhu.edu\/ams\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Department of Applied Mathematics and Statistics","distributor_original_site_url":"https:\/\/engineering.jhu.edu\/ams","push-errors":false,"_links":{"self":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tribe_events\/51043","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tribe_events"}],"about":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/types\/tribe_events"}],"author":[{"embeddable":true,"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/users\/69"}],"version-history":[{"count":2,"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tribe_events\/51043\/revisions"}],"predecessor-version":[{"id":51079,"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tribe_events\/51043\/revisions\/51079"}],"wp:attachment":[{"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/media?parent=51043"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tags?post=51043"},{"taxonomy":"tribe_events_cat","embeddable":true,"href":"https:\/\/engineering.jhu.edu\/ams\/wp-json\/wp\/v2\/tribe_events_cat?post=51043"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}