{"id":20109,"date":"2024-06-06T14:20:55","date_gmt":"2024-06-06T18:20:55","guid":{"rendered":"https:\/\/engineering.jhu.edu\/magazine-archive\/?p=20109"},"modified":"2024-06-11T11:33:42","modified_gmt":"2024-06-11T15:33:42","slug":"in-ai-we-trust","status":"publish","type":"post","link":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/","title":{"rendered":"In AI We Trust?"},"content":{"rendered":"<img loading=\"lazy\" decoding=\"async\" class=\"alignleft wp-image-20112 size-large\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy-1024x949.jpeg\" alt=\"Red letters reading &quot;In AI We Trust&quot; with a large question mark made from zeros and ones\" width=\"1024\" height=\"949\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy-1024x949.jpeg 1024w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy-300x278.jpeg 300w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy-768x712.jpeg 768w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy.jpeg 1287w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_20115\" class=\"wp-caption alignleft\" style=\"width: 251px\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-20115 size-medium\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Rama-Chellappa-greyscale-clipped-241x300.jpeg\" alt=\"grayscale head shot of Rama Chellappa wearing a suit and tie\" width=\"241\" height=\"300\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Rama-Chellappa-greyscale-clipped-241x300.jpeg 241w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Rama-Chellappa-greyscale-clipped.jpeg 600w\" sizes=\"auto, (max-width: 241px) 100vw, 241px\" \/><figcaption class=\"wp-caption-text\">Rama Chellappa: Bloomberg Distinguished Professor in electrical and computer engineering and biomedical engineering; Co-interim director, Data Science and AI Institute<\/figcaption><\/figure>\n<p>We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>To explore these and other timely issues that academic researchers are grappling with\u2014Can and should AI be regulated? How have rapid AI advances changed teaching?\u2014we brought together a panel of AI experts from across the Whiting School and tapped AI researcher <a href=\"https:\/\/engineering.jhu.edu\/faculty\/rama-chellappa\/\" target=\"_blank\" rel=\"noopener\"><b>RAMA CHELLAPPA <\/b><\/a>to lead them in a wide-ranging exchange. Highlights from their discussion follow.<\/p>\n<h4><span style=\"color: #993300;\">The \u2018Black-Box<span class=\"Apple-converted-space\">\u00a0<\/span>Problem\u2019<span class=\"Apple-converted-space\">\u00a0<\/span><\/span><\/h4>\n<blockquote><p><b>When it comes to artificial intelligence, how does the \u201cblack-box problem\u201d impact your work?<\/b><\/p><\/blockquote>\n<p><b>RAMA CHELLAPPA: <\/b>When we go to a doctor\u2019s office and we see diplomas from Harvard or Hopkins, we think the doctor knows what they are doing, and we trust them. But if the doctor is [employing] AI, we want to know where AI learned to diagnose illnesses and recommend therapies. When we have a physician, a patient, and AI working together, that requires complete trust. So, interpretability is a very key component to trusting the AI-based decision.<\/p>\n<p><b><a href=\"https:\/\/engineering.jhu.edu\/faculty\/natalia-trayanova\/\" target=\"_blank\" rel=\"noopener\">NATALIA TRAYANOVA<\/a>: <\/b>In my center\u2014the Alliance for Cardiovascular Diagnostic and Treatment Innovation\u2014our work is very clinically translational. Pretty much everything that we develop, our goal is to immediately bring it to the patient\u2019s bedside. We work very closely with clinicians. We are fully embedded in the Department of Cardiology, particularly interventional cardiology.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>In medical applications of AI, it is really important that we can learn how decisions are made. Black-box algorithms can restrict the clinician-patient relationship. The medical advice the doctor provides depends on medical reasoning and clarification, which is not available from black-box algorithms. When a black-box AI algorithm provides only a decision and not a justification for that decision, patients are deprived of an understanding of the underlying medical problems and why the decision is made. This can hurt the clinician-patient relationship and erode trust in the medical system. It\u2019s on our shoulders to develop AI applications that create and maintain that trust.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<figure id=\"attachment_20190\" class=\"wp-caption alignright\" style=\"width: 310px\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-20190 size-medium\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Mathias-Unberath_greyscale_clipped-300x200.jpeg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Mathias-Unberath_greyscale_clipped-300x200.jpeg 300w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Mathias-Unberath_greyscale_clipped-768x513.jpeg 768w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Mathias-Unberath_greyscale_clipped.jpeg 900w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption class=\"wp-caption-text\">Mathias Unberath: Assistant professor, Computer Science Laboratory for Computational and Sensing Robotics, and Malone Center for Engineering in Healthcare<\/figcaption><\/figure>\n<p><b><a href=\"https:\/\/engineering.jhu.edu\/faculty\/mathias-unberath\/\" target=\"_blank\" rel=\"noopener\">MATHIAS UNBERATH<\/a>: <\/b>This black-box problem requires nuanced discussion. The AI community is proposing explanations as a possible answer, but I think explainable AI may not always be the preferable solution\u2014and it may not even be necessary. Rigorous testing and evaluation to help elevate trust in AI at the technology level together with broader education will also contribute to an answer.<\/p>\n<p>But of course, achieving trustworthiness now is important. To contribute to this goal, we are trying to understand a few things. One is to better understand the datasets being used to develop these algorithms in hopes that understanding data-inherent biases will help us create models that don&#8217;t perpetuate [those biases]. Insights from causal reasoning as well as synthetic data can play an important role in this endeavor.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>The other is about how we deploy these models. If I train a model, will it be self-sufficient, and involve no human interaction? In some cases, this might be happening, but in other high-stakes environments, such as medicine, we might not want to run the model without human interaction. Then, we don\u2019t need to think exclusively about the model and its performance, but about the model and its possible explanations in the context of human interaction. That is a much more complicated problem.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b><a href=\"https:\/\/engineering.jhu.edu\/faculty\/daniel-khashabi\/\" target=\"_blank\" rel=\"noopener\">DANIEL KHASHABI<\/a>: <\/b>I want to second what Mathias said about making sure that users are part of this analysis. I don\u2019t think there will ever be an AI system that has responses interpretable to every human, so we need to define interpretability with respect to certain audiences.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>For example, people trust airplanes, not because we can \u201cinterpret\u201d them, but because we trust that someone who\u2019s an expert in airplanes can interpret their functionality.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>The same logic will likely hold also for various applications of AI. We should aim to build interpretable AI applications with high accuracy in, for example, the medical domain for experts in that domain. Increasingly, people will trust that others can interpret those results.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>MATHIAS UNBERATH: <\/b>What Daniel said about tailoring explanations to people is interesting. Right now, there seem to be very different philosophies in how we do \u201cexplainable AI.\u201d<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>There is the philosophy driven by people in the computer science\/computer vision\/machine learning AI community who are very interested in building novel explanation techniques that satisfy the needs of computational demand such as factual accuracy or fidelity. These people focus on computation first, with users and humans often being omitted or limited to an afterthought.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>And there\u2019s the human-computer interaction community that publishes in completely different venues. Their papers look and feel completely different, and they don\u2019t over-prioritize technical feasibility, especially early on, in favor of a more<span class=\"Apple-converted-space\">\u00a0<\/span>human-centered approach. They are focusing on tailoring a specific message to a specific user and measuring that. These two communities don\u2019t really connect.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>NATALIA TRAYANOVA: <\/b>To connect to Daniel\u2019s example of why people trust airplanes, patients don\u2019t question why they are given aspirin. They don\u2019t understand the mechanism by which aspirin works, but they take it because it\u2019s so commonly prescribed and has undergone so many clinical trials. I think this is something the AI community can look forward to.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<h4><span style=\"color: #993300;\">Danger Ahead?<\/span><b><span class=\"Apple-converted-space\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-20202 size-medium alignleft\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-300x259.jpeg\" alt=\"Illustration showing a double helix, a brain, researchers in lab coats, and a magnifying glass\" width=\"300\" height=\"259\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-300x259.jpeg 300w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-1024x885.jpeg 1024w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-768x664.jpeg 768w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-1536x1328.jpeg 1536w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Embracing-Difference_Interior-art-2048x1770.jpeg 2048w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/span><\/b><\/h4>\n<blockquote><p><b>Let\u2019s move on to talking about the risks of AI.<\/b><\/p><\/blockquote>\n<p><b>DANIEL KHASHABI: <\/b>I will briefly touch upon risks that keep me worried about the future of AI.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>AI thrives on data, and with the push to make AI systems more accurate, there\u2019s a lot of appetite for more data, and especially user data. The private sector is going to continue to collect increasingly more personalized data. Legislation in this country is so passive. That basically means that citizens here need to be vigilant, monitoring emerging applications and watching for anything that could possibly go wrong as a result of overuse or overreach of personalized data.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Relatedly, I\u2019m quite worried about the personalization of propaganda. In 2016, when we had an election, there was plenty of evidence that social media platforms were used to create propaganda to interfere with the election. Now that AI is being industrialized, it\u2019s possible to personalize this propaganda to an individual\u2019s mindset and you can frame your arguments to an individual\u2019s world model, values, and their most personal weaknesses, to sway their opinion. This is a really dangerous weapon for attacking a democracy.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>MATHIAS UNBERATH: <\/b>I have similar concerns, including that it\u2019s not always transparent what the objectives are that specific algorithms are optimized for.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Think about bail decisions or credit approval. The values or the reasons that go into making such decisions are very complicated and quantifying them in a way that can be optimized computationally via empirical risk minimization is not trivial. And there\u2019s an additional risk that we can introduce malicious behavior or exploitative intent by simply optimizing models to prioritize specific scenarios. Combine this with scalability of automated approaches, and poor decisions might be made at unprecedented scales.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Some say that we don\u2019t need to fear AI because we get to assign power to it, but I wholeheartedly disagree with this and that is because there is \u201ccreep.\u201d The presence of AI affects not just whether I consciously do or do not use it. AI can affect people\u2019s experiences subtly. For example, when it\u2019s used in areas like content moderation, it can change the landscape. On the individual level, the effects might be marginal, but at population level, they might tip the scales in favor of one policy or outcome, and that\u2019s power that nobody consciously assigned to AI.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>RAMA CHELLAPPA: <\/b>As far as risks, I always talk about domain shift\u2014you train AI using one kind of data and you change the data, and the performance becomes unpredictable. This happens in pathology, when different labs have different kinds of images, with slight changes.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>I also worry about attacks on AI systems and bias\u2014whether a system is fair to every group.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>AI\u2019s ability to generalize so it works for everybody makes it robust to attacks, but because people will try to attack any software system, we have to continuously monitor it. I think of it as a precocious child who will let the water run over in the kitchen sink to understand hydrology. We have to tell the kid to learn things properly and be useful.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>MATHIAS UNBERATH: <\/b>I agree with you. I am incredibly excited, and AI is a large part of my research agenda. I just think there\u2019s a lot of hype right now [and what\u2019s getting lost] is a more cautionary approach\u2014ensuring AI is scalable and that we can sustain its ethical deployment. I think those voices are a bit suppressed.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<blockquote><p><b>Should AI be regulated \u2026 and is regulation even feasible?<\/b><\/p><\/blockquote>\n<p><b>MATHIAS UNBERATH:<\/b>I am not a regulatory expert, so I don\u2019t think I sufficiently understand the regulatory powers and opportunities to meaningfully control AI. I invite the experts to help us better understand the situation and shape the conversations properly.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>However, I do think we have to think more carefully about how to contend with the risks AI systems pose when using data that is continually evolving over time. For instance, if an AI model is trained on one fixed dataset and then applied to data that is constantly changing, there is the risk of the model experiencing \u201cdrift,\u201d which leads to inaccuracy.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>There is also the issue that we cannot necessarily regulate what we don\u2019t understand. So, if companies bring out a new product with a certain behavior that we might not be able to even understand, how do we think about approving\u2014versus not approving\u2014 something as ethical or not ethical?<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>RAMA CHELLAPPA: <\/b>The FDA must approve many AI-based procedures. So, what is your opinion about AI regulation? And is it possible?<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<figure id=\"attachment_20187\" class=\"wp-caption alignright\" style=\"width: 274px\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-20187 size-medium\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Trayanova_greyscale_clipped-264x300.jpeg\" alt=\"grayscale image of NATALIA TRAYANOVA wearing a plaid jacket\" width=\"264\" height=\"300\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Trayanova_greyscale_clipped-264x300.jpeg 264w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/Trayanova_greyscale_clipped.jpeg 661w\" sizes=\"auto, (max-width: 264px) 100vw, 264px\" \/><figcaption class=\"wp-caption-text\">Natalia Trayanova: Murray B. Sachs Professor, Biomedical Engineering; Director, Alliance for Cardiovascular Diagnostic and Treatment Innovation<\/figcaption><\/figure>\n<p><b>NATALIA TRAYANOVA: <\/b>There are several possible overall big-picture approaches. One is that we pump the brakes a bit on the use of deep learning in very high-stakes applications. And the FDA is very much in line with that: They are not very keen to approve black-box deep learning applications for clinical decision-making. The FDA is very interested in explainability in these applications.<\/p>\n<p>For medical applications and beyond, the European Union is taking a more aggressive approach, creating a regulatory framework that sorts potential applications into risk categories. On March 13, 2024, they approved a landmark law governing AI. It imposed a blanket ban on some uses of AI such as biometric-based tools used to ascertain a person\u2019s race, sexual orientation, or political beliefs, prohibited the use of deep learning in situations where the potential for harm is high, such as finance, and criminal justice, but allowed low-stakes applications with guardrails.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>DANIEL KHASHABI: <\/b>Like my fellow panelists, I think the bulk of regulation should focus on applications, concentrating on where technology interacts with humans. We have various institutions that regulate and oversee sensitive domains, like the FDA and medical applications and the FAA and aviation.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Given AI\u2019s widespread application, we now need another regulatory body with a broad perspective on AI capabilities, deployed across a variety of applications. Maybe this body will work with the FDA and other domain-specific regulators. I worry about overregulating AI development because I don\u2019t want our progress to be curbed, but we need regulations on the AI development side, such as a certain level of transparency into how pre-training data was collected, ideally with some level of third-party investigators\/researchers.<\/p>\n<p><b>RAMA CHELLAPPA: <\/b>I\u2019m with you on that, Daniel. We had a meeting, last week at Johns Hopkins\u2019 Bloomberg Center [in Washington, D.C.] with U.S. Senators Mark Warner and Todd Young, and they talked about AI regulation and what Congress wants to do. There are many bills in development, and Senator Warner talked about how AI can negatively impact areas like financial markets. So, he says regulation may be coming, and Senator Young felt we don\u2019t have to start something entirely new but could probably build on what is already out there. I agree with a cautious approach to regulating AI.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<blockquote><p><b>Do you cover AI in your teaching? Has it changed your approach to teaching?<\/b><\/p><\/blockquote>\n<p><b>NATALIA TRAYANOVA: <\/b>I teach a core undergraduate class that students who are applying to medical school have to take, sort of computational medicine. I include the issues that we talked about today, but it\u2019s more general: What does it mean to bring AI into the clinical arena in medicine?<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>MATHIAS UNBERATH: <\/b>I teach a class on machine learning and deep learning and one on explainable machine learning, in the context of human-centered design. After [completing] these classes, students should understand the limitations of using these types of approaches.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>I built some of my code based on platforms and frameworks that are available online. So, if students want to use generative AI to help them code the homework assignments, given that these large language models are trained on everything that is on the internet, there is a high chance they will do quite well.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>But [for quizzes and exams], I\u2019ve been reverting to the \u201cMiddle Ages,\u201d where we use paper and a pen, and hopefully, we also use a brain, to demonstrate skills acquired in the class. I have reintroduced closed-book, pen and paper exams.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>DANIEL KHASHABI: <\/b>I always encourage my students in the class or my research lab to use generative AI to increase their productivity. This is just a new tool in their toolbox, to become effective researchers.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>This year, we needed to make a slight adaptation to my class. We are careful to make sure that questions we assign for homework are deeper and require more analysis. Even if [students] can prompt [a] language model, they have to be very creative how they prompt the model.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>I\u2019ve also tried to incorporate more interactivity in my class and we do more in-class activities and assignments during class so most learning happens during class hours.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<blockquote><p><b>Do you think AI and black-box issues should be taught as part of the first-year curriculum?<\/b><\/p><\/blockquote>\n<p><b>NATALIA TRAYANOVA: <\/b>I don\u2019t think in general it\u2019s suitable to teach AI and black-box issues in the first-year curriculum as black-box issues in AI require some prior knowledge.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>It\u2019s important to appropriately gauge when [AI curriculum] would fit a given population of students. You don\u2019t want to turn people off or scare them away. You want to introduce knowledge appropriately, so the approach should be to decide on a department-by-department and a school-by-school basis. I think in biomedical engineering it could be taught as part of the undergraduate experience, particularly if ethics issues are emphasized.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>MATHIAS UNBERATH: <\/b>I don\u2019t know the right moment to start discussing this. These things move very, very quickly\u2014like when the smartphone was introduced, making this crazy high level of computing accessible at your fingertips.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>I don\u2019t consider myself old, but when I meet younger people, I realize I\u2019m no longer young. Growing up, we had this modem making funny sounds, and you had to decide whether you wanted to place a telephone call or browse the internet at glacial speeds. We went from that to having a computer in our pockets very quickly.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Professors may be nimble at adapting to challenges and changing their course, but overall, schools might not have moved fast enough in areas such as digital well-being, where we need to consider the implications of disparities in technology use and access.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>There are new opportunities and challenges related to how we want to make up the fabric that holds society together: connectedness versus isolation, reverberation of personal views through content, moderation versus engagement with other viewpoints.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>So we have to think more broadly, and that might start well before a freshman AI ethics class.<\/p>\n<blockquote><p><b>What is a unique or creative use of AI that most people haven\u2019t considered yet?<\/b><\/p><\/blockquote>\n<p><b>MATHIAS UNBERATH: <\/b>I would love to see AI help us make more time for personal connections because I think we are spending too much time on tasks that don\u2019t require a human touch. If I look at my job or personal life satisfaction, most of it is attributable to interaction with others. Those are usually the most memorable and important moments, but I don\u2019t have enough of them because I end up spending too much time on things that I\u2019m not sure I need to be doing. So, this is the one direction where I would love to see AI go.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<figure id=\"attachment_20217\" class=\"wp-caption alignleft\" style=\"width: 307px\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-20217 size-medium\" src=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/daniel-kashabi_JHU0032_greyscale-clipped-copy-297x300.jpeg\" alt=\"grayscale photo of Daniel Khashabi standing with his arms crossed in front of his chest\" width=\"297\" height=\"300\" srcset=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/daniel-kashabi_JHU0032_greyscale-clipped-copy-297x300.jpeg 297w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/daniel-kashabi_JHU0032_greyscale-clipped-copy-768x775.jpeg 768w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/daniel-kashabi_JHU0032_greyscale-clipped-copy-125x125.jpeg 125w, https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/daniel-kashabi_JHU0032_greyscale-clipped-copy.jpeg 793w\" sizes=\"auto, (max-width: 297px) 100vw, 297px\" \/><figcaption class=\"wp-caption-text\">Daniel Khashabi: Assistant professor, Computer Science Center for Language and Speech Processing<\/figcaption><\/figure>\n<p><b>DANIEL KHASHABI: <\/b>My first wish is for a personal assistant. We are busy people, and I would love to have an assistant to tell \u201cfix this paper\u201d or do other tasks. That would save me time! My second wish is for trash-collecting robots. Every weekend, I volunteer to collect trash in our neighborhood and collecting trash is going to be a very difficult problem for AI-driven robots since every piece is different. So maybe in a couple of years, I will focus on trash-collecting robots.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>NATALIA TRAYANOVA: <\/b>What I want the most is medical foundation models (generalist medical AI) that make medical decisions without the need to train AI algorithms on specific datasets, then predict specific outcomes, and demonstrate generalizability on external datasets.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p>Our community has huge difficulties in getting anonymized patient data. So, I would like generalist models developed so we don\u2019t need data for each particular medical problem, we don\u2019t need to search for months to access external data, and so on. The medical generalist models will be our \u201cbase camp\u201d\u2014where we have general medical knowledge, and we just climb from there to solve a specific medical problem [she gestures], not climbing from the bottom every time, developing approaches de novo for each medical problem.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n<p><b>RAMA CHELLAPPA: <\/b>I think AI will greatly impact engineering design. My hope is to give it a layout of 10,000 buildings and then tell the AI, \u201cHey, give me a cool new building and these are my constraints. I want it to have four floors. I want this much made of glass,\u201d and have it somehow come up with a design that I probably never would have thought of.<span class=\"Apple-converted-space\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?<\/p>\n","protected":false},"author":30,"featured_media":20112,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[28],"tags":[],"class_list":["post-20109","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-features","issue-spring-2024"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>In AI We Trust? - JHU Engineering Magazine<\/title>\n<meta name=\"description\" content=\"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"In AI We Trust? - JHU Engineering Magazine\" \/>\n<meta property=\"og:description\" content=\"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/\" \/>\n<meta property=\"og:site_name\" content=\"JHU Engineering Magazine\" \/>\n<meta property=\"article:published_time\" content=\"2024-06-06T18:20:55+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-11T15:33:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/06\/carousel-ai2-social.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1393\" \/>\n\t<meta property=\"og:image:height\" content=\"729\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Monica Leigh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/06\/carousel-ai2-social.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Monica Leigh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"15 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/\"},\"author\":{\"name\":\"Monica Leigh\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/#\\\/schema\\\/person\\\/acfe7b0b2b4e334734cec46640d4b37c\"},\"headline\":\"In AI We Trust?\",\"datePublished\":\"2024-06-06T18:20:55+00:00\",\"dateModified\":\"2024-06-11T15:33:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/\"},\"wordCount\":3167,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/AI-Trust-opener-art-copy.jpeg\",\"articleSection\":[\"Features\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/\",\"url\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/\",\"name\":\"In AI We Trust? - JHU Engineering Magazine\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/AI-Trust-opener-art-copy.jpeg\",\"datePublished\":\"2024-06-06T18:20:55+00:00\",\"dateModified\":\"2024-06-11T15:33:42+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/#\\\/schema\\\/person\\\/acfe7b0b2b4e334734cec46640d4b37c\"},\"description\":\"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#primaryimage\",\"url\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/AI-Trust-opener-art-copy.jpeg\",\"contentUrl\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/wp-content\\\/uploads\\\/2024\\\/05\\\/AI-Trust-opener-art-copy.jpeg\",\"width\":1287,\"height\":1193,\"caption\":\"Red letters reading \\\"In AI We Trust\\\" with a large question mark made from zeros and ones\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/2024\\\/06\\\/in-ai-we-trust\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"In AI We Trust?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/#website\",\"url\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/\",\"name\":\"JHU Engineering Magazine\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/engineering.jhu.edu\\\/magazine-archive\\\/#\\\/schema\\\/person\\\/acfe7b0b2b4e334734cec46640d4b37c\",\"name\":\"Monica Leigh\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g\",\"caption\":\"Monica Leigh\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"In AI We Trust? - JHU Engineering Magazine","description":"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/","og_locale":"en_US","og_type":"article","og_title":"In AI We Trust? - JHU Engineering Magazine","og_description":"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?","og_url":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/","og_site_name":"JHU Engineering Magazine","article_published_time":"2024-06-06T18:20:55+00:00","article_modified_time":"2024-06-11T15:33:42+00:00","og_image":[{"width":1393,"height":729,"url":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/06\/carousel-ai2-social.jpg","type":"image\/jpeg"}],"author":"Monica Leigh","twitter_card":"summary_large_image","twitter_image":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/06\/carousel-ai2-social.jpg","twitter_misc":{"Written by":"Monica Leigh","Est. reading time":"15 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#article","isPartOf":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/"},"author":{"name":"Monica Leigh","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/#\/schema\/person\/acfe7b0b2b4e334734cec46640d4b37c"},"headline":"In AI We Trust?","datePublished":"2024-06-06T18:20:55+00:00","dateModified":"2024-06-11T15:33:42+00:00","mainEntityOfPage":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/"},"wordCount":3167,"commentCount":0,"image":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#primaryimage"},"thumbnailUrl":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy.jpeg","articleSection":["Features"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/","url":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/","name":"In AI We Trust? - JHU Engineering Magazine","isPartOf":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/#website"},"primaryImageOfPage":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#primaryimage"},"image":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#primaryimage"},"thumbnailUrl":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy.jpeg","datePublished":"2024-06-06T18:20:55+00:00","dateModified":"2024-06-11T15:33:42+00:00","author":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/#\/schema\/person\/acfe7b0b2b4e334734cec46640d4b37c"},"description":"We increasingly rely on AI models in our daily lives\u2014from traffic navigation and shopping apps to AI-informed care decisions made by our doctors. Given their ubiquity and influence, how and why should we trust these decisions? Can we be certain the models\u2019 predictions are free of biases or errors?","breadcrumb":{"@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#primaryimage","url":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy.jpeg","contentUrl":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-content\/uploads\/2024\/05\/AI-Trust-opener-art-copy.jpeg","width":1287,"height":1193,"caption":"Red letters reading \"In AI We Trust\" with a large question mark made from zeros and ones"},{"@type":"BreadcrumbList","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/2024\/06\/in-ai-we-trust\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/engineering.jhu.edu\/magazine-archive\/"},{"@type":"ListItem","position":2,"name":"In AI We Trust?"}]},{"@type":"WebSite","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/#website","url":"https:\/\/engineering.jhu.edu\/magazine-archive\/","name":"JHU Engineering Magazine","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/engineering.jhu.edu\/magazine-archive\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/engineering.jhu.edu\/magazine-archive\/#\/schema\/person\/acfe7b0b2b4e334734cec46640d4b37c","name":"Monica Leigh","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/453a535757449a6e5df98157a139bf964b78333c2f686d5468bf82ada8e18252?s=96&r=g","caption":"Monica Leigh"}}]}},"_links":{"self":[{"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/posts\/20109","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/users\/30"}],"replies":[{"embeddable":true,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/comments?post=20109"}],"version-history":[{"count":24,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/posts\/20109\/revisions"}],"predecessor-version":[{"id":20779,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/posts\/20109\/revisions\/20779"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/media\/20112"}],"wp:attachment":[{"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/media?parent=20109"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/categories?post=20109"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/engineering.jhu.edu\/magazine-archive\/wp-json\/wp\/v2\/tags?post=20109"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}