As use cases for augmented intelligence (AI) across the medical education continuum rapidly expand, transparency in how the technology is being employed in medical school assessment is essential, according to new policy adopted at the 2026 AMA Interim Meeting.
AI can make generating assessment materials more efficient, but quality remains a concern, says a resolution introduced by the AMA Medical Student Section. For example, a 2023 pilot study at a Canadian medical school found that 15% of AI-generated multiple-choice exam questions required revision because of issues such as outdated or inaccurate terminology and other errors.
Lack of clarity about AI’s role in assessment can shape how medical students approach their work. When learners do not understand how AI is used in grading, they may misunderstand the process or alter how they develop their answers.
“AI has the potential to help faculty manage a growing volume of applications and assessments of physicians-in-training and in practice, but it should support—not replace—human judgment in decisions that shape a physician’s career, and it is imperative that there is transparency for learners and prospective learners when AI is used to evaluate them,” said AMA Trustee Amar H. Kelkar, MD, MPH.
“Applicants and learners deserve access to meaningful human review, reevaluation, and appeals processes to ensure fairness, due process, and equity,” Dr. Kelkar added. “As the AMA develops guiding principles in this area, we will focus on guarding against bias so these tools widen opportunities in medicine.”
In a move to give medical students clarity about how these tools are being used, the AMA House of Delegates adopted new policy to support “risk-proportionate transparency on the use of generative AI and meaningful human review in the development and use of assessments for learners across the medical education, including medical students, resident and fellow physicians and practicing physicians participating in continuing medical education and continuing board certification.”
From AI implementation to digital health adoption and EHR usability, the AMA is fighting to make technology work for physicians, ensuring that it is an asset to doctors and the patients they care for. That includes the AMA Center for Digital Health and AI, which works to ensure physicians help shape how AI is developed, implemented and regulated across the healthcare system, with patient safety and physician-led care remaining at the center of those efforts.
Ensuring fairness in AI-aided admissions
AI-assisted review systems may offer useful ways to improve efficiency in medical school admissions and residency selection. As a result, technology is beginning to play a larger role in how applicants are screened, scored and evaluated.
But these systems also warrant caution, says a resolution introduced by the AMA Medical Student Section, Underrepresented in Medicine Advocacy Section and the Resident and Fellow Section. Research on AI in high-stakes decision-making has shown that such tools can reflect or amplify bias and rely on imprecise criteria, the resolution says.
Unchecked and unmonitored use of AI-assisted review systems in applicant vetting could adversely affect individual opportunities. More broadly, misuse of these systems could affect the shape of the future physician workforce.
In a move to ensure integrity in medical school admissions and residency-selection processes, the delegates directed the AMA to “study and report back on guiding principles for the ethical, equitable and transparent use of AI in the application, admission and selection-review processes, including access to human reevaluation and avenues to appeal or contest decisions.”
In addition, the House of Delegates adopted new policy to “support approaches to promote fairness, accountability and applicant due process related to the use of AI in the application process for medical school, residency and fellowships.”
Read about the other highlights from the 2026 AMA Interim Meeting.
