Co-host Ryan Piansky, a graduate student and patient advocate living with eosinophilic esophagitis (EoE) and eosinophilic asthma, and co-host Holly Knotowicz, a speech-language pathologist living with EoE who serves on APFED’s Health Sciences Advisory Council, have a conversation about artificial intelligence (AI) and patient education, with guest Dr. Corey Ketchem, a third-year Gastroenterology Fellow at the University of Pennsylvania. In this episode, Ryan, Holly, and Dr. Ketchem discuss Dr. Ketchem’s interests, and his research into using an AI chatbot to provide patient education on eosinophilic gastrointestinal diseases. He shares, in broad terms, the methodology and conclusion of the research and what current and future research he is pursuing about using artificial intelligence to improve patient education and care. Listen to this episode to learn about the current limitations and potential future benefits of using AI to help patients. Disclaimer: The information provided in this podcast is designed to support, not replace the relationship that exists between listeners and their healthcare providers. Opinions, information, and recommendations shared in this podcast are not a substitute for medical advice. Decisions related to medical care should be made with your healthcare provider. Opinions and views of guests and co-hosts are their own. Key Takeaways: [1:17] Ryan Piansky and co-host Holly Knotowicz introduce the topic, artificial intelligence and patient education, and their guest, Dr. Corey Ketchem, a third-year Gastroenterology Fellow at the University of Pennsylvania. [1:30] Dr. Corey Ketchem has an interest in allergic inflammation of the gastrointestinal tract, particularly eosinophilic gastrointestinal diseases (EGIDs), as well as artificial intelligence and epidemiologic studies. [2:01] Dr. Ketchem did his residency at the University of Pennsylvania following medical school. There he met Dr. Evan Dellon, a world expert in EoE. Dr. Dellon became a mentor to Dr. Ketchem. [2:24] As Dr. Ketchem learned more about EoE, he was fascinated by the many unknowns and opportunities for discovery within the eosinophilic GI field. He wanted to make an impact on patient care. [2:51] Under Dr. Dellon’s mentorship, he did epidemiologic studies. Seeking specialized training, he ended up at the University of Pennsylvania where he is getting rigorous training in epidemiology to study EGIDs. [3:18] As ChatGPT was gaining its buzz, Dr. Ketchem saw a lot of clinical applicability. He views AI as an asset in epidemiology and hopes to use it to accelerate his research. [4:30] AI usually references using computers to mimic human abilities, estimate decisions, or predict outcomes. An example is Natural Language Processing (NLP), to analyze and understand human language. Large Language Models (LLM) use NLP. [5:08] ChatGPT is based on a LLM. LLMs use NLP techniques to understand vast amounts of text that they are trained on and generate responses in a chat format. [5:25] Machine learning is another subset of AI that uses statistical techniques to give computers the ability to learn with the data and predict outcomes. [5:50] The hope is to use these AI techniques to speed up discovery and also minimize human expense or labor. [6:28] Dr. Ketchem co-authored a paper in Clinical Gastroenterology and Hepatology about an AI chatbot and EoE. He had been inspired by a cardiology paper on whether ChatGPT would create accurate, appropriate answers about cardiology disease health. [7:19] Dr. Ketchem wondered if ChatGPT could be applied to EoE education. He discussed it with Dr. Dellon and Dr. Krystle Lynch, Dr. Ketchem’s mentor at the University of Pennsylvania, and with Dr. Joy Chang, at the University of Michigan. They came up with a study design. [8:06] The study asked ChatGPT questions about EoE, focusing on patient education and the therapeutics, and seeing if it gave accurate responses or not. [8:45] The four doctors developed 40 questions that they gave ChatGPT as prompts and evaluated the responses. They proposed the questions in two ways: each question in an individual chat and 40 questions in a single chat. [9:41] Analyzing the responses, the study demonstrated that ChatGPT responded with multiple inaccuracies to questions about EoE on general topics, complications, and management. Over half of the responses mixed correct and incorrect information. [10:09] To evaluate the readability of the responses, the doctors used the Flesch-Kincaid reading ease tool. To understand the output from ChatGPT one would need high school and two years of college. That poses a potential health literacy barrier. [11:40] The questions ranged from general: “What is eosinophilic esophagitis?”, to complications: “What is a food impaction?”, “What is a stricture?”, to therapeutics: “What are steroids for eosinophilic esophagitis?”, “Can I use a proton pump ...
