A recent randomized clinical trial investigated the impact of ChatGPT, a large language model (LLM), on physicians’ diagnostic reasoning abilities. The study, involving 50 physicians from various specialties, found that access to ChatGPT did not significantly improve diagnostic performance compared to conventional resources alone. Surprisingly, ChatGPT outperformed both physician groups when used independently. The research highlights challenges in effectively integrating AI tools into clinical practice, including physicians’ reluctance to accept AI suggestions and lack of familiarity with optimal LLM use. These findings underscore the need for better training and integration strategies to harness the potential of AI in medicine, while maintaining the crucial role of human expertise in patient care.