.Attribute Medicine, Posted online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although huge foreign language designs (LLMs) show commitment in measured setups, a study currently exposes their limitations in real-world professional requests and points the way towards strong assessment as well as benchmarking before clinical usage.