Skip to main content

ChatGPT Performs Well as 'Partner' in Diagnosing Patients

Medically reviewed by Carmen Pope, BPharm. Last updated on Dec 13, 2023.

By Ernie Mundell HealthDay Reporter

TUESDAY, Dec. 12, 2023 -- Doctor's brains are great decision-makers, but even the smartest physicians might be well-served with a little diagnostic help from ChatGPT, a new study suggests.

The main benefit comes from a thinking process known as "probabilistic reasoning" -- knowing the odds that something will (or won't) happen.

“Humans struggle with probabilistic reasoning, the practice of making decisions based on calculating odds,” explained study lead author Dr. Adam Rodman, of Beth Israel Deaconess Medical Center in Boston.

“Probabilistic reasoning is one of several components of making a diagnosis, which is an incredibly complex process that uses a variety of different cognitive strategies," he explained in a Beth Israel news release. "We chose to evaluate probabilistic reasoning in isolation, because it is a well-known area where humans could use support.”

The Beth Israel team utilized data from a previously published survey of 550 health care practitioners. All had been asked to perform probabilistic reasoning to diagnose five separate medical cases.

In the new study, however, Rodman's team gave the same five cases to ChatGPT's AI algorithm, the Large Language Model (LLM), ChatGPT-4.

The cases included information from common medical tests, such as a chest scan for pneumonia, a mammography for breast cancer, a stress test for coronary artery disease and a urine culture for urinary tract infection.

Based on that info, the chatbot used its own probabilistic reasoning to reassess the likelihood of various patient diagnoses.

Of the five cases, the chatbot was more accurate than the human doctor for two; similarly accurate for another two; and less accurate for one. The researchers considered this a "draw" when comparing humans to the chatbot for medical diagnoses.

But the ChatGPT-4 chatbot excelled when a patients' tests came back negative (rather than positive), becoming more accurate at diagnosis than the doctors in all five cases.

“Humans sometimes feel the risk is higher than it is after a negative test result, which can lead to over-treatment, more tests and too many medications,” Rodman pointed out. He's an internal medicine physician and investigator in the department of medicine at Beth Israel.

The study was published Dec. 11 in JAMA Network Open.

It's possible then that doctors may someday work in tandem with AI to become even more accurate in patient diagnosis, the researchers said.

Rodman called that prospect "exciting."

"Even if imperfect, their [chatbots'] ease of use and ability to be integrated into clinical workflows could theoretically make humans make better decisions,” he said. “Future research into collective human and artificial intelligence is sorely needed.”

Sources

  • Beth Israel Deaconess Medical Center, news release, Dec. 11, 2023

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

© 2024 HealthDay. All rights reserved.

Posted December 2023

Read this next

1 in 8 Older Americans Are Stricken With Traumatic Head Injury

FRIDAY, May 31, 2024 -- About one in eight U.S. seniors will be treated for a traumatic brain injury, typically during a fall, a new study finds. Medicare data shows that about...

Could Tough Workouts Trigger a Hot Flash?

FRIDAY, May 31, 2024 -- While going through menopause, many women who gain weight head to the gym for intense workouts, but new research suggests that too much exercise may help...

U.S. Deaths Linked to ATVs Rose by a Third in One Year

FRIDAY, May 31, 2024 -- In just one year, U.S. deaths linked to the use of all-terrain vehicles (ATVs) jumped by a third, according to the latest report from the Consumer Product...

More news resources

Subscribe to our newsletter

Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.