ChatGPT Gives False and Even Dangerous Health Advice
My questions were answered with myths, misconceptions and dangerous falsehoods
Anyone seeking health information or advice should be extremely cautious with OpenAI’s ChatGPT app. I tested the so-called generative artificial intelligence (AI) app on some basic health questions, and while it offered accurate (if brief and incomplete) answers to some of my questions, it failed in multiple cases, repeating common myths, misconceptions and falsehoods that ranged from unhelpful to outright dangerous.
ChatGPT knows it’s far from perfect—it told me so, as you’ll see below. But since it provides no citations or links to further information, it’s impossible to know where it gets its info, good or bad.
Below are the questions I posed, and ChatGPT’s answers, word-for-word in their entirety. False and misleading passages are highlighted in bold, followed by the reality in each case with a link to an article for more information.
What is normal human body temperature?
The normal human body temperature is typically around 98.6 degrees Fahrenheit (37 degrees Celsius) when measured orally. However, individual body temperature can vary slightly throughout the day and can also depend on factors such as age, sex, and physical activity. In general, a body temperature of 100.4 degrees Fahrenheit (38 degrees Celsius) or higher is considered a fever and may indicate an underlying infection or illness.
Reality: ChatGPT got it wrong, though a lot of healthcare providers aren’t up to speed on this one, either. The inaccurate number dates back to an 1851 analysis of patients in one German city. A 2017 study put the mean human body temperature at 97.9 F, and more recent research has revealed significant differences in the average between men and women, and much greater variation among individuals than was previously recognized. Oh, and as a species, we’re cooling off.
What’s the best remedy for chronic pain?
Chronic pain can be a complex condition that requires individualized treatment based on the underlying cause and individual circumstances. There is no one-size-fits-all remedy for chronic pain, and treatment may involve a combination of approaches. Here are some possible remedies for chronic pain:
Medications: Depending on the cause of the pain, medications such as nonsteroidal anti-inflammatory drugs (NSAIDs), opioids, and anticonvulsants may be prescribed.
Physical therapy: Physical therapy can help alleviate pain and improve function by using exercises, stretches, and other techniques to increase flexibility, strength, and range of motion.
Mind-body therapies: Techniques like meditation, yoga, tai chi, and deep breathing can help manage chronic pain by reducing stress and improving relaxation.
Acupuncture: Acupuncture involves inserting thin needles into specific points on the body to promote natural healing and pain relief.
Transcutaneous electrical nerve stimulation (TENS): TENS involves the use of a small device that sends electrical impulses to nerve endings to relieve pain.
Surgery: In some cases, surgery may be necessary to alleviate chronic pain.
It’s important to work with a healthcare provider to determine the most appropriate treatment plan for your chronic pain.
Reality: Ouch. This response is dangerous and irresponsible. First, while opioids can be effective for acute pain, there’s no convincing evidence they work on chronic pain, and the risk of addiction is extreme. Surgery? Rarely works for chronic pain — studies actually find sham surgeries often work just as well (due to the placebo effect). Finally, kudos to ChatGPT for mentioning exercise via physical therapy. However, exercise should be the top go-to treatment for most people with chronic pain, experts say, and while a physical therapist may be necessary in some cases, and other options may be in order, much of what modern humans need to battle chronic pain involves simply getting off our duffs and walking or otherwise being more physically active. It’s not that ChatGPT didn’t mention exercise, but it failed to emphasize its importance in the mix.
How many steps should I take each day to be physically fit?
The number of steps you should take each day to be physically fit can vary depending on several factors, such as your age, current level of physical activity, and overall health goals. However, a general recommendation for healthy adults is to aim for at least 10,000 steps per day.
This recommendation is based on the idea that walking 10,000 steps per day can help improve cardiovascular health, increase physical activity, and promote weight loss. However, it’s important to note that 10,000 steps per day is a rough estimate and may not be appropriate for everyone. Factors such as age, weight, fitness level, and other health conditions may impact the number of steps you need to take.
In general, the best approach to achieving physical fitness is to combine regular physical activity with a healthy diet and lifestyle habits. It’s important to consult with your healthcare provider before beginning any new exercise program, particularly if you have any underlying health conditions or concerns.
Reality: The idea that 10,000 steps has any meaning at all was debunked long ago. The myth stems from 1965, when a Japanese company introduced the first commercial pedometer and called it Manpo-kei, which translates to “10,000-step meter.” The number stuck and has been incorporated into many fitness apps and tracking devices. While it’s fine to walk that much, that’s a stretch goal for many people, impractical or even impossible for others, and health benefits kick in at much lower numbers and start to level off before 10,000.
Is alcohol good for me?
There is no simple answer to this question, as the effects of alcohol on your health depend on a variety of factors, such as your age, gender, overall health, and the amount of alcohol consumed.
Moderate alcohol consumption has been associated with some health benefits, particularly for reducing the risk of heart disease in some people. However, even moderate alcohol consumption can have negative effects on other aspects of your health, such as increasing the risk of certain types of cancer, liver disease, and mental health problems.
Excessive alcohol consumption can have serious negative effects on your health, including increased risk of alcohol addiction, liver damage, high blood pressure, and increased risk of certain cancers.
It’s important to remember that any potential health benefits associated with alcohol consumption are outweighed by the risks of excessive alcohol consumption. If you do choose to drink alcohol, it’s recommended that you do so in moderation and consider any potential negative effects on your health. It’s also important to seek help if you or someone you know is struggling with alcohol addiction.
Reality: Terrible, dangerous advice. The appealing notion that a drink or two is good for you was thoroughly debunked almost a decade ago, and in repeated studies since. Much as many of use would prefer not to hear it, the truth is that alcohol is bad for the human body, in any quantity. The falsehood repeated by ChatGPT is rooted in old studies that considered people who had quit drinking for health reasons to be unhealthy nondrinkers, and people who drank may have been healthy at the time a study was done, with the notable bad effects of alcohol not showing up until later in life.
How much water should I drink?
The amount of water you should drink can depend on various factors such as your age, sex, body weight, level of physical activity, climate, and overall health.
As a general guideline, it is recommended that adults drink at least 8 glasses (64 ounces) of water per day. However, some people may need more or less water depending on their individual needs.
One way to determine your specific water needs is to consider your body weight. A common recommendation is to drink half of your body weight in ounces of water per day. For example, if you weigh 150 pounds, you would aim to drink 75 ounces of water per day.
It’s important to note that this guideline is just an estimate, and you may need to adjust your water intake based on your individual needs. Additionally, other beverages and foods that you consume throughout the day can also contribute to your overall hydration levels.
If you have any concerns about your water intake or hydration levels, it’s always a good idea to consult with a healthcare professional.
Reality: Ignorant. The old 8x8 rule — that you should drink eight 8-ounce glasses (equal to 8 cups) of water daily, has no basis in science. Nobody even knows where it came from. Yes, it’s important to drink enough water, but your water can come from fruits, vegetables, soup and other foods and drinks, and the amount of total fluid anyone needs varies greatly, from around 11.4 cups on average for women and 15.6 cups for men. And the notion that a 150-pound person needs 75 ounces (9.4 cups) is flat wrong no matter how you analyze it.
The bottom line: beware
Artificial intelligence shows great promise as a resource for physicians, and future iterations of ChatGPT, including a version currently being tested, may prove more reliable.
A study earlier this year found ChatGPT was almost able to meet the 60% accuracy threshold required to pass the United States Medical Licensing Exam. And research published last month in the journal JAMA Internal Medicine found that on average, ChatGPT did better than physicians at providing high-quality, empathetic patient advice.
In its current iteration, however, ChatGPT is often unable to sort fact from fiction on important health topics. None of its faulty answers should surprise us. ChatGPT warns at the bottom of every page: “ChatGPT may produce inaccurate information about people, places, or facts.”
Rather than leave it there, I decided to let ChatGPT have the last word. My final query:
Some of your health information is inaccurate. Why?
As an AI language model, I do not have personal experiences or emotions, and my responses are generated based on patterns and correlations found in large datasets of text. My responses are not intended to provide medical advice or diagnosis, and I always recommend consulting with a qualified healthcare professional for personalized advice.
It is possible that the health information I provide may be inaccurate due to limitations in the training data and biases that may exist in the data. Additionally, health information is constantly evolving and changing as new research and studies are conducted, so the information available at the time of my training may be different from what is currently understood.
If you believe that some of the health information I have provided is inaccurate, please let me know so I can review and improve my responses accordingly.
***
Your support makes my writing possible. You can sign up for emails when I publish on Medium, or join Medium via this link to directly support me and gain full access to all Medium stories, or get my book, Make Sleep Your Superpower. I post additional health news briefs on Mastodon. — Rob
