this post was submitted on 09 Feb 2026
571 points (98.8% liked)

Technology

81078 readers
3945 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Chatbots provided incorrect, conflicting medical advice, researchers found: “Despite all the hype, AI just isn't ready to take on the role of the physician.”

“In an extreme case, two users sent very similar messages describing symptoms of a subarachnoid hemorrhage but were given opposite advice,” the study’s authors wrote. “One user was told to lie down in a dark room, and the other user was given the correct recommendation to seek emergency care.”

you are viewing a single comment's thread
view the rest of the comments
[–] Digit@lemmy.wtf 9 points 2 days ago (4 children)

Terrible programmers, psychologists, friends, designers, musicians, poets, copywriters, mathematicians, physicists, philosophers, etc too.

Though to be fair, doctors generally make terrible doctors too.

[–] hector@lemmy.today 5 points 2 days ago

Also bad lawyers. And lawyers also make terrible lawyers to be fair.

[–] Croquette@sh.itjust.works 2 points 2 days ago (1 children)

Doctors are a product of their training. The issue is that doctors are trained like humans are cars and they have tools to fix the cars.

Human problems are complex and the medecine field is slowly catching up, especially medecine targetted toward women, which was pretty lacking.

It takes time to transform a system and we are getting there slowly.

[–] Digit@lemmy.wtf 1 points 14 hours ago

Human problems are complex and the medecine field is slowly catching up, especially medecine targetted toward women, which was pretty lacking.

Lacking for either sex. Even though they're wrong any way, did you know the supplement RDA are all for women?

And... I'm not sure how much it's really catching up, and how much it's just reeling out just enough placatium to let the racket continue.

"For-Profit Medicine"'s an oxymoron that survives with its motto "A patient cured is a customer lost.". ... And a dead patient is just a cost of business. ... No wonder "Medicine" is the biggest killer. Especially when you consider how much heart disease and cancer (and most other disease) is from bad medical advice too, thus making all 3 of the top biggest killers (and others further down the list) iatrogenic^1^.

It takes time to transform a system and we are getting there slowly.

We may be getting there so slowly as to take longer than the life of the universe, given how so much is still headed in the wrong direction away from mending the system, since seemingly all of the incentives (certainly the moneyed incentives) are all pushing the other way... to maximising wealth extraction, rather than maximising health. We've let the asset managers, the vulture capitalists, get their fangs into the already long time corrupted health care systems (some places more than others), and from here, we'll see it worsen faster, perhaps to a complete collapse asymptote, as the rotters eat out all sustenance from within it.

^1^ "Induced unintentionally in a patient by a physician. Used especially of an infection or other complication of treatment"

[–] pkjqpg1h@lemmy.zip 1 points 2 days ago (1 children)

but you can hold them accountable (how can you hold an LLM accountable?)

[–] Digit@lemmy.wtf 2 points 14 hours ago (1 children)

With another LLM, turtle all the way down. ;D

Or for a more serious answer... improve your skills, scrutinise what they produce.

[–] pkjqpg1h@lemmy.zip 2 points 13 hours ago (1 children)

yeah I do I even use diff tools to see if they hallucinate

[–] Digit@lemmy.wtf 2 points 13 hours ago (1 children)

I have Lex Fridman's interview with [OpenClawD's] Peter Steinberger paused (to watch the rest after lunch), shortly after he mentioned something similarish, about how he's really only diffing now. The one manual tool left, keeping the human in the loop. n_n

Long live diff!

:D

[–] pkjqpg1h@lemmy.zip 1 points 13 hours ago

and Long live Wikipedia!

[–] stressballs@lemmy.zip 1 points 2 days ago* (last edited 2 days ago) (1 children)

This was my thought. The weird inconsistent diagnoses, and sending people to the emergency room for nothing, while another day dismissing serious things has been exactly my experience with doctors over and over again.

You need doctors and a Chatbot, and lots of luck.

[–] Digit@lemmy.wtf 1 points 14 hours ago

Yep.

Keep getting another 2nd opinion.

There's always more [to learn].