this post was submitted on 15 Nov 2026
223 points (97.9% liked)

Technology

89802 readers
3106 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] tal@lemmy.today 54 points 5 hours ago* (last edited 4 hours ago)

I think that automation is fine, but when you start talking about life-critical systems, the bar on failure modes and reliability becomes a lot higher. Like, if you have a sensor for excessive chlorine levels, the default probably should be not to keep pumping more of the chemical in, but to have some "hard" upper level where no more chlorine goes in (and if the two systems aren't directly-integrated, to at least let the maintenance safety system power off the chlorine system), and for a secondary alarm to be triggered (like, start playing a loud audible alarm) if maintenance doesn't respond to the email notification and indicate that they've dismissed the alert within a given amount of time. That's disruptive and undesirable compared to just emailing maintenance, but as long as there aren't any failures, you shouldn't ever see it. But if you do have it come up, you don't want the failure mode to be chemical-keep-being-dumped-into-the-system-and-people-being-unaware-of-it.

You want fail-safe behavior.

Automation can increase safety by decreasing time until an issue is addressed, for example. Automation isn't intrinsically incompatible with safety. Aircraft computers today use TCAS to automatically instruct pilots what to do if they are about to collide (and in fact, today the automated system is explicitly given higher priority than human air traffic controllers


if the two give pilots conflicting directives, the human is the one to be disregarded). But you gotta make your automated procedures have high reliability and handle failure the way you want when the consequences of a failure are high (and that goes for non-automated procedures too).