You are not alone. I feel like the world is quickly giving in to LLMs and I'm one of the very rare holdouts. My nephews, my coworkers, my bosses... all of them use a mix of ChatGPT, Gemini, and/or Claude regularly. Hell, even my therapist tells me his wife uses ChatGPT for everything. I remember being worried when kids would immediately answer questions with some obnoxious response akin to "just Google it". I wondered if abandoning the need to remember anything would impact development. Now they instantly go to a chatbot.
I've tried it a few times with difficult problems and always found hallucinations. If I'm looking for something that doesn't exist, the LLM has always made up a convincing answer. It's frightening how so many people trust it blindly.
I work in US Public Education and the adoption of AI in this space scares the living fuck out of me. I understand the argument: "Kids are using it, or are going to use it. We need to get out in front of it." That's fine. Find a provider that "promises" not to use student data. Protect PII. Great.
But some district admins are enthusiastically using it. I literally mentioned in conversation that I needed to check when something was due for the state and they immediately asked Gemini and assumed the answer was correct. Another one 100% uses it for letters summarizing student performance and freaks out when ChapGPT is down. I can only imagine how horrific it must be in the private sector where the goal is efficiency and profit over everything.
This shit needs to pop, and fast.